Nov 06 11:36:54 devstack cinder-volume[76097]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 06 11:36:54 devstack cinder-volume[76097]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 06 11:36:54 devstack cinder-volume[76097]: we strongly recommend against using it for new projects.
Nov 06 11:36:54 devstack cinder-volume[76097]: If you are already using Eventlet, we recommend migrating to a different
Nov 06 11:36:54 devstack cinder-volume[76097]: framework.  For more detail see
Nov 06 11:36:54 devstack cinder-volume[76097]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 06 11:36:54 devstack cinder-volume[76097]:   import eventlet  # noqa
Nov 06 11:36:57 devstack cinder-volume[76097]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76097) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 06 11:36:57 devstack cinder-volume[76097]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76097) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 06 11:36:57 devstack cinder-volume[76097]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76097) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 06 11:36:58 devstack cinder-volume[76097]: INFO dbcounter [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] Registered counter for database cinder
Nov 06 11:36:58 devstack cinder-volume[76097]: DEBUG oslo_db.sqlalchemy.engines [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76097) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 06 11:36:58 devstack cinder-volume[76097]: DEBUG dbcounter [-] [76097] Writer thread running {{(pid=76097) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 06 11:36:58 devstack cinder-volume[76097]: INFO cinder.rpc [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 06 11:36:58 devstack cinder-volume[76097]: INFO cinder.rpc [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 06 11:36:58 devstack cinder-volume[76097]: DEBUG oslo_db.sqlalchemy.engines [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76097) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 06 11:36:58 devstack cinder-volume[76097]: INFO cinder.volume.manager [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] Determined volume DB was empty at startup.
Nov 06 11:36:58 devstack cinder-volume[76097]: DEBUG cinder.volume.manager [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76097) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 06 11:36:58 devstack cinder-volume[76097]: INFO cinder.volume.manager [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] Service not found for updating active_backend_id, assuming default for driver init.
Nov 06 11:36:58 devstack cinder-volume[76097]: WARNING stevedore.named [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 06 11:36:58 devstack cinder-volume[76097]: WARNING castellan.key_manager [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 06 11:36:58 devstack cinder-volume[76097]: WARNING cinder.keymgr.conf_key_mgr [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 06 11:36:58 devstack cinder-volume[76097]: DEBUG cinder.volume.drivers.lvm [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76097) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Nov 06 11:36:58 devstack cinder-volume[76097]: DEBUG oslo_concurrency.processutils [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76097) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_concurrency.processutils [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] CMD "cinder-rtstool verify" returned: 0 in 0.393s {{(pid=76097) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_db.sqlalchemy.engines [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76097) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 06 11:36:59 devstack cinder-volume[76097]: INFO cinder.rpc [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Nov 06 11:36:59 devstack cinder-volume[76097]: INFO cinder.rpc [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Nov 06 11:36:59 devstack cinder-volume[76097]: WARNING stevedore.named [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 06 11:36:59 devstack cinder-volume[76097]: WARNING castellan.key_manager [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 06 11:36:59 devstack cinder-volume[76097]: INFO cinder.volume.manager [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_db.sqlalchemy.engines [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76097) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 06 11:36:59 devstack cinder-volume[76097]: INFO oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] Starting 1 workers
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] Started child 76251 {{(pid=76097) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] Full set of CONF: {{(pid=76097) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] ******************************************************************************** {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] Configuration options gathered from: {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] ================================================================================ {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] allow_availability_zone_fallback = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] allow_compression_on_image_upload = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] allowed_direct_url_schemes     = [] {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] api_rate_limit                 = True {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] auth_strategy                  = keystone {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] az_cache_duration              = 3600 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_availability_zone      = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_host                   = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_name                   = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_stats_polling_interval = 60 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backup_api_class               = cinder.backup.api.API {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backup_name_template           = backup-%s {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backup_use_same_host           = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backup_use_temp_snapshot       = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] chap_password                  = **** {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] chap_username                  =  {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] cinder_internal_tenant_project_id = df10fdcf532045cab86ea2cece5e6ec7 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] cinder_internal_tenant_user_id = adf0c61e825142b185e4454841ba9f54 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] cloned_volume_same_az          = True {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] cluster                        = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] compression_format             = gzip {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] compute_api_class              = cinder.compute.nova.API {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] config_dir                     = [] {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] config_source                  = [] {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] control_exchange               = openstack {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] debug                          = True {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] default_availability_zone      = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] default_group_type             = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] default_volume_type            = lvmdriver-1 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] disk_geometry                  = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] driver_client_cert             = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] driver_client_cert_key         = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] driver_data_namespace          = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] driver_ssl_cert_path           = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] driver_ssl_cert_verify         = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] driver_use_ssl                 = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] enable_force_upload            = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] enable_new_services            = True {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] enable_unsupported_driver      = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] enforce_multipath_for_image_xfer = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] filter_function                = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] glance_api_insecure            = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] glance_api_servers             = ['http://192.168.122.253/image'] {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] glance_api_ssl_compression     = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] glance_ca_certificates_file    = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] glance_catalog_info            = image:glance:publicURL {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] glance_certfile                = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] glance_keyfile                 = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] glance_num_retries             = 3 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] glance_request_timeout         = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] goodness_function              = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] graceful_shutdown_timeout      = 5 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] group_api_class                = cinder.group.api.API {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] host                           = devstack {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] image_compress_on_upload       = True {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] image_conversion_address_space_limit = 1 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] image_conversion_cpu_limit     = 60 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76251]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1)
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] image_conversion_disable       = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] image_introspection_address_space_limit = 1 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] image_introspection_cpu_limit  = 60 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] image_upload_use_cinder_backend = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] image_upload_use_internal_tenant = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] image_volume_cache_enabled     = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] image_volume_cache_max_count   = 0 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] image_volume_cache_max_size_gb = 0 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] init_host_max_objects_retrieval = 0 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] instance_format                = [instance: %(uuid)s]  {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] iscsi_target_flags             =  {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] iscsi_write_cache              = on {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] iser_helper                    = tgtadm {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] iser_ip_address                = 192.168.122.253 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] iser_port                      = 3260 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] log_color                      = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] log_config_append              = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] log_dir                        = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] log_file                       = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] log_options                    = True {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] log_rotate_interval            = 1 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] log_rotate_interval_type       = days {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] log_rotation_type              = none {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] max_age                        = 0 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] max_logfile_count              = 30 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] max_logfile_size_mb            = 200 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] max_over_subscription_ratio    = 20.0 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] message_reap_interval          = 86400 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] message_ttl                    = 2592000 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] migration_create_volume_timeout_secs = 300 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] monkey_patch                   = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] monkey_patch_modules           = [] {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] my_ip                          = 192.168.122.253 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] no_snapshot_gb_quota           = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] num_iser_scan_tries            = 3 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] num_shell_tries                = 3 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] num_volume_device_scan_tries   = 3 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] nvmeof_conn_info_version       = 1 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] nvmet_ns_id                    = 10 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] nvmet_port_id                  = 1 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] osapi_max_limit                = 1000 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] osapi_volume_ext_list          = [] {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] osapi_volume_listen_port       = 8776 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] osapi_volume_use_ssl           = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] osapi_volume_workers           = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] per_volume_size_limit          = -1 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] periodic_fuzzy_delay           = 60 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] periodic_interval              = 60 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] public_endpoint                = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] publish_errors                 = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] quota_backup_gigabytes         = 1000 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] quota_backups                  = 10 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] quota_gigabytes                = 1000 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] quota_groups                   = 10 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] quota_snapshots                = 10 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] quota_volumes                  = 10 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] rate_limit_burst               = 0 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] rate_limit_except_level        = CRITICAL {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] rate_limit_interval            = 0 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] reinit_driver_count            = 3 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] replication_device             = **** {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] report_discard_supported       = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] report_interval                = 120 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] reservation_clean_interval     = 86400 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] reservation_expire             = 86400 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] reserved_image_namespaces      = [] {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] reserved_percentage            = 0 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] rpc_response_timeout           = 120 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] run_external_periodic_tasks    = True {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] scst_target_driver             = iscsi {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] scst_target_iqn_name           = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] service_down_time              = 720 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] shell_completion               = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] snapshot_name_template         = snapshot-%s {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] snapshot_same_host             = True {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] split_loggers                  = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] state_path                     = /opt/stack/data/cinder {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] storage_availability_zone      = nova {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] storage_protocol               = iSCSI {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] syslog_log_facility            = LOG_USER {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] target_helper                  = lioadm {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] target_ip_address              = 192.168.122.253 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] target_port                    = 3260 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] target_protocol                = iscsi {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] target_secondary_ip_addresses  = [] {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] trace_flags                    = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] transport_url                  = **** {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] until_refresh                  = 0 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] use_chap_auth                  = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] use_default_quota_class        = True {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] use_journal                    = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] use_json                       = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] use_multipath_for_image_xfer   = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] use_stderr                     = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] use_syslog                     = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] verify_glance_signatures       = enabled {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] volume_api_class               = cinder.volume.api.API {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] volume_backend_name            = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] volume_clear                   = zero {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] volume_clear_ionice            = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] volume_clear_size              = 0 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] volume_copy_bps_limit          = 0 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] volume_dd_blocksize            = 1M {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] volume_name_template           = volume-%s {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] volume_service_inithost_offload = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] volume_usage_audit_period      = month {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] zoning_mode                    = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_concurrency.disable_process_locking = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] keystone_authtoken.auth_section = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] keystone_authtoken.auth_type   = password {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] keystone_authtoken.auth_version = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] keystone_authtoken.cache       = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] keystone_authtoken.certfile    = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] keystone_authtoken.include_service_catalog = True {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] keystone_authtoken.insecure    = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] keystone_authtoken.interface   = public {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] keystone_authtoken.keyfile     = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] keystone_authtoken.memcache_password = **** {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] keystone_authtoken.memcache_username = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] keystone_authtoken.region_name = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] keystone_authtoken.service_type = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.253/identity {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] cache.backend                  = dogpile.cache.null {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] cache.backend_argument         = **** {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] cache.backend_expiration_time  = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] cache.config_prefix            = cache.oslo {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] cache.debug_cache_backend      = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] cache.enable_retry_client      = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] cache.enable_socket_keepalive  = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] cache.enabled                  = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] cache.expiration_time          = 600 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] cache.hashclient_retry_attempts = 2 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] cache.memcache_dead_retry      = 300 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] cache.memcache_pool_maxsize    = 10 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] cache.memcache_sasl_enabled    = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] cache.password                 = **** {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] cache.proxies                  = [] {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] cache.redis_db                 = 0 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] cache.redis_server             = localhost:6379 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] cache.retry_attempts           = 2 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] cache.retry_delay              = 0.0 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] cache.socket_keepalive_count   = 1 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] cache.socket_keepalive_idle    = 1 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] cache.socket_keepalive_interval = 1 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] cache.socket_timeout           = 1.0 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] cache.tls_allowed_ciphers      = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] cache.tls_cafile               = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] cache.tls_certfile             = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] cache.tls_enabled              = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] cache.tls_keyfile              = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] cache.username                 = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] coordination.backend_url       = **** {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] database.asyncio_connection    = **** {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] database.asyncio_slave_connection = **** {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] database.backend               = sqlalchemy {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] database.connection            = **** {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] database.connection_debug      = 0 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] database.connection_parameters =  {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] database.connection_recycle_time = 3600 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] database.connection_trace      = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] database.db_inc_retry_interval = True {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] database.db_max_retries        = 20 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] database.db_max_retry_interval = 10 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] database.db_retry_interval     = 1 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] database.max_overflow          = 50 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] database.max_pool_size         = 5 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] database.max_retries           = 10 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] database.mysql_wsrep_sync_wait = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] database.pool_timeout          = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] database.retry_interval        = 10 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] database.slave_connection      = **** {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] database.sqlite_synchronous    = True {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] database.synchronous_reader    = True {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] database.use_db_reconnect      = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_tracing.insecure = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] profiler.connection_string     = messaging:// {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] profiler.enabled               = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] profiler.es_doc_type           = notification {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] profiler.es_scroll_size        = 10000 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] profiler.es_scroll_time        = 2m {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] profiler.filter_error_trace    = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] profiler.hmac_keys             = **** {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] profiler.sentinel_service_name = mymaster {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] profiler.socket_timeout        = 0.1 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] profiler.trace_requests        = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] profiler.trace_sqlalchemy      = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] profiler_jaeger.process_tags   = {} {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] profiler_jaeger.service_name_prefix = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] profiler_otlp.service_name_prefix = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_policy.enforce_new_defaults = True {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_policy.policy_default_rule = default {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_policy.policy_file        = policy.yaml {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76251]: INFO cinder.volume.manager [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Nov 06 11:36:59 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] privsep_osbrick.group          = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] privsep_osbrick.helper_command = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] privsep_osbrick.user           = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] cinder_sys_admin.group         = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] cinder_sys_admin.helper_command = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] cinder_sys_admin.user          = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] service_user.auth_section      = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] service_user.auth_type         = password {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] service_user.cafile            = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] service_user.certfile          = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] service_user.collect_timing    = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] service_user.insecure          = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] service_user.keyfile           = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] service_user.send_service_user_token = True {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] service_user.split_loggers     = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] service_user.timeout           = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] service_user.tls_ciphers       = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] service_user.tls_min_version   = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] glance.auth_section            = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] glance.auth_type               = password {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] glance.certfile                = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] glance.collect_timing          = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] glance.insecure                = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] glance.keyfile                 = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] glance.region_name             = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] glance.split_loggers           = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] glance.timeout                 = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] glance.tls_ciphers             = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] glance.tls_min_version         = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.backend_availability_zone = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.chap_password = **** {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.050s {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.chap_username =  {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.disk_geometry = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.driver_client_cert = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.driver_client_cert_key = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.driver_data_namespace = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.driver_use_ssl = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.extra_capabilities = {} {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.filter_function = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.goodness_function = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.iscsi_target_flags =  {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.iscsi_write_cache = on {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.iser_helper   = tgtadm {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.iser_ip_address = 192.168.122.253 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.iser_port     = 3260 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:36:59 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.lvm_share_target = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.lvm_type      = auto {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.num_shell_tries = 3 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.replication_device = **** {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.report_discard_supported = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.reserved_percentage = 0 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.target_helper = tgtadm {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.target_ip_address = 192.168.122.253 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.target_port   = 3260 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.target_protocol = iscsi {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.trace_flags   = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.unique_fqdn_network = True {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.use_chap_auth = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.volume_backend_name = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.volume_clear  = zero {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.volume_clear_ionice = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.volume_clear_size = 0 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_reports.file_event_handler = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_reports.log_dir           = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.backend_host       = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.chap_password      = **** {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.chap_username      = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.disk_geometry      = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.driver_client_cert = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.extra_capabilities = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.filter_function    = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.goodness_function  = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.iser_helper        = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.iser_ip_address    = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.iser_port          = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.lvm_share_target   = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.lvm_type           = auto {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.num_shell_tries    = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.replication_device = **** {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.report_discard_supported = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.reserved_percentage = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.scst_target_driver = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.storage_protocol   = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.target_helper      = lioadm {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.target_ip_address  = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.target_port        = 3260 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.trace_flags        = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.use_chap_auth      = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.volume_clear       = zero {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.volume_clear_size  = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] lvmdriver-1.volumes_dir        = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack sudo[76279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack sudo[76279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_rabbit.ssl      = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_notifications.driver = [] {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_notifications.retry = -1 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] key_manager.fixed_key          = **** {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] barbican.barbican_api_version  = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] barbican.barbican_endpoint     = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] barbican.barbican_endpoint_type = public {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] barbican.barbican_region_name  = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] barbican.cafile                = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] barbican.certfile              = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] barbican.collect_timing        = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] barbican.insecure              = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] barbican.keyfile               = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] barbican.number_of_retries     = 60 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] barbican.retry_delay           = 1 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] barbican.send_service_user_token = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] barbican.split_loggers         = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] barbican.timeout               = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] barbican.tls_ciphers           = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] barbican.tls_min_version       = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] barbican.verify_ssl            = True {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] barbican.verify_ssl_path       = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] barbican_service_user.auth_section = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] barbican_service_user.auth_type = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] barbican_service_user.cafile   = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] barbican_service_user.certfile = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] barbican_service_user.collect_timing = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] barbican_service_user.insecure = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] barbican_service_user.keyfile  = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] barbican_service_user.split_loggers = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] barbican_service_user.timeout  = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] barbican_service_user.tls_ciphers = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] barbican_service_user.tls_min_version = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] vault.approle_role_id          = **** {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] vault.approle_secret_id        = **** {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] vault.auth_method              = approle {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] vault.auth_path                = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] vault.kv_mountpoint            = secret {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] vault.kv_path                  = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] vault.kv_version               = 2 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] vault.namespace                = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] vault.root_token_id            = **** {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] vault.ssl_ca_crt_file          = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] vault.timeout                  = 60.0 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] vault.token_file               = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] vault.token_role               = None {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] vault.use_ssl                  = False {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:36:59 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] ******************************************************************************** {{(pid=76097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 06 11:36:59 devstack sudo[76279]: pam_unix(sudo:session): session closed for user root
Nov 06 11:36:59 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.364s {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:36:59 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:36:59 devstack sudo[76403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 06 11:36:59 devstack sudo[76403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:37:00 devstack sudo[76403]: pam_unix(sudo:session): session closed for user root
Nov 06 11:37:00 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.358s {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:37:00 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 11:37:00 devstack cinder-volume[76251]: INFO cinder.brick.local_dev.lvm [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Nov 06 11:37:00 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:37:00 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:37:00 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:37:00 devstack sudo[76487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 06 11:37:00 devstack sudo[76487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:37:00 devstack sudo[76487]: pam_unix(sudo:session): session closed for user root
Nov 06 11:37:00 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:37:00 devstack cinder-volume[76251]: DEBUG cinder.brick.local_dev.lvm [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76251) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Nov 06 11:37:00 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:37:00 devstack sudo[76590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 06 11:37:00 devstack sudo[76590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:37:01 devstack sudo[76590]: pam_unix(sudo:session): session closed for user root
Nov 06 11:37:01 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.575s {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:37:01 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:37:01 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:37:01 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:37:01 devstack sudo[76788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 06 11:37:01 devstack sudo[76788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:37:01 devstack sudo[76788]: pam_unix(sudo:session): session closed for user root
Nov 06 11:37:01 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.323s {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:37:01 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:37:01 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:37:01 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:37:01 devstack sudo[76869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Nov 06 11:37:01 devstack sudo[76869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:37:01 devstack sudo[76869]: pam_unix(sudo:session): session closed for user root
Nov 06 11:37:01 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.254s {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:37:01 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:37:01 devstack sudo[76880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 06 11:37:01 devstack sudo[76880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:37:02 devstack sudo[76880]: pam_unix(sudo:session): session closed for user root
Nov 06 11:37:02 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.322s {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:37:02 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:37:02 devstack sudo[76957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 06 11:37:02 devstack sudo[76957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:37:02 devstack sudo[76957]: pam_unix(sudo:session): session closed for user root
Nov 06 11:37:02 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:37:02 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:37:02 devstack sudo[76966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 06 11:37:02 devstack sudo[76966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:37:02 devstack sudo[76966]: pam_unix(sudo:session): session closed for user root
Nov 06 11:37:02 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.342s {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:37:02 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:37:02 devstack sudo[77049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 06 11:37:02 devstack sudo[77049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:37:02 devstack sudo[77049]: pam_unix(sudo:session): session closed for user root
Nov 06 11:37:02 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:37:02 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:37:03 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:37:03 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:37:03 devstack sudo[77053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 06 11:37:03 devstack sudo[77053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:37:03 devstack sudo[77053]: pam_unix(sudo:session): session closed for user root
Nov 06 11:37:03 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:37:03 devstack cinder-volume[76251]: INFO cinder.volume.drivers.lvm [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Nov 06 11:37:03 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:37:03 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:37:03 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:37:03 devstack sudo[77057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 06 11:37:03 devstack sudo[77057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:37:03 devstack sudo[77057]: pam_unix(sudo:session): session closed for user root
Nov 06 11:37:03 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:37:03 devstack cinder-volume[76251]: DEBUG cinder.volume.drivers.lvm [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Updating volume stats {{(pid=76251) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 06 11:37:03 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:37:03 devstack sudo[77061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 06 11:37:03 devstack sudo[77061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:37:03 devstack sudo[77061]: pam_unix(sudo:session): session closed for user root
Nov 06 11:37:03 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:37:03 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:37:03 devstack sudo[77070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 06 11:37:03 devstack sudo[77070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:37:04 devstack sudo[77070]: pam_unix(sudo:session): session closed for user root
Nov 06 11:37:04 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:37:04 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:37:04 devstack sudo[77073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 06 11:37:04 devstack sudo[77073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:37:04 devstack sudo[77073]: pam_unix(sudo:session): session closed for user root
Nov 06 11:37:04 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:37:04 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:37:04 devstack sudo[77076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 06 11:37:04 devstack sudo[77076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:37:04 devstack sudo[77076]: pam_unix(sudo:session): session closed for user root
Nov 06 11:37:04 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.320s {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:37:04 devstack cinder-volume[76251]: INFO cinder.volume.driver [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Driver hasn't implemented _init_vendor_properties()
Nov 06 11:37:04 devstack cinder-volume[76251]: DEBUG cinder.volume.driver [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76251) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 06 11:37:04 devstack cinder-volume[76251]: DEBUG oslo_db.sqlalchemy.engines [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76251) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 06 11:37:04 devstack cinder-volume[76251]: DEBUG dbcounter [-] [76251] Writer thread running {{(pid=76251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 06 11:37:04 devstack cinder-volume[76251]: DEBUG cinder.db.api [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Building query based on filter {{(pid=76251) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Nov 06 11:37:04 devstack cinder-volume[76251]: DEBUG cinder.image.image_utils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76251) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 06 11:37:04 devstack cinder-volume[76251]: INFO cinder.keymgr.migration [None req-80b088bb-fc71-49b8-aeed-291e5c451f13 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 06 11:37:04 devstack cinder-volume[76251]: DEBUG cinder.volume.drivers.lvm [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Updating volume stats {{(pid=76251) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 06 11:37:04 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:37:04 devstack sudo[77081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 06 11:37:04 devstack sudo[77081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:37:05 devstack sudo[77081]: pam_unix(sudo:session): session closed for user root
Nov 06 11:37:05 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:37:05 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:37:05 devstack sudo[77084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 06 11:37:05 devstack sudo[77084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:37:05 devstack sudo[77084]: pam_unix(sudo:session): session closed for user root
Nov 06 11:37:05 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.323s {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:37:05 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:37:05 devstack sudo[77094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 06 11:37:05 devstack sudo[77094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:37:05 devstack sudo[77094]: pam_unix(sudo:session): session closed for user root
Nov 06 11:37:05 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:37:05 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:37:05 devstack sudo[77097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 06 11:37:05 devstack sudo[77097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:37:05 devstack sudo[77097]: pam_unix(sudo:session): session closed for user root
Nov 06 11:37:05 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:37:05 devstack cinder-volume[76251]: DEBUG cinder.manager [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Notifying Schedulers of capabilities ... {{(pid=76251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:37:05 devstack cinder-volume[76251]: INFO cinder.volume.manager [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Driver initialization completed successfully.
Nov 06 11:37:05 devstack cinder-volume[76251]: INFO cinder.manager [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Initiating service 2 cleanup
Nov 06 11:37:06 devstack cinder-volume[76251]: INFO cinder.manager [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Service 2 cleanup completed.
Nov 06 11:37:06 devstack cinder-volume[76251]: DEBUG cinder.service [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Creating RPC server for service cinder-volume {{(pid=76251) start /opt/stack/cinder/cinder/service.py:231}}
Nov 06 11:37:06 devstack cinder-volume[76251]: DEBUG cinder.service [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76251) start /opt/stack/cinder/cinder/service.py:237}}
Nov 06 11:37:06 devstack cinder-volume[76251]: INFO cinder.volume.manager [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Nov 06 11:37:06 devstack cinder-volume[76251]: DEBUG cinder.volume.drivers.lvm [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Updating volume stats {{(pid=76251) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 06 11:37:06 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:37:06 devstack sudo[77100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 06 11:37:06 devstack sudo[77100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:37:06 devstack sudo[77100]: pam_unix(sudo:session): session closed for user root
Nov 06 11:37:06 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:37:06 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:37:06 devstack sudo[77105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 06 11:37:06 devstack sudo[77105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:37:06 devstack sudo[77105]: pam_unix(sudo:session): session closed for user root
Nov 06 11:37:06 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.235s {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:37:06 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:37:06 devstack sudo[77108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 06 11:37:06 devstack sudo[77108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:37:06 devstack sudo[77108]: pam_unix(sudo:session): session closed for user root
Nov 06 11:37:06 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.240s {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:37:06 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:37:06 devstack sudo[77111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 06 11:37:06 devstack sudo[77111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:37:07 devstack sudo[77111]: pam_unix(sudo:session): session closed for user root
Nov 06 11:37:07 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:37:07 devstack cinder-volume[76251]: INFO cinder.volume.manager [None req-8be2fa03-c671-4dbb-95b9-a469a6143303 None None] Driver post RPC initialization completed successfully.
Nov 06 11:37:09 devstack cinder-volume[76097]: DEBUG dbcounter [-] [76097] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76097) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 11:37:17 devstack cinder-volume[76251]: DEBUG dbcounter [-] [76251] Writing DB stats cinder:SELECT=3 {{(pid=76251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 11:37:17 devstack cinder-volume[76251]: DEBUG dbcounter [-] [76251] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 11:38:04 devstack cinder-volume[76251]: DEBUG oslo_service.periodic_task [None req-f3258596-4bc1-4399-96a3-f2e3628d17cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 11:38:04 devstack cinder-volume[76251]: DEBUG cinder.volume.drivers.lvm [None req-f3258596-4bc1-4399-96a3-f2e3628d17cd None None] Updating volume stats {{(pid=76251) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 06 11:38:04 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-f3258596-4bc1-4399-96a3-f2e3628d17cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:38:04 devstack sudo[79032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 06 11:38:04 devstack sudo[79032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:38:04 devstack sudo[79032]: pam_unix(sudo:session): session closed for user root
Nov 06 11:38:04 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-f3258596-4bc1-4399-96a3-f2e3628d17cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:38:04 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-f3258596-4bc1-4399-96a3-f2e3628d17cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:38:04 devstack sudo[79035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 06 11:38:04 devstack sudo[79035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:38:04 devstack sudo[79035]: pam_unix(sudo:session): session closed for user root
Nov 06 11:38:04 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-f3258596-4bc1-4399-96a3-f2e3628d17cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:38:04 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-f3258596-4bc1-4399-96a3-f2e3628d17cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:38:04 devstack sudo[79065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 06 11:38:04 devstack sudo[79065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:38:04 devstack sudo[79065]: pam_unix(sudo:session): session closed for user root
Nov 06 11:38:04 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-f3258596-4bc1-4399-96a3-f2e3628d17cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:38:04 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-f3258596-4bc1-4399-96a3-f2e3628d17cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:38:04 devstack sudo[79068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 06 11:38:04 devstack sudo[79068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:38:05 devstack sudo[79068]: pam_unix(sudo:session): session closed for user root
Nov 06 11:38:05 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-f3258596-4bc1-4399-96a3-f2e3628d17cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:38:05 devstack cinder-volume[76251]: DEBUG cinder.manager [None req-f3258596-4bc1-4399-96a3-f2e3628d17cd None None] Notifying Schedulers of capabilities ... {{(pid=76251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:38:05 devstack cinder-volume[76251]: DEBUG oslo_service.periodic_task [None req-f3258596-4bc1-4399-96a3-f2e3628d17cd None None] Running periodic task VolumeManager._thread_info {{(pid=76251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 11:38:05 devstack cinder-volume[76251]: DEBUG cinder.volume.manager [None req-f3258596-4bc1-4399-96a3-f2e3628d17cd None None] thread count: 6 {{(pid=76251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 11:38:05 devstack cinder-volume[76251]: DEBUG cinder.volume.manager [None req-f3258596-4bc1-4399-96a3-f2e3628d17cd None None] thread info: [<_MainThread(MainThread, started 127923361255552)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127923246681728)>, <Thread(Thread-3 (stat_writer), started daemon 127923246958912)>, <Thread(Rabbit-heartbeat, started daemon 127923249832704)>, <Thread(Thread-5 (_runner), started daemon 127923246356800)>, <Thread(Thread-7 (_runner), started daemon 127923246457088)>] {{(pid=76251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 11:39:04 devstack cinder-volume[76251]: DEBUG oslo_service.periodic_task [None req-f3258596-4bc1-4399-96a3-f2e3628d17cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 11:39:04 devstack cinder-volume[76251]: DEBUG cinder.volume.drivers.lvm [None req-f3258596-4bc1-4399-96a3-f2e3628d17cd None None] Updating volume stats {{(pid=76251) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 06 11:39:04 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-f3258596-4bc1-4399-96a3-f2e3628d17cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:39:04 devstack sudo[82407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 06 11:39:04 devstack sudo[82407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:39:04 devstack sudo[82407]: pam_unix(sudo:session): session closed for user root
Nov 06 11:39:04 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-f3258596-4bc1-4399-96a3-f2e3628d17cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:39:04 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-f3258596-4bc1-4399-96a3-f2e3628d17cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:39:04 devstack sudo[82426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 06 11:39:04 devstack sudo[82426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:39:04 devstack sudo[82426]: pam_unix(sudo:session): session closed for user root
Nov 06 11:39:04 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-f3258596-4bc1-4399-96a3-f2e3628d17cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:39:04 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-f3258596-4bc1-4399-96a3-f2e3628d17cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:39:04 devstack sudo[82429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 06 11:39:04 devstack sudo[82429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:39:04 devstack sudo[82429]: pam_unix(sudo:session): session closed for user root
Nov 06 11:39:04 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-f3258596-4bc1-4399-96a3-f2e3628d17cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.246s {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:39:04 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-f3258596-4bc1-4399-96a3-f2e3628d17cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:39:04 devstack sudo[82433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 06 11:39:04 devstack sudo[82433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:39:05 devstack sudo[82433]: pam_unix(sudo:session): session closed for user root
Nov 06 11:39:05 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-f3258596-4bc1-4399-96a3-f2e3628d17cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:39:05 devstack cinder-volume[76251]: DEBUG cinder.manager [None req-f3258596-4bc1-4399-96a3-f2e3628d17cd None None] Notifying Schedulers of capabilities ... {{(pid=76251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:39:17 devstack cinder-volume[76251]: DEBUG dbcounter [-] [76251] Writing DB stats cinder:SELECT=1 {{(pid=76251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 11:39:17 devstack cinder-volume[76251]: DEBUG dbcounter [-] [76251] Writing DB stats cinder:UPDATE=1 {{(pid=76251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 11:40:04 devstack cinder-volume[76251]: DEBUG oslo_service.periodic_task [None req-f3258596-4bc1-4399-96a3-f2e3628d17cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 11:40:04 devstack cinder-volume[76251]: DEBUG cinder.volume.drivers.lvm [None req-f3258596-4bc1-4399-96a3-f2e3628d17cd None None] Updating volume stats {{(pid=76251) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 06 11:40:04 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-f3258596-4bc1-4399-96a3-f2e3628d17cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:40:04 devstack sudo[84552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 06 11:40:04 devstack sudo[84552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:40:04 devstack sudo[84552]: pam_unix(sudo:session): session closed for user root
Nov 06 11:40:04 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-f3258596-4bc1-4399-96a3-f2e3628d17cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:40:04 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-f3258596-4bc1-4399-96a3-f2e3628d17cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:40:04 devstack sudo[84563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 06 11:40:04 devstack sudo[84563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:40:04 devstack sudo[84563]: pam_unix(sudo:session): session closed for user root
Nov 06 11:40:04 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-f3258596-4bc1-4399-96a3-f2e3628d17cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:40:04 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-f3258596-4bc1-4399-96a3-f2e3628d17cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:40:04 devstack sudo[84566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 06 11:40:04 devstack sudo[84566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:40:04 devstack sudo[84566]: pam_unix(sudo:session): session closed for user root
Nov 06 11:40:04 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-f3258596-4bc1-4399-96a3-f2e3628d17cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:40:04 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-f3258596-4bc1-4399-96a3-f2e3628d17cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:40:04 devstack sudo[84572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 06 11:40:04 devstack sudo[84572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:40:05 devstack sudo[84572]: pam_unix(sudo:session): session closed for user root
Nov 06 11:40:05 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-f3258596-4bc1-4399-96a3-f2e3628d17cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:40:05 devstack cinder-volume[76251]: DEBUG cinder.manager [None req-f3258596-4bc1-4399-96a3-f2e3628d17cd None None] Notifying Schedulers of capabilities ... {{(pid=76251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:40:05 devstack cinder-volume[76251]: DEBUG oslo_service.periodic_task [None req-f3258596-4bc1-4399-96a3-f2e3628d17cd None None] Running periodic task VolumeManager._thread_info {{(pid=76251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 11:40:05 devstack cinder-volume[76251]: DEBUG cinder.volume.manager [None req-f3258596-4bc1-4399-96a3-f2e3628d17cd None None] thread count: 6 {{(pid=76251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 11:40:05 devstack cinder-volume[76251]: DEBUG cinder.volume.manager [None req-f3258596-4bc1-4399-96a3-f2e3628d17cd None None] thread info: [<_MainThread(MainThread, started 127923361255552)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127923246681728)>, <Thread(Thread-3 (stat_writer), started daemon 127923246958912)>, <Thread(Rabbit-heartbeat, started daemon 127923249832704)>, <Thread(Thread-5 (_runner), started daemon 127923246356800)>, <Thread(Thread-7 (_runner), started daemon 127923246457088)>] {{(pid=76251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 11:41:04 devstack cinder-volume[76251]: DEBUG oslo_service.periodic_task [None req-f3258596-4bc1-4399-96a3-f2e3628d17cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 11:41:04 devstack cinder-volume[76251]: DEBUG cinder.volume.drivers.lvm [None req-f3258596-4bc1-4399-96a3-f2e3628d17cd None None] Updating volume stats {{(pid=76251) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 06 11:41:04 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-f3258596-4bc1-4399-96a3-f2e3628d17cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:41:04 devstack sudo[85799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 06 11:41:04 devstack sudo[85799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:41:04 devstack sudo[85799]: pam_unix(sudo:session): session closed for user root
Nov 06 11:41:04 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-f3258596-4bc1-4399-96a3-f2e3628d17cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:41:04 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-f3258596-4bc1-4399-96a3-f2e3628d17cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:41:04 devstack sudo[85819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 06 11:41:04 devstack sudo[85819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:41:04 devstack sudo[85819]: pam_unix(sudo:session): session closed for user root
Nov 06 11:41:04 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-f3258596-4bc1-4399-96a3-f2e3628d17cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.237s {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:41:04 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-f3258596-4bc1-4399-96a3-f2e3628d17cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:41:04 devstack sudo[85822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 06 11:41:04 devstack sudo[85822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:41:04 devstack sudo[85822]: pam_unix(sudo:session): session closed for user root
Nov 06 11:41:04 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-f3258596-4bc1-4399-96a3-f2e3628d17cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.244s {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:41:04 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-f3258596-4bc1-4399-96a3-f2e3628d17cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:41:04 devstack sudo[85828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 06 11:41:04 devstack sudo[85828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:41:05 devstack sudo[85828]: pam_unix(sudo:session): session closed for user root
Nov 06 11:41:05 devstack cinder-volume[76251]: DEBUG oslo_concurrency.processutils [None req-f3258596-4bc1-4399-96a3-f2e3628d17cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=76251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:41:05 devstack cinder-volume[76251]: DEBUG cinder.manager [None req-f3258596-4bc1-4399-96a3-f2e3628d17cd None None] Notifying Schedulers of capabilities ... {{(pid=76251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:41:17 devstack cinder-volume[76251]: DEBUG dbcounter [-] [76251] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 11:41:22 devstack cinder-volume[76097]: INFO oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] Caught SIGTERM, stopping children
Nov 06 11:41:22 devstack cinder-volume[76097]: DEBUG oslo_concurrency.lockutils [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] Acquiring lock "singleton_lock" {{(pid=76097) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 06 11:41:22 devstack cinder-volume[76097]: DEBUG oslo_concurrency.lockutils [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] Acquired lock "singleton_lock" {{(pid=76097) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 06 11:41:22 devstack cinder-volume[76097]: DEBUG oslo_concurrency.lockutils [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] Releasing lock "singleton_lock" {{(pid=76097) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 06 11:41:22 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] Stop services. {{(pid=76097) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Nov 06 11:41:22 devstack cinder-volume[76097]: DEBUG oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] Killing children. {{(pid=76097) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Nov 06 11:41:22 devstack cinder-volume[76097]: INFO oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] Waiting on 1 children to exit
Nov 06 11:41:26 devstack cinder-volume[76251]: DEBUG oslo_concurrency.lockutils [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] Acquiring lock "singleton_lock" {{(pid=76251) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 06 11:41:26 devstack cinder-volume[76251]: DEBUG oslo_concurrency.lockutils [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] Acquired lock "singleton_lock" {{(pid=76251) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 06 11:41:26 devstack cinder-volume[76251]: DEBUG oslo_concurrency.lockutils [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] Releasing lock "singleton_lock" {{(pid=76251) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 06 11:41:26 devstack cinder-volume[76251]: WARNING amqp [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 06 11:41:26 devstack cinder-volume[76251]: WARNING amqp [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 06 11:41:26 devstack cinder-volume[76097]: INFO oslo_service.backend._eventlet.service [None req-d4e71b42-10e9-4411-ac9a-ab7c4ec73ac9 None None] Child 76251 exited with status 0
Nov 06 11:41:26 devstack cinder-volume[86324]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 06 11:41:26 devstack cinder-volume[86324]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 06 11:41:26 devstack cinder-volume[86324]: we strongly recommend against using it for new projects.
Nov 06 11:41:26 devstack cinder-volume[86324]: If you are already using Eventlet, we recommend migrating to a different
Nov 06 11:41:26 devstack cinder-volume[86324]: framework.  For more detail see
Nov 06 11:41:26 devstack cinder-volume[86324]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 06 11:41:26 devstack cinder-volume[86324]:   import eventlet  # noqa
Nov 06 11:41:28 devstack cinder-volume[86324]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86324) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 06 11:41:28 devstack cinder-volume[86324]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86324) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 06 11:41:28 devstack cinder-volume[86324]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86324) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 06 11:41:29 devstack cinder-volume[86324]: INFO dbcounter [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] Registered counter for database cinder
Nov 06 11:41:29 devstack cinder-volume[86324]: DEBUG oslo_db.sqlalchemy.engines [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86324) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 06 11:41:29 devstack cinder-volume[86324]: DEBUG dbcounter [-] [86324] Writer thread running {{(pid=86324) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 06 11:41:29 devstack cinder-volume[86324]: INFO cinder.rpc [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 06 11:41:29 devstack cinder-volume[86324]: INFO cinder.rpc [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 06 11:41:29 devstack cinder-volume[86324]: DEBUG oslo_db.sqlalchemy.engines [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86324) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 06 11:41:29 devstack cinder-volume[86324]: INFO cinder.volume.manager [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] Determined volume DB was empty at startup.
Nov 06 11:41:29 devstack cinder-volume[86324]: DEBUG cinder.volume.manager [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86324) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 06 11:41:29 devstack cinder-volume[86324]: INFO cinder.volume.manager [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] Service not found for updating active_backend_id, assuming default for driver init.
Nov 06 11:41:29 devstack cinder-volume[86324]: WARNING stevedore.named [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 06 11:41:29 devstack cinder-volume[86324]: WARNING castellan.key_manager [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 06 11:41:29 devstack cinder-volume[86324]: WARNING cinder.keymgr.conf_key_mgr [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 06 11:41:29 devstack cinder-volume[86324]: INFO cinder.volume.manager [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] Image-volume cache disabled for host devstack@QuobyteHD.
Nov 06 11:41:29 devstack cinder-volume[86324]: DEBUG oslo_db.sqlalchemy.engines [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86324) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 06 11:41:29 devstack cinder-volume[86324]: INFO oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] Starting 1 workers
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] Started child 86541 {{(pid=86324) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] Full set of CONF: {{(pid=86324) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] ******************************************************************************** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] Configuration options gathered from: {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] ================================================================================ {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] allow_availability_zone_fallback = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] allow_compression_on_image_upload = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] allowed_direct_url_schemes     = [] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] api_rate_limit                 = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] auth_strategy                  = keystone {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_availability_zone      = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_host                   = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_name                   = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_stats_polling_interval = 60 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backup_api_class               = cinder.backup.api.API {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86541]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1)
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backup_name_template           = backup-%s {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backup_use_same_host           = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backup_use_temp_snapshot       = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] chap_password                  = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] chap_username                  =  {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] cinder_internal_tenant_project_id = df10fdcf532045cab86ea2cece5e6ec7 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] cinder_internal_tenant_user_id = adf0c61e825142b185e4454841ba9f54 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] cluster                        = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] compression_format             = gzip {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] compute_api_class              = cinder.compute.nova.API {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] config_dir                     = [] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] config_source                  = [] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] control_exchange               = openstack {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] debug                          = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] default_availability_zone      = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] default_group_type             = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] default_volume_type            = QuobyteHD {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] disk_geometry                  = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] driver_client_cert             = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] driver_client_cert_key         = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] driver_data_namespace          = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] driver_ssl_cert_path           = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] driver_ssl_cert_verify         = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] driver_use_ssl                 = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] enable_new_services            = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] enable_unsupported_driver      = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] enabled_backends               = ['QuobyteHD'] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] enforce_multipath_for_image_xfer = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] filter_function                = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] glance_api_insecure            = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] glance_api_servers             = ['http://192.168.122.253/image'] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] glance_api_ssl_compression     = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] glance_ca_certificates_file    = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] glance_catalog_info            = image:glance:publicURL {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] glance_certfile                = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] glance_keyfile                 = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] glance_num_retries             = 3 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] glance_request_timeout         = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] goodness_function              = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] graceful_shutdown_timeout      = 5 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] group_api_class                = cinder.group.api.API {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] host                           = devstack {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] image_compress_on_upload       = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] image_conversion_address_space_limit = 1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] image_conversion_cpu_limit     = 60 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] image_conversion_disable       = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] image_introspection_address_space_limit = 1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] image_introspection_cpu_limit  = 60 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] image_upload_use_cinder_backend = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] image_upload_use_internal_tenant = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] image_volume_cache_enabled     = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] image_volume_cache_max_count   = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] image_volume_cache_max_size_gb = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] init_host_max_objects_retrieval = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] instance_format                = [instance: %(uuid)s]  {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] iscsi_target_flags             =  {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] iscsi_write_cache              = on {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] iser_helper                    = tgtadm {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] iser_ip_address                = 192.168.122.253 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] iser_port                      = 3260 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] log_color                      = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] log_config_append              = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] log_dir                        = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] log_file                       = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] log_options                    = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] log_rotate_interval            = 1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] log_rotate_interval_type       = days {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] log_rotation_type              = none {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] max_age                        = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] max_logfile_count              = 30 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] max_logfile_size_mb            = 200 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] max_over_subscription_ratio    = 20.0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] message_reap_interval          = 86400 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] message_ttl                    = 2592000 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] migration_create_volume_timeout_secs = 300 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] monkey_patch                   = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] monkey_patch_modules           = [] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] my_ip                          = 192.168.122.253 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] no_snapshot_gb_quota           = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] num_iser_scan_tries            = 3 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] num_shell_tries                = 3 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] num_volume_device_scan_tries   = 3 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] nvmeof_conn_info_version       = 1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] nvmet_ns_id                    = 10 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] nvmet_port_id                  = 1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] osapi_max_limit                = 1000 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] osapi_volume_ext_list          = [] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] osapi_volume_listen_port       = 8776 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] osapi_volume_use_ssl           = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] osapi_volume_workers           = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] per_volume_size_limit          = -1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] periodic_fuzzy_delay           = 60 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] periodic_interval              = 60 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] public_endpoint                = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86541]: INFO cinder.volume.manager [None req-8166c444-9cb5-4bf6-bada-a4277625d0b9 None None] Starting volume driver QuobyteDriver (1.2.1)
Nov 06 11:41:30 devstack cinder-volume[86541]: DEBUG cinder.volume.drivers.remotefs [None req-8166c444-9cb5-4bf6-bada-a4277625d0b9 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86541) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] publish_errors                 = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] quota_backup_gigabytes         = 1000 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] quota_backups                  = 10 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] quota_gigabytes                = 1000 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] quota_groups                   = 10 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] quota_snapshots                = 10 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] quota_volumes                  = 10 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] rate_limit_burst               = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] rate_limit_except_level        = CRITICAL {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] rate_limit_interval            = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] reinit_driver_count            = 3 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] replication_device             = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] report_discard_supported       = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] report_interval                = 120 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] reservation_clean_interval     = 86400 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] reservation_expire             = 86400 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] reserved_image_namespaces      = [] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] reserved_percentage            = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] rpc_response_timeout           = 120 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] run_external_periodic_tasks    = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] scst_target_driver             = iscsi {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] scst_target_iqn_name           = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] service_down_time              = 720 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] shell_completion               = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] snapshot_name_template         = snapshot-%s {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] split_loggers                  = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] state_path                     = /opt/stack/data/cinder {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] storage_availability_zone      = nova {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] storage_protocol               = iSCSI {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] syslog_log_facility            = LOG_USER {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] target_helper                  = lioadm {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] target_ip_address              = 192.168.122.253 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] target_port                    = 3260 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] target_protocol                = iscsi {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] target_secondary_ip_addresses  = [] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] trace_flags                    = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] transport_url                  = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] until_refresh                  = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] use_chap_auth                  = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] use_default_quota_class        = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] use_journal                    = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] use_json                       = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] use_multipath_for_image_xfer   = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] use_stderr                     = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] use_syslog                     = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] verify_glance_signatures       = enabled {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] volume_api_class               = cinder.volume.api.API {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] volume_backend_name            = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] volume_clear                   = zero {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] volume_clear_ionice            = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] volume_clear_size              = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] volume_copy_bps_limit          = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] volume_dd_blocksize            = 1M {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] volume_name_template           = volume-%s {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] volume_service_inithost_offload = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] volume_usage_audit_period      = month {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] zoning_mode                    = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_concurrency.disable_process_locking = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] keystone_authtoken.auth_section = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] keystone_authtoken.auth_type   = password {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] keystone_authtoken.auth_version = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] keystone_authtoken.cache       = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] keystone_authtoken.certfile    = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] keystone_authtoken.delay_auth_decision = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] keystone_authtoken.http_connect_timeout = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] keystone_authtoken.include_service_catalog = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] keystone_authtoken.insecure    = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] keystone_authtoken.interface   = public {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] keystone_authtoken.keyfile     = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] keystone_authtoken.memcache_password = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] keystone_authtoken.memcache_username = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] keystone_authtoken.region_name = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] keystone_authtoken.service_token_roles_required = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] keystone_authtoken.service_type = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] keystone_authtoken.token_cache_time = 300 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.253/identity {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] cache.backend                  = dogpile.cache.null {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] cache.backend_argument         = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] cache.backend_expiration_time  = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] cache.config_prefix            = cache.oslo {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] cache.debug_cache_backend      = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] cache.enable_retry_client      = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] cache.enable_socket_keepalive  = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] cache.enabled                  = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] cache.expiration_time          = 600 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] cache.hashclient_retry_attempts = 2 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] cache.memcache_dead_retry      = 300 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] cache.memcache_pool_maxsize    = 10 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] cache.memcache_sasl_enabled    = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] cache.password                 = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] cache.proxies                  = [] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] cache.redis_db                 = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] cache.redis_sentinel_service_name = mymaster {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] cache.redis_server             = localhost:6379 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] cache.retry_attempts           = 2 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] cache.retry_delay              = 0.0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] cache.socket_keepalive_count   = 1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] cache.socket_keepalive_idle    = 1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] cache.socket_keepalive_interval = 1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] cache.socket_timeout           = 1.0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] cache.tls_allowed_ciphers      = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] cache.tls_cafile               = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] cache.tls_certfile             = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] cache.tls_enabled              = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] cache.tls_keyfile              = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] cache.username                 = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] coordination.backend_url       = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] database.asyncio_connection    = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] database.asyncio_slave_connection = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] database.backend               = sqlalchemy {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] database.connection            = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] database.connection_debug      = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] database.connection_parameters =  {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] database.connection_recycle_time = 3600 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] database.connection_trace      = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] database.db_inc_retry_interval = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] database.db_max_retries        = 20 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] database.db_max_retry_interval = 10 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] database.db_retry_interval     = 1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] database.max_overflow          = 50 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] database.max_pool_size         = 5 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] database.max_retries           = 10 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] database.mysql_wsrep_sync_wait = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] database.pool_timeout          = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] database.retry_interval        = 10 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] database.slave_connection      = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] database.sqlite_synchronous    = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] database.synchronous_reader    = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] database.use_db_reconnect      = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_tracing.insecure = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] profiler.connection_string     = messaging:// {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] profiler.enabled               = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] profiler.es_doc_type           = notification {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] profiler.es_scroll_size        = 10000 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] profiler.es_scroll_time        = 2m {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] profiler.filter_error_trace    = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] profiler.hmac_keys             = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] profiler.sentinel_service_name = mymaster {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] profiler.socket_timeout        = 0.1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] profiler.trace_requests        = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] profiler.trace_sqlalchemy      = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] profiler_jaeger.process_tags   = {} {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] profiler_jaeger.service_name_prefix = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] profiler_otlp.service_name_prefix = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_policy.enforce_new_defaults = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_policy.policy_default_rule = default {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_policy.policy_file        = policy.yaml {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] privsep_osbrick.group          = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] privsep_osbrick.helper_command = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] privsep_osbrick.user           = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] cinder_sys_admin.group         = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] cinder_sys_admin.helper_command = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] cinder_sys_admin.user          = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] service_user.auth_section      = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] service_user.auth_type         = password {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] service_user.cafile            = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] service_user.certfile          = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] service_user.collect_timing    = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] service_user.insecure          = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] service_user.keyfile           = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] service_user.send_service_user_token = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] service_user.split_loggers     = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] service_user.timeout           = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] service_user.tls_ciphers       = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] service_user.tls_min_version   = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] glance.auth_section            = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] glance.auth_type               = password {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] glance.certfile                = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] glance.collect_timing          = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] glance.insecure                = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] glance.keyfile                 = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] glance.region_name             = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] glance.split_loggers           = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] glance.timeout                 = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] glance.tls_ciphers             = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] glance.tls_min_version         = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.backend_availability_zone = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.chap_password = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.chap_username =  {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86541]: DEBUG cinder.volume.drivers.quobyte [None req-8166c444-9cb5-4bf6-bada-a4277625d0b9 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86541) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86541]: WARNING cinder.volume.drivers.quobyte [None req-8166c444-9cb5-4bf6-bada-a4277625d0b9 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Nov 06 11:41:30 devstack cinder-volume[86541]: WARNING cinder.volume.drivers.quobyte [None req-8166c444-9cb5-4bf6-bada-a4277625d0b9 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.disk_geometry = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.driver_client_cert = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.driver_client_cert_key = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.driver_data_namespace = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.driver_use_ssl = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86541]: DEBUG oslo_concurrency.processutils [None req-8166c444-9cb5-4bf6-bada-a4277625d0b9 None None] Running cmd (subprocess): mount.quobyte {{(pid=86541) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.enable_unsupported_driver = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.extra_capabilities = {} {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.filter_function = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.goodness_function = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.iscsi_target_flags =  {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.iscsi_write_cache = on {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.iser_helper   = tgtadm {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.iser_ip_address = 192.168.122.253 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.iser_port     = 3260 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.nas_host      =  {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.nas_login     = admin {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.nas_mount_options = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.nas_password  = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.nas_private_key =  {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.nas_share_path =  {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.num_shell_tries = 3 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.nvmet_port_id = 1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.quobyte_client_cfg = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.quobyte_volume_url = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.replication_device = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.report_discard_supported = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.reserved_percentage = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.scst_target_driver = iscsi {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.scst_target_iqn_name = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.storage_protocol = iSCSI {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.target_helper = tgtadm {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.target_ip_address = 192.168.122.253 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.target_port   = 3260 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.target_protocol = iscsi {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.trace_flags   = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.unique_fqdn_network = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.use_chap_auth = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.volume_backend_name = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.volume_clear  = zero {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.volume_clear_ionice = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.volume_clear_size = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_reports.file_event_handler = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_reports.log_dir           = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.backend_availability_zone = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.backend_host         = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.chap_password        = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.chap_username        = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.chiscsi_conf         = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.disk_geometry        = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.driver_client_cert   = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.driver_client_cert_key = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.driver_data_namespace = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.driver_use_ssl       = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.extra_capabilities   = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.filter_function      = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.goodness_function    = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.iser_helper          = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.iser_ip_address      = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.iser_port            = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.iser_target_prefix   = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.nas_host             = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.nas_login            = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.nas_mount_options    = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.nas_password         = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.nas_private_key      = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.nas_share_path       = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.nas_ssh_port         = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.num_shell_tries      = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.nvmet_port_id        = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.replication_device   = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.report_discard_supported = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.reserved_percentage  = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.scst_target_driver   = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.storage_protocol     = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.target_helper        = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.target_ip_address    = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.target_port          = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.target_prefix        = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.target_protocol      = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.trace_flags          = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.use_chap_auth        = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.volume_clear         = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.volume_clear_size    = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] QuobyteHD.volumes_dir          = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_rabbit.ssl      = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_notifications.driver = [] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_notifications.retry = -1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] oslo_messaging_notifications.transport_url = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] key_manager.fixed_key          = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] barbican.barbican_api_version  = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] barbican.barbican_endpoint     = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] barbican.barbican_endpoint_type = public {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] barbican.barbican_region_name  = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] barbican.cafile                = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] barbican.certfile              = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] barbican.collect_timing        = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] barbican.insecure              = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] barbican.keyfile               = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] barbican.number_of_retries     = 60 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] barbican.retry_delay           = 1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] barbican.send_service_user_token = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] barbican.split_loggers         = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] barbican.timeout               = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] barbican.tls_ciphers           = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] barbican.tls_min_version       = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] barbican.verify_ssl            = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] barbican.verify_ssl_path       = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] barbican_service_user.auth_section = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] barbican_service_user.auth_type = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] barbican_service_user.cafile   = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] barbican_service_user.certfile = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] barbican_service_user.collect_timing = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack quobyte-client[86546]: Reading configuration file: /etc/quobyte/client.cfg
Nov 06 11:41:30 devstack quobyte-client[86546]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] barbican_service_user.insecure = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] barbican_service_user.keyfile  = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] barbican_service_user.split_loggers = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] barbican_service_user.timeout  = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] barbican_service_user.tls_ciphers = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] barbican_service_user.tls_min_version = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] vault.approle_role_id          = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86541]: DEBUG oslo_concurrency.processutils [None req-8166c444-9cb5-4bf6-bada-a4277625d0b9 None None] CMD "mount.quobyte" returned: 1 in 0.126s {{(pid=86541) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:41:30 devstack cinder-volume[86541]: DEBUG oslo_concurrency.lockutils [None req-8166c444-9cb5-4bf6-bada-a4277625d0b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86541) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:41:30 devstack cinder-volume[86541]: DEBUG oslo_concurrency.lockutils [None req-8166c444-9cb5-4bf6-bada-a4277625d0b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86541) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:41:30 devstack cinder-volume[86541]: DEBUG cinder.volume.drivers.quobyte [None req-8166c444-9cb5-4bf6-bada-a4277625d0b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=86541) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:41:30 devstack cinder-volume[86541]: INFO cinder.volume.drivers.quobyte [None req-8166c444-9cb5-4bf6-bada-a4277625d0b9 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 ...
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] vault.approle_secret_id        = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86541]: DEBUG oslo_concurrency.processutils [None req-8166c444-9cb5-4bf6-bada-a4277625d0b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e -c /etc/quobyte/client-cinder.cfg {{(pid=86541) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] vault.auth_method              = approle {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] vault.auth_path                = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] vault.kv_mountpoint            = secret {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] vault.kv_path                  = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] vault.kv_version               = 2 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] vault.namespace                = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] vault.root_token_id            = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] vault.ssl_ca_crt_file          = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] vault.timeout                  = 60.0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] vault.token_file               = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] vault.token_role               = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] vault.use_ssl                  = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:30 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] ******************************************************************************** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 06 11:41:30 devstack sudo[86547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e -c /etc/quobyte/client-cinder.cfg
Nov 06 11:41:30 devstack sudo[86547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:41:30 devstack sudo[86547]: pam_unix(sudo:session): session closed for user root
Nov 06 11:41:30 devstack cinder-volume[86541]: DEBUG oslo_concurrency.processutils [None req-8166c444-9cb5-4bf6-bada-a4277625d0b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.408s {{(pid=86541) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:41:30 devstack cinder-volume[86541]: INFO cinder.volume.drivers.quobyte [None req-8166c444-9cb5-4bf6-bada-a4277625d0b9 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 succeeded
Nov 06 11:41:30 devstack cinder-volume[86541]: DEBUG cinder.volume.drivers.quobyte [None req-8166c444-9cb5-4bf6-bada-a4277625d0b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=86541) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:41:30 devstack cinder-volume[86541]: DEBUG oslo_concurrency.lockutils [None req-8166c444-9cb5-4bf6-bada-a4277625d0b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.421s {{(pid=86541) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:41:30 devstack cinder-volume[86541]: DEBUG oslo_concurrency.processutils [None req-8166c444-9cb5-4bf6-bada-a4277625d0b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=86541) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:41:30 devstack sudo[86649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:41:30 devstack sudo[86649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:41:31 devstack sudo[86649]: pam_unix(sudo:session): session closed for user root
Nov 06 11:41:31 devstack cinder-volume[86541]: DEBUG oslo_concurrency.processutils [None req-8166c444-9cb5-4bf6-bada-a4277625d0b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.238s {{(pid=86541) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:41:31 devstack cinder-volume[86541]: INFO cinder.volume.driver [None req-8166c444-9cb5-4bf6-bada-a4277625d0b9 None None] Driver hasn't implemented _init_vendor_properties()
Nov 06 11:41:31 devstack cinder-volume[86541]: DEBUG cinder.volume.driver [None req-8166c444-9cb5-4bf6-bada-a4277625d0b9 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.401268005371, 'free_capacity_gb': 1773.401268005371, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86541) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 06 11:41:31 devstack cinder-volume[86541]: DEBUG oslo_db.sqlalchemy.engines [None req-8166c444-9cb5-4bf6-bada-a4277625d0b9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86541) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 06 11:41:31 devstack cinder-volume[86541]: DEBUG dbcounter [-] [86541] Writer thread running {{(pid=86541) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 06 11:41:31 devstack cinder-volume[86541]: DEBUG cinder.db.api [None req-8166c444-9cb5-4bf6-bada-a4277625d0b9 None None] Building query based on filter {{(pid=86541) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Nov 06 11:41:31 devstack cinder-volume[86541]: DEBUG cinder.image.image_utils [None req-8166c444-9cb5-4bf6-bada-a4277625d0b9 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86541) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 06 11:41:31 devstack cinder-volume[86541]: INFO cinder.keymgr.migration [None req-8fb99295-abc8-4cfc-b50d-308e32b65e51 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 06 11:41:31 devstack cinder-volume[86541]: DEBUG oslo_concurrency.lockutils [None req-8166c444-9cb5-4bf6-bada-a4277625d0b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86541) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:41:31 devstack cinder-volume[86541]: DEBUG oslo_concurrency.lockutils [None req-8166c444-9cb5-4bf6-bada-a4277625d0b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86541) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:41:31 devstack cinder-volume[86541]: DEBUG cinder.volume.drivers.quobyte [None req-8166c444-9cb5-4bf6-bada-a4277625d0b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=86541) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:41:31 devstack cinder-volume[86541]: DEBUG cinder.volume.drivers.quobyte [None req-8166c444-9cb5-4bf6-bada-a4277625d0b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=86541) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:41:31 devstack cinder-volume[86541]: DEBUG oslo_concurrency.lockutils [None req-8166c444-9cb5-4bf6-bada-a4277625d0b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86541) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:41:31 devstack cinder-volume[86541]: DEBUG oslo_concurrency.processutils [None req-8166c444-9cb5-4bf6-bada-a4277625d0b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=86541) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:41:31 devstack sudo[86652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:41:31 devstack sudo[86652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:41:31 devstack sudo[86652]: pam_unix(sudo:session): session closed for user root
Nov 06 11:41:31 devstack cinder-volume[86541]: DEBUG oslo_concurrency.processutils [None req-8166c444-9cb5-4bf6-bada-a4277625d0b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.223s {{(pid=86541) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:41:31 devstack cinder-volume[86541]: DEBUG cinder.manager [None req-8166c444-9cb5-4bf6-bada-a4277625d0b9 None None] Notifying Schedulers of capabilities ... {{(pid=86541) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:41:31 devstack cinder-volume[86541]: INFO cinder.volume.manager [None req-8166c444-9cb5-4bf6-bada-a4277625d0b9 None None] Driver initialization completed successfully.
Nov 06 11:41:31 devstack cinder-volume[86541]: INFO cinder.manager [None req-8166c444-9cb5-4bf6-bada-a4277625d0b9 None None] Initiating service 3 cleanup
Nov 06 11:41:31 devstack cinder-volume[86541]: INFO cinder.manager [None req-8166c444-9cb5-4bf6-bada-a4277625d0b9 None None] Service 3 cleanup completed.
Nov 06 11:41:31 devstack cinder-volume[86541]: DEBUG cinder.service [None req-8166c444-9cb5-4bf6-bada-a4277625d0b9 None None] Creating RPC server for service cinder-volume {{(pid=86541) start /opt/stack/cinder/cinder/service.py:231}}
Nov 06 11:41:31 devstack cinder-volume[86541]: DEBUG cinder.service [None req-8166c444-9cb5-4bf6-bada-a4277625d0b9 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86541) start /opt/stack/cinder/cinder/service.py:237}}
Nov 06 11:41:31 devstack cinder-volume[86541]: INFO cinder.volume.manager [None req-8166c444-9cb5-4bf6-bada-a4277625d0b9 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Nov 06 11:41:31 devstack cinder-volume[86541]: DEBUG oslo_concurrency.lockutils [None req-8166c444-9cb5-4bf6-bada-a4277625d0b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86541) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:41:31 devstack cinder-volume[86541]: DEBUG oslo_concurrency.lockutils [None req-8166c444-9cb5-4bf6-bada-a4277625d0b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86541) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:41:31 devstack cinder-volume[86541]: DEBUG cinder.volume.drivers.quobyte [None req-8166c444-9cb5-4bf6-bada-a4277625d0b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=86541) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:41:31 devstack cinder-volume[86541]: DEBUG cinder.volume.drivers.quobyte [None req-8166c444-9cb5-4bf6-bada-a4277625d0b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=86541) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:41:31 devstack cinder-volume[86541]: DEBUG oslo_concurrency.lockutils [None req-8166c444-9cb5-4bf6-bada-a4277625d0b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86541) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:41:31 devstack cinder-volume[86541]: DEBUG oslo_concurrency.processutils [None req-8166c444-9cb5-4bf6-bada-a4277625d0b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=86541) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:41:31 devstack sudo[86655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:41:31 devstack sudo[86655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:41:31 devstack sudo[86655]: pam_unix(sudo:session): session closed for user root
Nov 06 11:41:31 devstack cinder-volume[86541]: DEBUG oslo_concurrency.processutils [None req-8166c444-9cb5-4bf6-bada-a4277625d0b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.247s {{(pid=86541) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:41:31 devstack cinder-volume[86541]: INFO cinder.volume.manager [None req-8166c444-9cb5-4bf6-bada-a4277625d0b9 None None] Driver post RPC initialization completed successfully.
Nov 06 11:41:36 devstack cinder-volume[86541]: DEBUG oslo_concurrency.lockutils [None req-fdf055f5-70dd-4ab5-833e-3087efecdb39 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86541) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:41:36 devstack cinder-volume[86541]: DEBUG oslo_concurrency.lockutils [None req-fdf055f5-70dd-4ab5-833e-3087efecdb39 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86541) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:41:36 devstack cinder-volume[86541]: DEBUG cinder.volume.drivers.quobyte [None req-fdf055f5-70dd-4ab5-833e-3087efecdb39 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=86541) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:41:36 devstack cinder-volume[86541]: DEBUG cinder.volume.drivers.quobyte [None req-fdf055f5-70dd-4ab5-833e-3087efecdb39 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=86541) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:41:36 devstack cinder-volume[86541]: DEBUG oslo_concurrency.lockutils [None req-fdf055f5-70dd-4ab5-833e-3087efecdb39 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86541) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:41:36 devstack cinder-volume[86541]: DEBUG oslo_concurrency.processutils [None req-fdf055f5-70dd-4ab5-833e-3087efecdb39 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=86541) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:41:36 devstack sudo[86803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:41:36 devstack sudo[86803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:41:36 devstack sudo[86803]: pam_unix(sudo:session): session closed for user root
Nov 06 11:41:36 devstack cinder-volume[86541]: DEBUG oslo_concurrency.processutils [None req-fdf055f5-70dd-4ab5-833e-3087efecdb39 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.236s {{(pid=86541) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:41:36 devstack cinder-volume[86541]: DEBUG cinder.manager [None req-fdf055f5-70dd-4ab5-833e-3087efecdb39 None None] Notifying Schedulers of capabilities ... {{(pid=86541) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:41:36 devstack cinder-volume[86324]: INFO oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] Caught SIGTERM, stopping children
Nov 06 11:41:36 devstack cinder-volume[86324]: DEBUG oslo_concurrency.lockutils [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] Acquiring lock "singleton_lock" {{(pid=86324) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 06 11:41:36 devstack cinder-volume[86324]: DEBUG oslo_concurrency.lockutils [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] Acquired lock "singleton_lock" {{(pid=86324) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 06 11:41:36 devstack cinder-volume[86324]: DEBUG oslo_concurrency.lockutils [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] Releasing lock "singleton_lock" {{(pid=86324) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 06 11:41:36 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] Stop services. {{(pid=86324) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Nov 06 11:41:36 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] Killing children. {{(pid=86324) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Nov 06 11:41:36 devstack cinder-volume[86324]: INFO oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] Waiting on 1 children to exit
Nov 06 11:41:39 devstack cinder-volume[86541]: DEBUG oslo_concurrency.lockutils [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] Acquiring lock "singleton_lock" {{(pid=86541) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 06 11:41:39 devstack cinder-volume[86541]: DEBUG oslo_concurrency.lockutils [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] Acquired lock "singleton_lock" {{(pid=86541) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 06 11:41:39 devstack cinder-volume[86541]: DEBUG oslo_concurrency.lockutils [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] Releasing lock "singleton_lock" {{(pid=86541) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 06 11:41:39 devstack cinder-volume[86541]: WARNING amqp [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 06 11:41:39 devstack cinder-volume[86541]: WARNING amqp [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 06 11:41:39 devstack cinder-volume[86324]: INFO oslo_service.backend._eventlet.service [None req-7b7d9132-ecba-461e-af24-f3ceb3ab0d0e None None] Child 86541 exited with status 0
Nov 06 11:41:40 devstack cinder-volume[86857]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 06 11:41:40 devstack cinder-volume[86857]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 06 11:41:40 devstack cinder-volume[86857]: we strongly recommend against using it for new projects.
Nov 06 11:41:40 devstack cinder-volume[86857]: If you are already using Eventlet, we recommend migrating to a different
Nov 06 11:41:40 devstack cinder-volume[86857]: framework.  For more detail see
Nov 06 11:41:40 devstack cinder-volume[86857]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 06 11:41:40 devstack cinder-volume[86857]:   import eventlet  # noqa
Nov 06 11:41:43 devstack cinder-volume[86857]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86857) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 06 11:41:43 devstack cinder-volume[86857]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86857) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 06 11:41:43 devstack cinder-volume[86857]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86857) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 06 11:41:44 devstack cinder-volume[86857]: INFO dbcounter [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] Registered counter for database cinder
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_db.sqlalchemy.engines [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86857) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG dbcounter [-] [86857] Writer thread running {{(pid=86857) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 06 11:41:44 devstack cinder-volume[86857]: INFO cinder.rpc [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 06 11:41:44 devstack cinder-volume[86857]: INFO cinder.rpc [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_db.sqlalchemy.engines [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86857) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 06 11:41:44 devstack cinder-volume[86857]: INFO cinder.volume.manager [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] Determined volume DB was empty at startup.
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG cinder.volume.manager [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86857) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 06 11:41:44 devstack cinder-volume[86857]: WARNING stevedore.named [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 06 11:41:44 devstack cinder-volume[86857]: WARNING castellan.key_manager [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 06 11:41:44 devstack cinder-volume[86857]: WARNING cinder.keymgr.conf_key_mgr [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 06 11:41:44 devstack cinder-volume[86857]: INFO cinder.volume.manager [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_db.sqlalchemy.engines [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86857) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 06 11:41:44 devstack cinder-volume[86857]: INFO oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] Starting 1 workers
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] Started child 87165 {{(pid=86857) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] Full set of CONF: {{(pid=86857) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] ******************************************************************************** {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] Configuration options gathered from: {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] ================================================================================ {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] allow_availability_zone_fallback = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] allow_compression_on_image_upload = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] allowed_direct_url_schemes     = [] {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] api_rate_limit                 = True {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] auth_strategy                  = keystone {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_availability_zone      = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_host                   = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_name                   = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_stats_polling_interval = 60 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backup_api_class               = cinder.backup.api.API {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backup_name_template           = backup-%s {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backup_use_same_host           = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backup_use_temp_snapshot       = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] chap_password                  = **** {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] chap_username                  =  {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[87165]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1)
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] cinder_internal_tenant_project_id = df10fdcf532045cab86ea2cece5e6ec7 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] cinder_internal_tenant_user_id = adf0c61e825142b185e4454841ba9f54 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] cluster                        = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] compression_format             = gzip {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] compute_api_class              = cinder.compute.nova.API {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] config_dir                     = [] {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] config_source                  = [] {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] control_exchange               = openstack {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] debug                          = True {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] default_availability_zone      = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] default_group_type             = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] default_volume_type            = QuobyteHD {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] disk_geometry                  = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] driver_client_cert             = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] driver_client_cert_key         = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] driver_data_namespace          = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] driver_ssl_cert_path           = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] driver_ssl_cert_verify         = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] driver_use_ssl                 = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] enable_new_services            = True {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] enable_unsupported_driver      = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] enabled_backends               = ['QuobyteHD'] {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] enforce_multipath_for_image_xfer = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] filter_function                = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] glance_api_insecure            = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] glance_api_servers             = ['http://192.168.122.253/image'] {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] glance_api_ssl_compression     = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] glance_ca_certificates_file    = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] glance_catalog_info            = image:glance:publicURL {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] glance_certfile                = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] glance_keyfile                 = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] glance_num_retries             = 3 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] glance_request_timeout         = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] goodness_function              = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] graceful_shutdown_timeout      = 5 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] group_api_class                = cinder.group.api.API {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] host                           = devstack {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] image_compress_on_upload       = True {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] image_conversion_address_space_limit = 1 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] image_conversion_cpu_limit     = 60 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] image_conversion_disable       = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] image_introspection_address_space_limit = 1 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] image_introspection_cpu_limit  = 60 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] image_upload_use_cinder_backend = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] image_upload_use_internal_tenant = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] image_volume_cache_enabled     = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] image_volume_cache_max_count   = 0 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] image_volume_cache_max_size_gb = 0 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] init_host_max_objects_retrieval = 0 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] instance_format                = [instance: %(uuid)s]  {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] iscsi_target_flags             =  {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] iscsi_write_cache              = on {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] iser_helper                    = tgtadm {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] iser_ip_address                = 192.168.122.253 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] iser_port                      = 3260 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] log_color                      = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] log_config_append              = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] log_dir                        = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] log_file                       = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] log_options                    = True {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] log_rotate_interval            = 1 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] log_rotate_interval_type       = days {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] log_rotation_type              = none {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] max_age                        = 0 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] max_logfile_count              = 30 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] max_logfile_size_mb            = 200 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] max_over_subscription_ratio    = 20.0 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] message_reap_interval          = 86400 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] message_ttl                    = 2592000 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] migration_create_volume_timeout_secs = 300 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] monkey_patch                   = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] monkey_patch_modules           = [] {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] my_ip                          = 192.168.122.253 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] no_snapshot_gb_quota           = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] num_iser_scan_tries            = 3 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] num_shell_tries                = 3 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] num_volume_device_scan_tries   = 3 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] nvmeof_conn_info_version       = 1 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] nvmet_ns_id                    = 10 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] nvmet_port_id                  = 1 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] osapi_max_limit                = 1000 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] osapi_volume_ext_list          = [] {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] osapi_volume_listen_port       = 8776 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] osapi_volume_use_ssl           = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] osapi_volume_workers           = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] per_volume_size_limit          = -1 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] periodic_fuzzy_delay           = 60 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] periodic_interval              = 60 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] public_endpoint                = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] publish_errors                 = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] quota_backup_gigabytes         = 1000 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] quota_backups                  = 10 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] quota_gigabytes                = 1000 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] quota_groups                   = 10 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] quota_snapshots                = 10 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] quota_volumes                  = 10 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] rate_limit_burst               = 0 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-d0ca8ff2-b961-49e7-b053-70948b28565c None None] Starting volume driver QuobyteDriver (1.2.1)
Nov 06 11:41:44 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-d0ca8ff2-b961-49e7-b053-70948b28565c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87165) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] rate_limit_except_level        = CRITICAL {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] rate_limit_interval            = 0 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] reinit_driver_count            = 3 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] replication_device             = **** {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] report_discard_supported       = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] report_interval                = 120 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] reservation_clean_interval     = 86400 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] reservation_expire             = 86400 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] reserved_image_namespaces      = [] {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] reserved_percentage            = 0 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] rpc_response_timeout           = 120 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] run_external_periodic_tasks    = True {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:44 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] scst_target_driver             = iscsi {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] scst_target_iqn_name           = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] service_down_time              = 720 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] shell_completion               = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] snapshot_name_template         = snapshot-%s {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] split_loggers                  = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] state_path                     = /opt/stack/data/cinder {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] storage_availability_zone      = nova {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] storage_protocol               = iSCSI {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] syslog_log_facility            = LOG_USER {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] target_helper                  = lioadm {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] target_ip_address              = 192.168.122.253 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] target_port                    = 3260 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] target_protocol                = iscsi {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] target_secondary_ip_addresses  = [] {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] trace_flags                    = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] transport_url                  = **** {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] until_refresh                  = 0 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] use_chap_auth                  = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] use_default_quota_class        = True {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] use_journal                    = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] use_json                       = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] use_multipath_for_image_xfer   = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] use_stderr                     = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] use_syslog                     = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] verify_glance_signatures       = enabled {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] volume_api_class               = cinder.volume.api.API {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] volume_backend_name            = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] volume_clear                   = zero {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] volume_clear_ionice            = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] volume_clear_size              = 0 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] volume_copy_bps_limit          = 0 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] volume_dd_blocksize            = 1M {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] volume_name_template           = volume-%s {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] volume_service_inithost_offload = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] volume_usage_audit_period      = month {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] zoning_mode                    = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_concurrency.disable_process_locking = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] keystone_authtoken.auth_section = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] keystone_authtoken.auth_type   = password {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] keystone_authtoken.auth_version = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] keystone_authtoken.cache       = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] keystone_authtoken.certfile    = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] keystone_authtoken.include_service_catalog = True {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] keystone_authtoken.insecure    = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] keystone_authtoken.interface   = public {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] keystone_authtoken.keyfile     = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] keystone_authtoken.memcache_password = **** {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] keystone_authtoken.memcache_username = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] keystone_authtoken.region_name = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] keystone_authtoken.service_type = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.253/identity {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] cache.backend                  = dogpile.cache.null {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] cache.backend_argument         = **** {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] cache.backend_expiration_time  = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] cache.config_prefix            = cache.oslo {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] cache.debug_cache_backend      = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] cache.enable_retry_client      = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] cache.enable_socket_keepalive  = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] cache.enabled                  = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] cache.expiration_time          = 600 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] cache.hashclient_retry_attempts = 2 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] cache.memcache_dead_retry      = 300 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] cache.memcache_pool_maxsize    = 10 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] cache.memcache_sasl_enabled    = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] cache.password                 = **** {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] cache.proxies                  = [] {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] cache.redis_db                 = 0 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] cache.redis_server             = localhost:6379 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] cache.retry_attempts           = 2 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] cache.retry_delay              = 0.0 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] cache.socket_keepalive_count   = 1 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] cache.socket_keepalive_idle    = 1 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] cache.socket_keepalive_interval = 1 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] cache.socket_timeout           = 1.0 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] cache.tls_allowed_ciphers      = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] cache.tls_cafile               = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] cache.tls_certfile             = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] cache.tls_enabled              = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] cache.tls_keyfile              = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] cache.username                 = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] coordination.backend_url       = **** {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] database.asyncio_connection    = **** {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] database.asyncio_slave_connection = **** {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] database.backend               = sqlalchemy {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] database.connection            = **** {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] database.connection_debug      = 0 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] database.connection_parameters =  {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] database.connection_recycle_time = 3600 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] database.connection_trace      = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] database.db_inc_retry_interval = True {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] database.db_max_retries        = 20 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] database.db_max_retry_interval = 10 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] database.db_retry_interval     = 1 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] database.max_overflow          = 50 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] database.max_pool_size         = 5 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] database.max_retries           = 10 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] database.mysql_wsrep_sync_wait = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] database.pool_timeout          = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] database.retry_interval        = 10 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] database.slave_connection      = **** {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] database.sqlite_synchronous    = True {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-d0ca8ff2-b961-49e7-b053-70948b28565c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87165) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] database.synchronous_reader    = True {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] database.use_db_reconnect      = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.quobyte [None req-d0ca8ff2-b961-49e7-b053-70948b28565c None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.quobyte [None req-d0ca8ff2-b961-49e7-b053-70948b28565c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_tracing.insecure = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d0ca8ff2-b961-49e7-b053-70948b28565c None None] Running cmd (subprocess): mount.quobyte {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] profiler.connection_string     = messaging:// {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] profiler.enabled               = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] profiler.es_doc_type           = notification {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] profiler.es_scroll_size        = 10000 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] profiler.es_scroll_time        = 2m {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] profiler.filter_error_trace    = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] profiler.hmac_keys             = **** {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] profiler.sentinel_service_name = mymaster {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] profiler.socket_timeout        = 0.1 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] profiler.trace_requests        = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] profiler.trace_sqlalchemy      = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] profiler_jaeger.process_tags   = {} {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] profiler_jaeger.service_name_prefix = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] profiler_otlp.service_name_prefix = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_policy.enforce_new_defaults = True {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_policy.policy_default_rule = default {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_policy.policy_file        = policy.yaml {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] privsep_osbrick.group          = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] privsep_osbrick.helper_command = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] privsep_osbrick.user           = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] cinder_sys_admin.group         = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] cinder_sys_admin.helper_command = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] cinder_sys_admin.user          = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] service_user.auth_section      = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] service_user.auth_type         = password {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] service_user.cafile            = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] service_user.certfile          = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] service_user.collect_timing    = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] service_user.insecure          = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] service_user.keyfile           = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] service_user.send_service_user_token = True {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] service_user.split_loggers     = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] service_user.timeout           = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] service_user.tls_ciphers       = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] service_user.tls_min_version   = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] glance.auth_section            = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] glance.auth_type               = password {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] glance.certfile                = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] glance.collect_timing          = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] glance.insecure                = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] glance.keyfile                 = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] glance.region_name             = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] glance.split_loggers           = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] glance.timeout                 = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] glance.tls_ciphers             = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] glance.tls_min_version         = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.backend_availability_zone = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.chap_password = **** {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.chap_username =  {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.disk_geometry = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.driver_client_cert = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.driver_client_cert_key = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.driver_data_namespace = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.driver_use_ssl = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.extra_capabilities = {} {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.filter_function = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.goodness_function = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.iscsi_target_flags =  {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.iscsi_write_cache = on {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.iser_helper   = tgtadm {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.iser_ip_address = 192.168.122.253 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.iser_port     = 3260 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.nas_host      =  {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.nas_login     = admin {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.nas_mount_options = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.nas_password  = **** {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.nas_private_key =  {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.nas_share_path =  {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.num_shell_tries = 3 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.quobyte_volume_url = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.replication_device = **** {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.report_discard_supported = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.reserved_percentage = 0 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.target_helper = tgtadm {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.target_ip_address = 192.168.122.253 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.target_port   = 3260 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.target_protocol = iscsi {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.trace_flags   = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.unique_fqdn_network = True {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.use_chap_auth = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.volume_backend_name = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.volume_clear  = zero {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.volume_clear_ionice = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.volume_clear_size = 0 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack quobyte-client[87166]: Reading configuration file: /etc/quobyte/client.cfg
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_reports.file_event_handler = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_reports.log_dir           = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack quobyte-client[87166]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.backend_availability_zone = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.backend_host         = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.chap_password        = **** {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.chap_username        = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d0ca8ff2-b961-49e7-b053-70948b28565c None None] CMD "mount.quobyte" returned: 1 in 0.051s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.chiscsi_conf         = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.disk_geometry        = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d0ca8ff2-b961-49e7-b053-70948b28565c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.driver_client_cert   = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d0ca8ff2-b961-49e7-b053-70948b28565c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.driver_data_namespace = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-d0ca8ff2-b961-49e7-b053-70948b28565c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.driver_use_ssl       = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.extra_capabilities   = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.filter_function      = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.goodness_function    = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.iser_helper          = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.iser_ip_address      = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.iser_port            = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.iser_target_prefix   = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.nas_host             = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.nas_login            = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.nas_mount_options    = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.nas_password         = **** {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.nas_private_key      = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.nas_share_path       = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.nas_ssh_port         = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.num_shell_tries      = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-d0ca8ff2-b961-49e7-b053-70948b28565c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.nvmet_port_id        = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d0ca8ff2-b961-49e7-b053-70948b28565c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d0ca8ff2-b961-49e7-b053-70948b28565c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.replication_device   = **** {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.report_discard_supported = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.reserved_percentage  = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.scst_target_driver   = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.storage_protocol     = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.target_helper        = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.target_ip_address    = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.target_port          = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.target_prefix        = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.target_protocol      = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.trace_flags          = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.use_chap_auth        = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.volume_clear         = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.volume_clear_size    = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] QuobyteHD.volumes_dir          = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack sudo[87167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack sudo[87167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_rabbit.ssl      = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_notifications.driver = [] {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_notifications.retry = -1 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] key_manager.fixed_key          = **** {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] barbican.barbican_api_version  = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] barbican.barbican_endpoint     = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] barbican.barbican_endpoint_type = public {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] barbican.barbican_region_name  = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] barbican.cafile                = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] barbican.certfile              = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] barbican.collect_timing        = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] barbican.insecure              = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] barbican.keyfile               = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] barbican.number_of_retries     = 60 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] barbican.retry_delay           = 1 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] barbican.send_service_user_token = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] barbican.split_loggers         = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] barbican.timeout               = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] barbican.tls_ciphers           = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] barbican.tls_min_version       = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] barbican.verify_ssl            = True {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] barbican.verify_ssl_path       = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] barbican_service_user.auth_section = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] barbican_service_user.auth_type = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] barbican_service_user.cafile   = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] barbican_service_user.certfile = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] barbican_service_user.collect_timing = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] barbican_service_user.insecure = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] barbican_service_user.keyfile  = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] barbican_service_user.split_loggers = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] barbican_service_user.timeout  = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] barbican_service_user.tls_ciphers = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] barbican_service_user.tls_min_version = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] vault.approle_role_id          = **** {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] vault.approle_secret_id        = **** {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] vault.auth_method              = approle {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] vault.auth_path                = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] vault.kv_mountpoint            = secret {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] vault.kv_path                  = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] vault.kv_version               = 2 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] vault.namespace                = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] vault.root_token_id            = **** {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] vault.ssl_ca_crt_file          = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] vault.timeout                  = 60.0 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] vault.token_file               = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] vault.token_role               = None {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] vault.use_ssl                  = False {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 06 11:41:45 devstack cinder-volume[86857]: DEBUG oslo_service.backend._eventlet.service [None req-27b89d27-e8fd-4f5f-861b-540c7888d958 None None] ******************************************************************************** {{(pid=86857) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 06 11:41:45 devstack sudo[87167]: pam_unix(sudo:session): session closed for user root
Nov 06 11:41:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d0ca8ff2-b961-49e7-b053-70948b28565c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.242s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:41:45 devstack cinder-volume[87165]: INFO cinder.volume.driver [None req-d0ca8ff2-b961-49e7-b053-70948b28565c None None] Driver hasn't implemented _init_vendor_properties()
Nov 06 11:41:45 devstack cinder-volume[87165]: DEBUG cinder.volume.driver [None req-d0ca8ff2-b961-49e7-b053-70948b28565c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.401268005371, 'free_capacity_gb': 1773.401268005371, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87165) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 06 11:41:45 devstack cinder-volume[87165]: DEBUG oslo_db.sqlalchemy.engines [None req-d0ca8ff2-b961-49e7-b053-70948b28565c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87165) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 06 11:41:45 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writer thread running {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 06 11:41:45 devstack cinder-volume[87165]: DEBUG cinder.db.api [None req-d0ca8ff2-b961-49e7-b053-70948b28565c None None] Building query based on filter {{(pid=87165) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Nov 06 11:41:45 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-d0ca8ff2-b961-49e7-b053-70948b28565c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87165) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 06 11:41:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d0ca8ff2-b961-49e7-b053-70948b28565c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:41:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d0ca8ff2-b961-49e7-b053-70948b28565c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:41:45 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-d0ca8ff2-b961-49e7-b053-70948b28565c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:41:45 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-d0ca8ff2-b961-49e7-b053-70948b28565c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:41:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d0ca8ff2-b961-49e7-b053-70948b28565c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:41:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d0ca8ff2-b961-49e7-b053-70948b28565c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:41:45 devstack cinder-volume[87165]: INFO cinder.keymgr.migration [None req-f83e381f-e3eb-4b5d-8b2e-38bf19417f3d None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 06 11:41:45 devstack sudo[87180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:41:45 devstack sudo[87180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:41:45 devstack sudo[87180]: pam_unix(sudo:session): session closed for user root
Nov 06 11:41:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d0ca8ff2-b961-49e7-b053-70948b28565c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.239s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:41:45 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-d0ca8ff2-b961-49e7-b053-70948b28565c None None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:41:45 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-d0ca8ff2-b961-49e7-b053-70948b28565c None None] Driver initialization completed successfully.
Nov 06 11:41:45 devstack cinder-volume[87165]: INFO cinder.manager [None req-d0ca8ff2-b961-49e7-b053-70948b28565c None None] Initiating service 3 cleanup
Nov 06 11:41:45 devstack cinder-volume[87165]: INFO cinder.manager [None req-d0ca8ff2-b961-49e7-b053-70948b28565c None None] Service 3 cleanup completed.
Nov 06 11:41:45 devstack cinder-volume[87165]: DEBUG cinder.service [None req-d0ca8ff2-b961-49e7-b053-70948b28565c None None] Creating RPC server for service cinder-volume {{(pid=87165) start /opt/stack/cinder/cinder/service.py:231}}
Nov 06 11:41:45 devstack cinder-volume[87165]: DEBUG cinder.service [None req-d0ca8ff2-b961-49e7-b053-70948b28565c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87165) start /opt/stack/cinder/cinder/service.py:237}}
Nov 06 11:41:45 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-d0ca8ff2-b961-49e7-b053-70948b28565c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Nov 06 11:41:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d0ca8ff2-b961-49e7-b053-70948b28565c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:41:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d0ca8ff2-b961-49e7-b053-70948b28565c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:41:45 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-d0ca8ff2-b961-49e7-b053-70948b28565c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:41:45 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-d0ca8ff2-b961-49e7-b053-70948b28565c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:41:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d0ca8ff2-b961-49e7-b053-70948b28565c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:41:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d0ca8ff2-b961-49e7-b053-70948b28565c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:41:45 devstack sudo[87193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:41:45 devstack sudo[87193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:41:46 devstack sudo[87193]: pam_unix(sudo:session): session closed for user root
Nov 06 11:41:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d0ca8ff2-b961-49e7-b053-70948b28565c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.233s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:41:46 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-d0ca8ff2-b961-49e7-b053-70948b28565c None None] Driver post RPC initialization completed successfully.
Nov 06 11:41:54 devstack cinder-volume[86857]: DEBUG dbcounter [-] [86857] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86857) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 11:41:55 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:SELECT=2 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 11:41:56 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 11:42:17 devstack cinder-volume[87165]: DEBUG oslo_service.periodic_task [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running periodic task VolumeManager._thread_info {{(pid=87165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 11:42:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] thread count: 6 {{(pid=87165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 11:42:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] thread info: [<_MainThread(MainThread, started 127732956901504)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127732842693056)>, <Thread(Thread-3 (stat_writer), started daemon 127732841891136)>, <Thread(Rabbit-heartbeat, started daemon 127732842515648)>, <Thread(Thread-5 (_runner), started daemon 127732840534464)>, <Thread(Thread-7 (_runner), started daemon 127732840636032)>] {{(pid=87165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 11:42:44 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-92aa0dbf-d113-4d46-9c66-8311c85849bc tempest-TaggedAttachmentsTest-1691297006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:42:44 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-92aa0dbf-d113-4d46-9c66-8311c85849bc tempest-TaggedAttachmentsTest-1691297006 None] Flow 'volume_create_manager' (1901db9b-befa-4a1d-b8de-91c12180956d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:42:44 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-92aa0dbf-d113-4d46-9c66-8311c85849bc tempest-TaggedAttachmentsTest-1691297006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c674f289-d610-4f4d-a090-bf166f33f2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:42:44 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-92aa0dbf-d113-4d46-9c66-8311c85849bc tempest-TaggedAttachmentsTest-1691297006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c674f289-d610-4f4d-a090-bf166f33f2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-427074725',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10fef99a-9c48-4364-ad00-8a1e9df9f7ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf943c8835a14ed2b78a0e41a53af71f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:42:45Z,use_quota=True,user_id='9a42e1d324c94433a36a30eb9ec95997',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:42:44 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-92aa0dbf-d113-4d46-9c66-8311c85849bc tempest-TaggedAttachmentsTest-1691297006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b1884f0-0e8d-4067-bd2b-33d3cfd733be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:42:44 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-92aa0dbf-d113-4d46-9c66-8311c85849bc tempest-TaggedAttachmentsTest-1691297006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b1884f0-0e8d-4067-bd2b-33d3cfd733be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:42:44 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-92aa0dbf-d113-4d46-9c66-8311c85849bc tempest-TaggedAttachmentsTest-1691297006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (410b15f6-409e-4ca1-a564-f0701b7f571b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:42:44 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-92aa0dbf-d113-4d46-9c66-8311c85849bc tempest-TaggedAttachmentsTest-1691297006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (410b15f6-409e-4ca1-a564-f0701b7f571b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10fef99a-9c48-4364-ad00-8a1e9df9f7ca', 'volume_name': 'volume-10fef99a-9c48-4364-ad00-8a1e9df9f7ca', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:42:44 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-92aa0dbf-d113-4d46-9c66-8311c85849bc tempest-TaggedAttachmentsTest-1691297006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07eeeacc-24bd-4468-9b99-99152329dd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:42:44 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-92aa0dbf-d113-4d46-9c66-8311c85849bc tempest-TaggedAttachmentsTest-1691297006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07eeeacc-24bd-4468-9b99-99152329dd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:42:44 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-92aa0dbf-d113-4d46-9c66-8311c85849bc tempest-TaggedAttachmentsTest-1691297006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13fd316a-1902-4d80-8156-4c7c2e71a1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:42:44 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-92aa0dbf-d113-4d46-9c66-8311c85849bc tempest-TaggedAttachmentsTest-1691297006 None] Volume 10fef99a-9c48-4364-ad00-8a1e9df9f7ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10fef99a-9c48-4364-ad00-8a1e9df9f7ca', 'volume_size': 1}
Nov 06 11:42:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-92aa0dbf-d113-4d46-9c66-8311c85849bc tempest-TaggedAttachmentsTest-1691297006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:42:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-92aa0dbf-d113-4d46-9c66-8311c85849bc tempest-TaggedAttachmentsTest-1691297006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:42:44 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-92aa0dbf-d113-4d46-9c66-8311c85849bc tempest-TaggedAttachmentsTest-1691297006 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-427074725',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10fef99a-9c48-4364-ad00-8a1e9df9f7ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf943c8835a14ed2b78a0e41a53af71f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:42:45Z,use_quota=True,user_id='9a42e1d324c94433a36a30eb9ec95997',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:42:44 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-92aa0dbf-d113-4d46-9c66-8311c85849bc tempest-TaggedAttachmentsTest-1691297006 None] Creating volume 10fef99a-9c48-4364-ad00-8a1e9df9f7ca {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:42:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-92aa0dbf-d113-4d46-9c66-8311c85849bc tempest-TaggedAttachmentsTest-1691297006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:42:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-92aa0dbf-d113-4d46-9c66-8311c85849bc tempest-TaggedAttachmentsTest-1691297006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:42:44 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-92aa0dbf-d113-4d46-9c66-8311c85849bc tempest-TaggedAttachmentsTest-1691297006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:42:44 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-92aa0dbf-d113-4d46-9c66-8311c85849bc tempest-TaggedAttachmentsTest-1691297006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:42:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-92aa0dbf-d113-4d46-9c66-8311c85849bc tempest-TaggedAttachmentsTest-1691297006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:42:44 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-92aa0dbf-d113-4d46-9c66-8311c85849bc tempest-TaggedAttachmentsTest-1691297006 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:42:44 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-92aa0dbf-d113-4d46-9c66-8311c85849bc tempest-TaggedAttachmentsTest-1691297006 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:42:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-92aa0dbf-d113-4d46-9c66-8311c85849bc tempest-TaggedAttachmentsTest-1691297006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-10fef99a-9c48-4364-ad00-8a1e9df9f7ca 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:42:44 devstack sudo[87556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-10fef99a-9c48-4364-ad00-8a1e9df9f7ca 1073741824
Nov 06 11:42:44 devstack sudo[87556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:42:45 devstack sudo[87556]: pam_unix(sudo:session): session closed for user root
Nov 06 11:42:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-92aa0dbf-d113-4d46-9c66-8311c85849bc tempest-TaggedAttachmentsTest-1691297006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-10fef99a-9c48-4364-ad00-8a1e9df9f7ca 1073741824" returned: 0 in 0.607s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:42:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-92aa0dbf-d113-4d46-9c66-8311c85849bc tempest-TaggedAttachmentsTest-1691297006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-10fef99a-9c48-4364-ad00-8a1e9df9f7ca {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:42:45 devstack sudo[87876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-10fef99a-9c48-4364-ad00-8a1e9df9f7ca
Nov 06 11:42:45 devstack sudo[87876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:42:45 devstack sudo[87876]: pam_unix(sudo:session): session closed for user root
Nov 06 11:42:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-92aa0dbf-d113-4d46-9c66-8311c85849bc tempest-TaggedAttachmentsTest-1691297006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-10fef99a-9c48-4364-ad00-8a1e9df9f7ca" returned: 0 in 0.377s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:42:45 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-92aa0dbf-d113-4d46-9c66-8311c85849bc tempest-TaggedAttachmentsTest-1691297006 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:42:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-92aa0dbf-d113-4d46-9c66-8311c85849bc tempest-TaggedAttachmentsTest-1691297006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:42:45 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-92aa0dbf-d113-4d46-9c66-8311c85849bc tempest-TaggedAttachmentsTest-1691297006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13fd316a-1902-4d80-8156-4c7c2e71a1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10fef99a-9c48-4364-ad00-8a1e9df9f7ca', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:42:45 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-92aa0dbf-d113-4d46-9c66-8311c85849bc tempest-TaggedAttachmentsTest-1691297006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cdae021-3c30-468c-a910-a054204942f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:42:45 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-92aa0dbf-d113-4d46-9c66-8311c85849bc tempest-TaggedAttachmentsTest-1691297006 None] Volume volume-10fef99a-9c48-4364-ad00-8a1e9df9f7ca (10fef99a-9c48-4364-ad00-8a1e9df9f7ca): created successfully
Nov 06 11:42:45 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-92aa0dbf-d113-4d46-9c66-8311c85849bc tempest-TaggedAttachmentsTest-1691297006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cdae021-3c30-468c-a910-a054204942f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:42:45 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-92aa0dbf-d113-4d46-9c66-8311c85849bc tempest-TaggedAttachmentsTest-1691297006 None] Flow 'volume_create_manager' (1901db9b-befa-4a1d-b8de-91c12180956d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:42:45 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-92aa0dbf-d113-4d46-9c66-8311c85849bc tempest-TaggedAttachmentsTest-1691297006 None] Created volume successfully.
Nov 06 11:42:55 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 11:42:55 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 11:43:10 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0499377-621b-4fd2-8612-360693efc672 tempest-VolumesAdminNegativeTest-1371137587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:43:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c0499377-621b-4fd2-8612-360693efc672 tempest-VolumesAdminNegativeTest-1371137587 None] Flow 'volume_create_manager' (cbaf8983-6dbc-4432-a62d-99ec278c9c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:43:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c0499377-621b-4fd2-8612-360693efc672 tempest-VolumesAdminNegativeTest-1371137587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c898bdda-6336-45ce-8cb8-2f8ecb3a6151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:43:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c0499377-621b-4fd2-8612-360693efc672 tempest-VolumesAdminNegativeTest-1371137587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c898bdda-6336-45ce-8cb8-2f8ecb3a6151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1211668870',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=722c292f-9041-4705-ba6a-fdcc792256aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='369b42083df84c26accda81fc999a65e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:43:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:43:10Z,use_quota=True,user_id='898e2223672849838f0eea69fc3b34e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:43:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c0499377-621b-4fd2-8612-360693efc672 tempest-VolumesAdminNegativeTest-1371137587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d14db6da-617c-464a-a168-01d6ad15c4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:43:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c0499377-621b-4fd2-8612-360693efc672 tempest-VolumesAdminNegativeTest-1371137587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d14db6da-617c-464a-a168-01d6ad15c4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:43:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c0499377-621b-4fd2-8612-360693efc672 tempest-VolumesAdminNegativeTest-1371137587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca205967-f22f-468d-a157-64291c0de66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:43:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c0499377-621b-4fd2-8612-360693efc672 tempest-VolumesAdminNegativeTest-1371137587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca205967-f22f-468d-a157-64291c0de66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '722c292f-9041-4705-ba6a-fdcc792256aa', 'volume_name': 'volume-722c292f-9041-4705-ba6a-fdcc792256aa', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:43:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c0499377-621b-4fd2-8612-360693efc672 tempest-VolumesAdminNegativeTest-1371137587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (228afad7-9ea2-487e-9615-cf6a84bbcd7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:43:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c0499377-621b-4fd2-8612-360693efc672 tempest-VolumesAdminNegativeTest-1371137587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (228afad7-9ea2-487e-9615-cf6a84bbcd7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:43:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c0499377-621b-4fd2-8612-360693efc672 tempest-VolumesAdminNegativeTest-1371137587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ba6c59f-73cf-4758-8414-9672c20a48b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:43:10 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-c0499377-621b-4fd2-8612-360693efc672 tempest-VolumesAdminNegativeTest-1371137587 None] Volume 722c292f-9041-4705-ba6a-fdcc792256aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-722c292f-9041-4705-ba6a-fdcc792256aa', 'volume_size': 1}
Nov 06 11:43:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c0499377-621b-4fd2-8612-360693efc672 tempest-VolumesAdminNegativeTest-1371137587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:43:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c0499377-621b-4fd2-8612-360693efc672 tempest-VolumesAdminNegativeTest-1371137587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:43:10 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-c0499377-621b-4fd2-8612-360693efc672 tempest-VolumesAdminNegativeTest-1371137587 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1211668870',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=722c292f-9041-4705-ba6a-fdcc792256aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='369b42083df84c26accda81fc999a65e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:43:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:43:10Z,use_quota=True,user_id='898e2223672849838f0eea69fc3b34e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:43:10 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-c0499377-621b-4fd2-8612-360693efc672 tempest-VolumesAdminNegativeTest-1371137587 None] Creating volume 722c292f-9041-4705-ba6a-fdcc792256aa {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:43:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c0499377-621b-4fd2-8612-360693efc672 tempest-VolumesAdminNegativeTest-1371137587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:43:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c0499377-621b-4fd2-8612-360693efc672 tempest-VolumesAdminNegativeTest-1371137587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:43:10 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-c0499377-621b-4fd2-8612-360693efc672 tempest-VolumesAdminNegativeTest-1371137587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:43:10 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-c0499377-621b-4fd2-8612-360693efc672 tempest-VolumesAdminNegativeTest-1371137587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:43:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c0499377-621b-4fd2-8612-360693efc672 tempest-VolumesAdminNegativeTest-1371137587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:43:10 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-c0499377-621b-4fd2-8612-360693efc672 tempest-VolumesAdminNegativeTest-1371137587 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:43:10 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-c0499377-621b-4fd2-8612-360693efc672 tempest-VolumesAdminNegativeTest-1371137587 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:43:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c0499377-621b-4fd2-8612-360693efc672 tempest-VolumesAdminNegativeTest-1371137587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-722c292f-9041-4705-ba6a-fdcc792256aa 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:43:10 devstack sudo[88340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-722c292f-9041-4705-ba6a-fdcc792256aa 1073741824
Nov 06 11:43:10 devstack sudo[88340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:43:11 devstack sudo[88340]: pam_unix(sudo:session): session closed for user root
Nov 06 11:43:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c0499377-621b-4fd2-8612-360693efc672 tempest-VolumesAdminNegativeTest-1371137587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-722c292f-9041-4705-ba6a-fdcc792256aa 1073741824" returned: 0 in 0.819s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:43:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c0499377-621b-4fd2-8612-360693efc672 tempest-VolumesAdminNegativeTest-1371137587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-722c292f-9041-4705-ba6a-fdcc792256aa {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:43:11 devstack sudo[88354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-722c292f-9041-4705-ba6a-fdcc792256aa
Nov 06 11:43:11 devstack sudo[88354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:43:12 devstack sudo[88354]: pam_unix(sudo:session): session closed for user root
Nov 06 11:43:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c0499377-621b-4fd2-8612-360693efc672 tempest-VolumesAdminNegativeTest-1371137587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-722c292f-9041-4705-ba6a-fdcc792256aa" returned: 0 in 0.546s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:43:12 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-c0499377-621b-4fd2-8612-360693efc672 tempest-VolumesAdminNegativeTest-1371137587 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:43:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c0499377-621b-4fd2-8612-360693efc672 tempest-VolumesAdminNegativeTest-1371137587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.515s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:43:12 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c0499377-621b-4fd2-8612-360693efc672 tempest-VolumesAdminNegativeTest-1371137587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ba6c59f-73cf-4758-8414-9672c20a48b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-722c292f-9041-4705-ba6a-fdcc792256aa', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:43:12 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c0499377-621b-4fd2-8612-360693efc672 tempest-VolumesAdminNegativeTest-1371137587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09f6c38a-0b5d-4174-bbc2-4d280fb819c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:43:12 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-c0499377-621b-4fd2-8612-360693efc672 tempest-VolumesAdminNegativeTest-1371137587 None] Volume volume-722c292f-9041-4705-ba6a-fdcc792256aa (722c292f-9041-4705-ba6a-fdcc792256aa): created successfully
Nov 06 11:43:12 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c0499377-621b-4fd2-8612-360693efc672 tempest-VolumesAdminNegativeTest-1371137587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09f6c38a-0b5d-4174-bbc2-4d280fb819c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:43:12 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c0499377-621b-4fd2-8612-360693efc672 tempest-VolumesAdminNegativeTest-1371137587 None] Flow 'volume_create_manager' (cbaf8983-6dbc-4432-a62d-99ec278c9c15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:43:12 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-c0499377-621b-4fd2-8612-360693efc672 tempest-VolumesAdminNegativeTest-1371137587 None] Created volume successfully.
Nov 06 11:43:13 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5b465a19-efb5-4865-8e7a-72f92919c1aa tempest-VolumesAdminNegativeTest-1371137587 None] Acquiring lock "cinder-722c292f-9041-4705-ba6a-fdcc792256aa-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:43:13 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5b465a19-efb5-4865-8e7a-72f92919c1aa tempest-VolumesAdminNegativeTest-1371137587 None] Lock "cinder-722c292f-9041-4705-ba6a-fdcc792256aa-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:43:13 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5b465a19-efb5-4865-8e7a-72f92919c1aa tempest-VolumesAdminNegativeTest-1371137587 None] Acquiring lock "cinder-quobyte-722c292f-9041-4705-ba6a-fdcc792256aa" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:43:13 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5b465a19-efb5-4865-8e7a-72f92919c1aa tempest-VolumesAdminNegativeTest-1371137587 None] Lock "cinder-quobyte-722c292f-9041-4705-ba6a-fdcc792256aa" acquired by "delete_volume" :: waited 0.028s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:43:13 devstack cinder-volume[87165]: INFO oslo.privsep.daemon [None req-5b465a19-efb5-4865-8e7a-72f92919c1aa tempest-VolumesAdminNegativeTest-1371137587 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpb4hw2qc4/privsep.sock']
Nov 06 11:43:13 devstack sudo[88418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpb4hw2qc4/privsep.sock
Nov 06 11:43:13 devstack sudo[88418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:43:15 devstack cinder-volume[87165]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Nov 06 11:43:15 devstack cinder-volume[87165]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 06 11:43:15 devstack cinder-volume[87165]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Nov 06 11:43:15 devstack cinder-volume[87165]: WARNING oslo.privsep.daemon [-] privsep log: 
Nov 06 11:43:15 devstack cinder-volume[87165]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Nov 06 11:43:15 devstack cinder-volume[87165]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Nov 06 11:43:15 devstack cinder-volume[87165]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 06 11:43:15 devstack cinder-volume[87165]: WARNING oslo.privsep.daemon [-] privsep log: 
Nov 06 11:43:15 devstack cinder-volume[87165]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Nov 06 11:43:16 devstack sudo[88418]: pam_unix(sudo:session): session closed for user root
Nov 06 11:43:16 devstack cinder-volume[87165]: INFO oslo.privsep.daemon [None req-5b465a19-efb5-4865-8e7a-72f92919c1aa tempest-VolumesAdminNegativeTest-1371137587 None] Spawned new privsep daemon via rootwrap
Nov 06 11:43:16 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [None req-5b465a19-efb5-4865-8e7a-72f92919c1aa tempest-VolumesAdminNegativeTest-1371137587 None] Accepted privsep connection to /tmp/tmpb4hw2qc4/privsep.sock {{(pid=87165) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Nov 06 11:43:16 devstack cinder-volume[87165]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 06 11:43:16 devstack cinder-volume[87165]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 06 11:43:16 devstack cinder-volume[87165]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 06 11:43:16 devstack cinder-volume[87165]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88431
Nov 06 11:43:16 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69f1d66-46ae-4ade-955c-ab56da387e62]: (2,) {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:43:16 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7e3903-d872-443d-abb0-7835608fd644]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:43:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5b465a19-efb5-4865-8e7a-72f92919c1aa tempest-VolumesAdminNegativeTest-1371137587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-722c292f-9041-4705-ba6a-fdcc792256aa {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:43:16 devstack sudo[88435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-722c292f-9041-4705-ba6a-fdcc792256aa
Nov 06 11:43:16 devstack sudo[88435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:43:17 devstack cinder-volume[87165]: DEBUG oslo_service.periodic_task [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 11:43:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:43:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:43:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:43:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:43:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:43:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:43:17 devstack sudo[88439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:43:17 devstack sudo[88439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:43:17 devstack sudo[88435]: pam_unix(sudo:session): session closed for user root
Nov 06 11:43:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5b465a19-efb5-4865-8e7a-72f92919c1aa tempest-VolumesAdminNegativeTest-1371137587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-722c292f-9041-4705-ba6a-fdcc792256aa" returned: 0 in 0.824s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:43:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5b465a19-efb5-4865-8e7a-72f92919c1aa tempest-VolumesAdminNegativeTest-1371137587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-722c292f-9041-4705-ba6a-fdcc792256aa {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:43:17 devstack sudo[88443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-722c292f-9041-4705-ba6a-fdcc792256aa
Nov 06 11:43:17 devstack sudo[88443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:43:17 devstack sudo[88439]: pam_unix(sudo:session): session closed for user root
Nov 06 11:43:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.598s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:43:17 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:43:17 devstack cinder-volume[87165]: DEBUG oslo_service.periodic_task [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running periodic task VolumeManager._thread_info {{(pid=87165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 11:43:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] thread count: 8 {{(pid=87165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 11:43:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] thread info: [<_MainThread(MainThread, started 127732956901504)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127732842693056)>, <Thread(Thread-3 (stat_writer), started daemon 127732841891136)>, <Thread(Rabbit-heartbeat, started daemon 127732842515648)>, <Thread(Thread-5 (_runner), started daemon 127732840534464)>, <Thread(Thread-7 (_runner), started daemon 127732840636032)>, <Thread(fd_logger, started daemon 127732838664256)>, <Thread(privsep_reader, started daemon 127732838673408)>] {{(pid=87165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 11:43:17 devstack sudo[88443]: pam_unix(sudo:session): session closed for user root
Nov 06 11:43:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5b465a19-efb5-4865-8e7a-72f92919c1aa tempest-VolumesAdminNegativeTest-1371137587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-722c292f-9041-4705-ba6a-fdcc792256aa" returned: 0 in 0.616s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:43:17 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5b465a19-efb5-4865-8e7a-72f92919c1aa tempest-VolumesAdminNegativeTest-1371137587 None] Lock "cinder-quobyte-722c292f-9041-4705-ba6a-fdcc792256aa" released by "delete_volume" :: held 4.358s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:43:18 devstack cinder-volume[87165]: WARNING cinder.quota [None req-5b465a19-efb5-4865-8e7a-72f92919c1aa tempest-VolumesAdminNegativeTest-1371137587 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 06 11:43:18 devstack cinder-volume[87165]: WARNING cinder.quota [None req-5b465a19-efb5-4865-8e7a-72f92919c1aa tempest-VolumesAdminNegativeTest-1371137587 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 06 11:43:18 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-5b465a19-efb5-4865-8e7a-72f92919c1aa tempest-VolumesAdminNegativeTest-1371137587 None] Created reservations ['78b71a19-3ec4-4db3-bca9-cbd571a63176', '9f734746-6db8-4fbb-87a5-c777ace4ed3a', '68d069cf-4f2d-4875-93b4-93e55e64af6f', 'cc3ecd26-9068-4a6e-92e5-41fed2964b4e'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:43:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5b465a19-efb5-4865-8e7a-72f92919c1aa tempest-VolumesAdminNegativeTest-1371137587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:43:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5b465a19-efb5-4865-8e7a-72f92919c1aa tempest-VolumesAdminNegativeTest-1371137587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:43:18 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5b465a19-efb5-4865-8e7a-72f92919c1aa tempest-VolumesAdminNegativeTest-1371137587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:43:18 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5b465a19-efb5-4865-8e7a-72f92919c1aa tempest-VolumesAdminNegativeTest-1371137587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:43:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5b465a19-efb5-4865-8e7a-72f92919c1aa tempest-VolumesAdminNegativeTest-1371137587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:43:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5b465a19-efb5-4865-8e7a-72f92919c1aa tempest-VolumesAdminNegativeTest-1371137587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:43:18 devstack sudo[88448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:43:18 devstack sudo[88448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:43:18 devstack sudo[88448]: pam_unix(sudo:session): session closed for user root
Nov 06 11:43:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5b465a19-efb5-4865-8e7a-72f92919c1aa tempest-VolumesAdminNegativeTest-1371137587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.647s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:43:19 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-5b465a19-efb5-4865-8e7a-72f92919c1aa tempest-VolumesAdminNegativeTest-1371137587 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:43:19 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-5b465a19-efb5-4865-8e7a-72f92919c1aa tempest-VolumesAdminNegativeTest-1371137587 None] Deleted volume successfully.
Nov 06 11:43:19 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5b465a19-efb5-4865-8e7a-72f92919c1aa tempest-VolumesAdminNegativeTest-1371137587 None] Lock "cinder-722c292f-9041-4705-ba6a-fdcc792256aa-delete_volume" released by "delete_volume" :: held 5.683s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:43:26 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f4cce7c-6b73-4e84-8d67-41153e7cd6b8 tempest-ServersNegativeTestJSON-1077345452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:43:26 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7f4cce7c-6b73-4e84-8d67-41153e7cd6b8 tempest-ServersNegativeTestJSON-1077345452 None] Flow 'volume_create_manager' (0250d990-a344-4e44-93bc-1a62f26b6e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:43:26 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7f4cce7c-6b73-4e84-8d67-41153e7cd6b8 tempest-ServersNegativeTestJSON-1077345452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98d8d1d4-9fc1-4a32-be0a-548a554e1abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:43:26 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7f4cce7c-6b73-4e84-8d67-41153e7cd6b8 tempest-ServersNegativeTestJSON-1077345452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98d8d1d4-9fc1-4a32-be0a-548a554e1abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-116595818',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee15ce71-9aa7-4bac-a2b1-f8efd935a7e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='655da6eac4594d66aeb01a5cf4f18de5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:43:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:43:27Z,use_quota=True,user_id='014df8c834da47e884381c2dc904be0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:43:26 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7f4cce7c-6b73-4e84-8d67-41153e7cd6b8 tempest-ServersNegativeTestJSON-1077345452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac99cea6-230b-473f-8ed8-ed07de3f9310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:43:26 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7f4cce7c-6b73-4e84-8d67-41153e7cd6b8 tempest-ServersNegativeTestJSON-1077345452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac99cea6-230b-473f-8ed8-ed07de3f9310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:43:27 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7f4cce7c-6b73-4e84-8d67-41153e7cd6b8 tempest-ServersNegativeTestJSON-1077345452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (949eb526-de06-417a-bdad-910aaa9baff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:43:27 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7f4cce7c-6b73-4e84-8d67-41153e7cd6b8 tempest-ServersNegativeTestJSON-1077345452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (949eb526-de06-417a-bdad-910aaa9baff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee15ce71-9aa7-4bac-a2b1-f8efd935a7e5', 'volume_name': 'volume-ee15ce71-9aa7-4bac-a2b1-f8efd935a7e5', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:43:27 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7f4cce7c-6b73-4e84-8d67-41153e7cd6b8 tempest-ServersNegativeTestJSON-1077345452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebcc47e9-b4df-40fd-8cd6-728980b2e20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:43:27 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7f4cce7c-6b73-4e84-8d67-41153e7cd6b8 tempest-ServersNegativeTestJSON-1077345452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebcc47e9-b4df-40fd-8cd6-728980b2e20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:43:27 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7f4cce7c-6b73-4e84-8d67-41153e7cd6b8 tempest-ServersNegativeTestJSON-1077345452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ea37d4d-29f1-4ebf-ad3b-29945152109e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:43:27 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-7f4cce7c-6b73-4e84-8d67-41153e7cd6b8 tempest-ServersNegativeTestJSON-1077345452 None] Volume ee15ce71-9aa7-4bac-a2b1-f8efd935a7e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee15ce71-9aa7-4bac-a2b1-f8efd935a7e5', 'volume_size': 1}
Nov 06 11:43:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-7f4cce7c-6b73-4e84-8d67-41153e7cd6b8 tempest-ServersNegativeTestJSON-1077345452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:43:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-7f4cce7c-6b73-4e84-8d67-41153e7cd6b8 tempest-ServersNegativeTestJSON-1077345452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:43:27 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-7f4cce7c-6b73-4e84-8d67-41153e7cd6b8 tempest-ServersNegativeTestJSON-1077345452 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-116595818',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee15ce71-9aa7-4bac-a2b1-f8efd935a7e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='655da6eac4594d66aeb01a5cf4f18de5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:43:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:43:27Z,use_quota=True,user_id='014df8c834da47e884381c2dc904be0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:43:27 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-7f4cce7c-6b73-4e84-8d67-41153e7cd6b8 tempest-ServersNegativeTestJSON-1077345452 None] Creating volume ee15ce71-9aa7-4bac-a2b1-f8efd935a7e5 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:43:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-7f4cce7c-6b73-4e84-8d67-41153e7cd6b8 tempest-ServersNegativeTestJSON-1077345452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:43:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-7f4cce7c-6b73-4e84-8d67-41153e7cd6b8 tempest-ServersNegativeTestJSON-1077345452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:43:27 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-7f4cce7c-6b73-4e84-8d67-41153e7cd6b8 tempest-ServersNegativeTestJSON-1077345452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:43:27 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-7f4cce7c-6b73-4e84-8d67-41153e7cd6b8 tempest-ServersNegativeTestJSON-1077345452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:43:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-7f4cce7c-6b73-4e84-8d67-41153e7cd6b8 tempest-ServersNegativeTestJSON-1077345452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:43:27 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-7f4cce7c-6b73-4e84-8d67-41153e7cd6b8 tempest-ServersNegativeTestJSON-1077345452 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:43:27 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-7f4cce7c-6b73-4e84-8d67-41153e7cd6b8 tempest-ServersNegativeTestJSON-1077345452 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:43:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7f4cce7c-6b73-4e84-8d67-41153e7cd6b8 tempest-ServersNegativeTestJSON-1077345452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ee15ce71-9aa7-4bac-a2b1-f8efd935a7e5 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:43:27 devstack sudo[88533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ee15ce71-9aa7-4bac-a2b1-f8efd935a7e5 1073741824
Nov 06 11:43:27 devstack sudo[88533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:43:27 devstack sudo[88533]: pam_unix(sudo:session): session closed for user root
Nov 06 11:43:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7f4cce7c-6b73-4e84-8d67-41153e7cd6b8 tempest-ServersNegativeTestJSON-1077345452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ee15ce71-9aa7-4bac-a2b1-f8efd935a7e5 1073741824" returned: 0 in 0.740s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:43:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7f4cce7c-6b73-4e84-8d67-41153e7cd6b8 tempest-ServersNegativeTestJSON-1077345452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ee15ce71-9aa7-4bac-a2b1-f8efd935a7e5 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:43:27 devstack sudo[88539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ee15ce71-9aa7-4bac-a2b1-f8efd935a7e5
Nov 06 11:43:27 devstack sudo[88539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:43:28 devstack sudo[88539]: pam_unix(sudo:session): session closed for user root
Nov 06 11:43:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7f4cce7c-6b73-4e84-8d67-41153e7cd6b8 tempest-ServersNegativeTestJSON-1077345452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ee15ce71-9aa7-4bac-a2b1-f8efd935a7e5" returned: 0 in 0.293s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:43:28 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-7f4cce7c-6b73-4e84-8d67-41153e7cd6b8 tempest-ServersNegativeTestJSON-1077345452 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:43:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-7f4cce7c-6b73-4e84-8d67-41153e7cd6b8 tempest-ServersNegativeTestJSON-1077345452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:43:28 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7f4cce7c-6b73-4e84-8d67-41153e7cd6b8 tempest-ServersNegativeTestJSON-1077345452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ea37d4d-29f1-4ebf-ad3b-29945152109e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee15ce71-9aa7-4bac-a2b1-f8efd935a7e5', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:43:28 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7f4cce7c-6b73-4e84-8d67-41153e7cd6b8 tempest-ServersNegativeTestJSON-1077345452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (570f6cd5-ff76-4b35-b124-e80070bf4ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:43:28 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-7f4cce7c-6b73-4e84-8d67-41153e7cd6b8 tempest-ServersNegativeTestJSON-1077345452 None] Volume volume-ee15ce71-9aa7-4bac-a2b1-f8efd935a7e5 (ee15ce71-9aa7-4bac-a2b1-f8efd935a7e5): created successfully
Nov 06 11:43:28 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7f4cce7c-6b73-4e84-8d67-41153e7cd6b8 tempest-ServersNegativeTestJSON-1077345452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (570f6cd5-ff76-4b35-b124-e80070bf4ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:43:28 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7f4cce7c-6b73-4e84-8d67-41153e7cd6b8 tempest-ServersNegativeTestJSON-1077345452 None] Flow 'volume_create_manager' (0250d990-a344-4e44-93bc-1a62f26b6e32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:43:28 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-7f4cce7c-6b73-4e84-8d67-41153e7cd6b8 tempest-ServersNegativeTestJSON-1077345452 None] Created volume successfully.
Nov 06 11:43:31 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-073f5da7-d40e-4fa0-8f49-0423c9ca1fa4 tempest-ServersNegativeTestJSON-1077345452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:43:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-073f5da7-d40e-4fa0-8f49-0423c9ca1fa4 tempest-ServersNegativeTestJSON-1077345452 None] Flow 'volume_create_manager' (99bcd2a6-c3a6-448f-87d0-e0ff287a7bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:43:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-073f5da7-d40e-4fa0-8f49-0423c9ca1fa4 tempest-ServersNegativeTestJSON-1077345452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80633fd5-589e-455d-81b1-f48c346e113d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:43:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-073f5da7-d40e-4fa0-8f49-0423c9ca1fa4 tempest-ServersNegativeTestJSON-1077345452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80633fd5-589e-455d-81b1-f48c346e113d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1580079678',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d313b2fe-430e-49d6-b077-0a6d2834b120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='655da6eac4594d66aeb01a5cf4f18de5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:43:31Z,use_quota=True,user_id='014df8c834da47e884381c2dc904be0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:43:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-073f5da7-d40e-4fa0-8f49-0423c9ca1fa4 tempest-ServersNegativeTestJSON-1077345452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd3fd508-4a9e-4071-bc9e-c23faec361d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:43:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-073f5da7-d40e-4fa0-8f49-0423c9ca1fa4 tempest-ServersNegativeTestJSON-1077345452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd3fd508-4a9e-4071-bc9e-c23faec361d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:43:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-073f5da7-d40e-4fa0-8f49-0423c9ca1fa4 tempest-ServersNegativeTestJSON-1077345452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f6ea8b5-a19d-4e9b-91e0-3c3ee13aa128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:43:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-073f5da7-d40e-4fa0-8f49-0423c9ca1fa4 tempest-ServersNegativeTestJSON-1077345452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f6ea8b5-a19d-4e9b-91e0-3c3ee13aa128) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd313b2fe-430e-49d6-b077-0a6d2834b120', 'volume_name': 'volume-d313b2fe-430e-49d6-b077-0a6d2834b120', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:43:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-073f5da7-d40e-4fa0-8f49-0423c9ca1fa4 tempest-ServersNegativeTestJSON-1077345452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fc2afef-1c93-4182-8353-25abe4bdbca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:43:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-073f5da7-d40e-4fa0-8f49-0423c9ca1fa4 tempest-ServersNegativeTestJSON-1077345452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fc2afef-1c93-4182-8353-25abe4bdbca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:43:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-073f5da7-d40e-4fa0-8f49-0423c9ca1fa4 tempest-ServersNegativeTestJSON-1077345452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (991f8786-cce2-4f01-80a5-4dda25f639fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:43:31 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-073f5da7-d40e-4fa0-8f49-0423c9ca1fa4 tempest-ServersNegativeTestJSON-1077345452 None] Volume d313b2fe-430e-49d6-b077-0a6d2834b120: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d313b2fe-430e-49d6-b077-0a6d2834b120', 'volume_size': 1}
Nov 06 11:43:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-073f5da7-d40e-4fa0-8f49-0423c9ca1fa4 tempest-ServersNegativeTestJSON-1077345452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:43:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-073f5da7-d40e-4fa0-8f49-0423c9ca1fa4 tempest-ServersNegativeTestJSON-1077345452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:43:31 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-073f5da7-d40e-4fa0-8f49-0423c9ca1fa4 tempest-ServersNegativeTestJSON-1077345452 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1580079678',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d313b2fe-430e-49d6-b077-0a6d2834b120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='655da6eac4594d66aeb01a5cf4f18de5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:43:31Z,use_quota=True,user_id='014df8c834da47e884381c2dc904be0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:43:31 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-073f5da7-d40e-4fa0-8f49-0423c9ca1fa4 tempest-ServersNegativeTestJSON-1077345452 None] Creating volume d313b2fe-430e-49d6-b077-0a6d2834b120 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:43:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-073f5da7-d40e-4fa0-8f49-0423c9ca1fa4 tempest-ServersNegativeTestJSON-1077345452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:43:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-073f5da7-d40e-4fa0-8f49-0423c9ca1fa4 tempest-ServersNegativeTestJSON-1077345452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:43:31 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-073f5da7-d40e-4fa0-8f49-0423c9ca1fa4 tempest-ServersNegativeTestJSON-1077345452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:43:31 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-073f5da7-d40e-4fa0-8f49-0423c9ca1fa4 tempest-ServersNegativeTestJSON-1077345452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:43:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-073f5da7-d40e-4fa0-8f49-0423c9ca1fa4 tempest-ServersNegativeTestJSON-1077345452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:43:31 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-073f5da7-d40e-4fa0-8f49-0423c9ca1fa4 tempest-ServersNegativeTestJSON-1077345452 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:43:31 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-073f5da7-d40e-4fa0-8f49-0423c9ca1fa4 tempest-ServersNegativeTestJSON-1077345452 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:43:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-073f5da7-d40e-4fa0-8f49-0423c9ca1fa4 tempest-ServersNegativeTestJSON-1077345452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d313b2fe-430e-49d6-b077-0a6d2834b120 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:43:31 devstack sudo[88588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d313b2fe-430e-49d6-b077-0a6d2834b120 1073741824
Nov 06 11:43:31 devstack sudo[88588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:43:31 devstack sudo[88588]: pam_unix(sudo:session): session closed for user root
Nov 06 11:43:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-073f5da7-d40e-4fa0-8f49-0423c9ca1fa4 tempest-ServersNegativeTestJSON-1077345452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d313b2fe-430e-49d6-b077-0a6d2834b120 1073741824" returned: 0 in 0.532s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:43:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-073f5da7-d40e-4fa0-8f49-0423c9ca1fa4 tempest-ServersNegativeTestJSON-1077345452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d313b2fe-430e-49d6-b077-0a6d2834b120 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:43:31 devstack sudo[88594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d313b2fe-430e-49d6-b077-0a6d2834b120
Nov 06 11:43:31 devstack sudo[88594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:43:32 devstack sudo[88594]: pam_unix(sudo:session): session closed for user root
Nov 06 11:43:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-073f5da7-d40e-4fa0-8f49-0423c9ca1fa4 tempest-ServersNegativeTestJSON-1077345452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d313b2fe-430e-49d6-b077-0a6d2834b120" returned: 0 in 0.319s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:43:32 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-073f5da7-d40e-4fa0-8f49-0423c9ca1fa4 tempest-ServersNegativeTestJSON-1077345452 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:43:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-073f5da7-d40e-4fa0-8f49-0423c9ca1fa4 tempest-ServersNegativeTestJSON-1077345452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:43:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-073f5da7-d40e-4fa0-8f49-0423c9ca1fa4 tempest-ServersNegativeTestJSON-1077345452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (991f8786-cce2-4f01-80a5-4dda25f639fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d313b2fe-430e-49d6-b077-0a6d2834b120', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:43:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-073f5da7-d40e-4fa0-8f49-0423c9ca1fa4 tempest-ServersNegativeTestJSON-1077345452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d22fb41d-4559-4926-95e2-842394486788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:43:32 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-073f5da7-d40e-4fa0-8f49-0423c9ca1fa4 tempest-ServersNegativeTestJSON-1077345452 None] Volume volume-d313b2fe-430e-49d6-b077-0a6d2834b120 (d313b2fe-430e-49d6-b077-0a6d2834b120): created successfully
Nov 06 11:43:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-073f5da7-d40e-4fa0-8f49-0423c9ca1fa4 tempest-ServersNegativeTestJSON-1077345452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d22fb41d-4559-4926-95e2-842394486788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:43:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-073f5da7-d40e-4fa0-8f49-0423c9ca1fa4 tempest-ServersNegativeTestJSON-1077345452 None] Flow 'volume_create_manager' (99bcd2a6-c3a6-448f-87d0-e0ff287a7bbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:43:32 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-073f5da7-d40e-4fa0-8f49-0423c9ca1fa4 tempest-ServersNegativeTestJSON-1077345452 None] Created volume successfully.
Nov 06 11:43:34 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-cd9fa9a6-984c-4e27-a2bc-be314fad0452 tempest-ServersNegativeTestJSON-1077345452 None] Acquiring lock "cinder-d313b2fe-430e-49d6-b077-0a6d2834b120-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:43:34 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-cd9fa9a6-984c-4e27-a2bc-be314fad0452 tempest-ServersNegativeTestJSON-1077345452 None] Lock "cinder-d313b2fe-430e-49d6-b077-0a6d2834b120-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:43:34 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-cd9fa9a6-984c-4e27-a2bc-be314fad0452 tempest-ServersNegativeTestJSON-1077345452 None] Acquiring lock "cinder-quobyte-d313b2fe-430e-49d6-b077-0a6d2834b120" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:43:35 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-cd9fa9a6-984c-4e27-a2bc-be314fad0452 tempest-ServersNegativeTestJSON-1077345452 None] Lock "cinder-quobyte-d313b2fe-430e-49d6-b077-0a6d2834b120" acquired by "delete_volume" :: waited 0.049s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:43:35 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c39e084-abda-40e5-8162-997f798163fe]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:43:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cd9fa9a6-984c-4e27-a2bc-be314fad0452 tempest-ServersNegativeTestJSON-1077345452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d313b2fe-430e-49d6-b077-0a6d2834b120 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:43:35 devstack sudo[88599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d313b2fe-430e-49d6-b077-0a6d2834b120
Nov 06 11:43:35 devstack sudo[88599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:43:35 devstack sudo[88599]: pam_unix(sudo:session): session closed for user root
Nov 06 11:43:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cd9fa9a6-984c-4e27-a2bc-be314fad0452 tempest-ServersNegativeTestJSON-1077345452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d313b2fe-430e-49d6-b077-0a6d2834b120" returned: 0 in 0.466s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:43:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cd9fa9a6-984c-4e27-a2bc-be314fad0452 tempest-ServersNegativeTestJSON-1077345452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d313b2fe-430e-49d6-b077-0a6d2834b120 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:43:35 devstack sudo[88605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d313b2fe-430e-49d6-b077-0a6d2834b120
Nov 06 11:43:35 devstack sudo[88605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:43:35 devstack sudo[88605]: pam_unix(sudo:session): session closed for user root
Nov 06 11:43:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cd9fa9a6-984c-4e27-a2bc-be314fad0452 tempest-ServersNegativeTestJSON-1077345452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d313b2fe-430e-49d6-b077-0a6d2834b120" returned: 0 in 0.301s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:43:35 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-cd9fa9a6-984c-4e27-a2bc-be314fad0452 tempest-ServersNegativeTestJSON-1077345452 None] Lock "cinder-quobyte-d313b2fe-430e-49d6-b077-0a6d2834b120" released by "delete_volume" :: held 0.827s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:43:35 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-cd9fa9a6-984c-4e27-a2bc-be314fad0452 tempest-ServersNegativeTestJSON-1077345452 None] Created reservations ['b428e984-b637-4525-a4c2-a473ff11b47b', '1e2aabc5-abf7-4c5a-84eb-6cdb1d075afa', 'e44a50c3-09c8-484f-b22a-86789c8f9ec6', '53ad82dd-beac-41bf-89b3-19beafad4898'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:43:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-cd9fa9a6-984c-4e27-a2bc-be314fad0452 tempest-ServersNegativeTestJSON-1077345452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:43:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-cd9fa9a6-984c-4e27-a2bc-be314fad0452 tempest-ServersNegativeTestJSON-1077345452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:43:35 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-cd9fa9a6-984c-4e27-a2bc-be314fad0452 tempest-ServersNegativeTestJSON-1077345452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:43:35 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-cd9fa9a6-984c-4e27-a2bc-be314fad0452 tempest-ServersNegativeTestJSON-1077345452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:43:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-cd9fa9a6-984c-4e27-a2bc-be314fad0452 tempest-ServersNegativeTestJSON-1077345452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:43:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cd9fa9a6-984c-4e27-a2bc-be314fad0452 tempest-ServersNegativeTestJSON-1077345452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:43:36 devstack sudo[88609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:43:36 devstack sudo[88609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:43:36 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c9df31dd-f900-4998-9b74-bbcdcbbe1bbf tempest-ServersNegativeTestJSON-1077345452 None] Acquiring lock "cinder-ee15ce71-9aa7-4bac-a2b1-f8efd935a7e5-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:43:36 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c9df31dd-f900-4998-9b74-bbcdcbbe1bbf tempest-ServersNegativeTestJSON-1077345452 None] Lock "cinder-ee15ce71-9aa7-4bac-a2b1-f8efd935a7e5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:43:36 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c9df31dd-f900-4998-9b74-bbcdcbbe1bbf tempest-ServersNegativeTestJSON-1077345452 None] Acquiring lock "cinder-quobyte-ee15ce71-9aa7-4bac-a2b1-f8efd935a7e5" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:43:36 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c9df31dd-f900-4998-9b74-bbcdcbbe1bbf tempest-ServersNegativeTestJSON-1077345452 None] Lock "cinder-quobyte-ee15ce71-9aa7-4bac-a2b1-f8efd935a7e5" acquired by "delete_volume" :: waited 0.021s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:43:36 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[18bff908-7717-417d-b963-8eb5fa335f20]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:43:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c9df31dd-f900-4998-9b74-bbcdcbbe1bbf tempest-ServersNegativeTestJSON-1077345452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ee15ce71-9aa7-4bac-a2b1-f8efd935a7e5 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:43:36 devstack sudo[88612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ee15ce71-9aa7-4bac-a2b1-f8efd935a7e5
Nov 06 11:43:36 devstack sudo[88612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:43:36 devstack sudo[88609]: pam_unix(sudo:session): session closed for user root
Nov 06 11:43:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cd9fa9a6-984c-4e27-a2bc-be314fad0452 tempest-ServersNegativeTestJSON-1077345452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.434s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:43:36 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-cd9fa9a6-984c-4e27-a2bc-be314fad0452 tempest-ServersNegativeTestJSON-1077345452 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:43:36 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-cd9fa9a6-984c-4e27-a2bc-be314fad0452 tempest-ServersNegativeTestJSON-1077345452 None] Deleted volume successfully.
Nov 06 11:43:36 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-cd9fa9a6-984c-4e27-a2bc-be314fad0452 tempest-ServersNegativeTestJSON-1077345452 None] Lock "cinder-d313b2fe-430e-49d6-b077-0a6d2834b120-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:43:36 devstack sudo[88612]: pam_unix(sudo:session): session closed for user root
Nov 06 11:43:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c9df31dd-f900-4998-9b74-bbcdcbbe1bbf tempest-ServersNegativeTestJSON-1077345452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ee15ce71-9aa7-4bac-a2b1-f8efd935a7e5" returned: 0 in 0.435s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:43:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c9df31dd-f900-4998-9b74-bbcdcbbe1bbf tempest-ServersNegativeTestJSON-1077345452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ee15ce71-9aa7-4bac-a2b1-f8efd935a7e5 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:43:36 devstack sudo[88618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ee15ce71-9aa7-4bac-a2b1-f8efd935a7e5
Nov 06 11:43:36 devstack sudo[88618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:43:36 devstack sudo[88618]: pam_unix(sudo:session): session closed for user root
Nov 06 11:43:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c9df31dd-f900-4998-9b74-bbcdcbbe1bbf tempest-ServersNegativeTestJSON-1077345452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ee15ce71-9aa7-4bac-a2b1-f8efd935a7e5" returned: 0 in 0.284s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:43:36 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c9df31dd-f900-4998-9b74-bbcdcbbe1bbf tempest-ServersNegativeTestJSON-1077345452 None] Lock "cinder-quobyte-ee15ce71-9aa7-4bac-a2b1-f8efd935a7e5" released by "delete_volume" :: held 0.767s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:43:37 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-c9df31dd-f900-4998-9b74-bbcdcbbe1bbf tempest-ServersNegativeTestJSON-1077345452 None] Created reservations ['7eab14fd-2d42-4d71-ad5e-cc1fa97994f5', '95e17a56-3494-439f-bad0-e062b4fead06', '5773998a-3e49-47f9-ac61-165440f3c55d', '1a437eac-4602-4a34-8c5a-fea25bed3dc7'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:43:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c9df31dd-f900-4998-9b74-bbcdcbbe1bbf tempest-ServersNegativeTestJSON-1077345452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:43:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c9df31dd-f900-4998-9b74-bbcdcbbe1bbf tempest-ServersNegativeTestJSON-1077345452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:43:37 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-c9df31dd-f900-4998-9b74-bbcdcbbe1bbf tempest-ServersNegativeTestJSON-1077345452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:43:37 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-c9df31dd-f900-4998-9b74-bbcdcbbe1bbf tempest-ServersNegativeTestJSON-1077345452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:43:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c9df31dd-f900-4998-9b74-bbcdcbbe1bbf tempest-ServersNegativeTestJSON-1077345452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:43:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c9df31dd-f900-4998-9b74-bbcdcbbe1bbf tempest-ServersNegativeTestJSON-1077345452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:43:37 devstack sudo[88621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:43:37 devstack sudo[88621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:43:37 devstack sudo[88621]: pam_unix(sudo:session): session closed for user root
Nov 06 11:43:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c9df31dd-f900-4998-9b74-bbcdcbbe1bbf tempest-ServersNegativeTestJSON-1077345452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.368s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:43:37 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-c9df31dd-f900-4998-9b74-bbcdcbbe1bbf tempest-ServersNegativeTestJSON-1077345452 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:43:37 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-c9df31dd-f900-4998-9b74-bbcdcbbe1bbf tempest-ServersNegativeTestJSON-1077345452 None] Deleted volume successfully.
Nov 06 11:43:37 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c9df31dd-f900-4998-9b74-bbcdcbbe1bbf tempest-ServersNegativeTestJSON-1077345452 None] Lock "cinder-ee15ce71-9aa7-4bac-a2b1-f8efd935a7e5-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:43:56 devstack cinder-volume[87165]: WARNING py.warnings [req-43ea32a8-c0b5-482d-addc-18998c33c7a2 req-a65527fb-3d7d-4eb5-be02-abd7d689be64 tempest-TaggedAttachmentsTest-1691297006 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment".  Apply join condition(s) between each element to resolve.
Nov 06 11:43:56 devstack cinder-volume[87165]:   .first()
Nov 06 11:43:56 devstack cinder-volume[87165]: 
Nov 06 11:43:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-43ea32a8-c0b5-482d-addc-18998c33c7a2 req-a65527fb-3d7d-4eb5-be02-abd7d689be64 tempest-TaggedAttachmentsTest-1691297006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:43:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-43ea32a8-c0b5-482d-addc-18998c33c7a2 req-a65527fb-3d7d-4eb5-be02-abd7d689be64 tempest-TaggedAttachmentsTest-1691297006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:43:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-43ea32a8-c0b5-482d-addc-18998c33c7a2 req-a65527fb-3d7d-4eb5-be02-abd7d689be64 tempest-TaggedAttachmentsTest-1691297006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:43:56 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-43ea32a8-c0b5-482d-addc-18998c33c7a2 req-a65527fb-3d7d-4eb5-be02-abd7d689be64 tempest-TaggedAttachmentsTest-1691297006 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50', 'name': 'volume-10fef99a-9c48-4364-ad00-8a1e9df9f7ca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a218a02b-a12f-49f4-b4db-9a97ef3772b9', 'enforce_multipath': True} {{(pid=87165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 11:43:56 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-43ea32a8-c0b5-482d-addc-18998c33c7a2 req-a65527fb-3d7d-4eb5-be02-abd7d689be64 tempest-TaggedAttachmentsTest-1691297006 None] attachment_update completed successfully.
Nov 06 11:44:04 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-fb5d25b1-2b22-43ef-b5a7-f8cba289e99d req-00711ef8-72d8-426d-822f-93c7a461e8de tempest-TaggedAttachmentsTest-1691297006 None] Terminate volume connection completed successfully.
Nov 06 11:44:04 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-fb5d25b1-2b22-43ef-b5a7-f8cba289e99d req-00711ef8-72d8-426d-822f-93c7a461e8de tempest-TaggedAttachmentsTest-1691297006 None] Deleting attachment a218a02b-a12f-49f4-b4db-9a97ef3772b9. {{(pid=87165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 11:44:14 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:UPDATE=38,cinder:SELECT=24,cinder:INSERT=7,cinder:DELETE=3 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 11:44:14 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:SELECT=34,cinder:UPDATE=32,cinder:DELETE=3,cinder:INSERT=8 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 11:44:17 devstack cinder-volume[87165]: DEBUG oslo_service.periodic_task [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 11:44:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:44:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:44:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:44:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:44:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:44:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:44:17 devstack sudo[89472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:44:17 devstack sudo[89472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:44:17 devstack sudo[89472]: pam_unix(sudo:session): session closed for user root
Nov 06 11:44:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.553s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:44:17 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:44:21 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c89cee5-b78f-4ec2-948e-b62382d26513 tempest-DeleteServersTestJSON-933491727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:44:21 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4c89cee5-b78f-4ec2-948e-b62382d26513 tempest-DeleteServersTestJSON-933491727 None] Flow 'volume_create_manager' (89237cfe-cc52-4614-98ec-3e95db8723a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:44:21 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4c89cee5-b78f-4ec2-948e-b62382d26513 tempest-DeleteServersTestJSON-933491727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a37d8b3-51db-4c4c-93db-568eadd3c505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:44:21 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4c89cee5-b78f-4ec2-948e-b62382d26513 tempest-DeleteServersTestJSON-933491727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a37d8b3-51db-4c4c-93db-568eadd3c505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1359874915',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=236b2689-8a19-4917-b631-adbbb3dacaf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4081f1c4714243b38ed45abd35b77c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:44:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:44:21Z,use_quota=True,user_id='af61f4c21d374b1f863ef0fa86444755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:44:21 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4c89cee5-b78f-4ec2-948e-b62382d26513 tempest-DeleteServersTestJSON-933491727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b13d694e-072a-4585-bf9f-77ccd423a7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:44:21 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4c89cee5-b78f-4ec2-948e-b62382d26513 tempest-DeleteServersTestJSON-933491727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b13d694e-072a-4585-bf9f-77ccd423a7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:44:21 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4c89cee5-b78f-4ec2-948e-b62382d26513 tempest-DeleteServersTestJSON-933491727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14aa3d59-c7bf-4eae-8f11-8bdda1b16df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:44:21 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4c89cee5-b78f-4ec2-948e-b62382d26513 tempest-DeleteServersTestJSON-933491727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14aa3d59-c7bf-4eae-8f11-8bdda1b16df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '236b2689-8a19-4917-b631-adbbb3dacaf2', 'volume_name': 'volume-236b2689-8a19-4917-b631-adbbb3dacaf2', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:44:21 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4c89cee5-b78f-4ec2-948e-b62382d26513 tempest-DeleteServersTestJSON-933491727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (362bb824-e869-495f-b39e-56ac8f25c54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:44:21 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4c89cee5-b78f-4ec2-948e-b62382d26513 tempest-DeleteServersTestJSON-933491727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (362bb824-e869-495f-b39e-56ac8f25c54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:44:21 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4c89cee5-b78f-4ec2-948e-b62382d26513 tempest-DeleteServersTestJSON-933491727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf582eba-7e88-477c-a3b9-656f6d73f5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:44:21 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-4c89cee5-b78f-4ec2-948e-b62382d26513 tempest-DeleteServersTestJSON-933491727 None] Volume 236b2689-8a19-4917-b631-adbbb3dacaf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-236b2689-8a19-4917-b631-adbbb3dacaf2', 'volume_size': 1}
Nov 06 11:44:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4c89cee5-b78f-4ec2-948e-b62382d26513 tempest-DeleteServersTestJSON-933491727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:44:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4c89cee5-b78f-4ec2-948e-b62382d26513 tempest-DeleteServersTestJSON-933491727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:44:21 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-4c89cee5-b78f-4ec2-948e-b62382d26513 tempest-DeleteServersTestJSON-933491727 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1359874915',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=236b2689-8a19-4917-b631-adbbb3dacaf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4081f1c4714243b38ed45abd35b77c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:44:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:44:21Z,use_quota=True,user_id='af61f4c21d374b1f863ef0fa86444755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:44:21 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-4c89cee5-b78f-4ec2-948e-b62382d26513 tempest-DeleteServersTestJSON-933491727 None] Creating volume 236b2689-8a19-4917-b631-adbbb3dacaf2 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:44:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4c89cee5-b78f-4ec2-948e-b62382d26513 tempest-DeleteServersTestJSON-933491727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:44:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4c89cee5-b78f-4ec2-948e-b62382d26513 tempest-DeleteServersTestJSON-933491727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:44:21 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-4c89cee5-b78f-4ec2-948e-b62382d26513 tempest-DeleteServersTestJSON-933491727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:44:21 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-4c89cee5-b78f-4ec2-948e-b62382d26513 tempest-DeleteServersTestJSON-933491727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:44:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4c89cee5-b78f-4ec2-948e-b62382d26513 tempest-DeleteServersTestJSON-933491727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:44:21 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-4c89cee5-b78f-4ec2-948e-b62382d26513 tempest-DeleteServersTestJSON-933491727 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:44:21 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-4c89cee5-b78f-4ec2-948e-b62382d26513 tempest-DeleteServersTestJSON-933491727 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:44:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4c89cee5-b78f-4ec2-948e-b62382d26513 tempest-DeleteServersTestJSON-933491727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-236b2689-8a19-4917-b631-adbbb3dacaf2 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:44:21 devstack sudo[89539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-236b2689-8a19-4917-b631-adbbb3dacaf2 1073741824
Nov 06 11:44:21 devstack sudo[89539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:44:22 devstack sudo[89539]: pam_unix(sudo:session): session closed for user root
Nov 06 11:44:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4c89cee5-b78f-4ec2-948e-b62382d26513 tempest-DeleteServersTestJSON-933491727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-236b2689-8a19-4917-b631-adbbb3dacaf2 1073741824" returned: 0 in 0.890s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:44:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4c89cee5-b78f-4ec2-948e-b62382d26513 tempest-DeleteServersTestJSON-933491727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-236b2689-8a19-4917-b631-adbbb3dacaf2 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:44:22 devstack sudo[89555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-236b2689-8a19-4917-b631-adbbb3dacaf2
Nov 06 11:44:22 devstack sudo[89555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:44:22 devstack sudo[89555]: pam_unix(sudo:session): session closed for user root
Nov 06 11:44:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4c89cee5-b78f-4ec2-948e-b62382d26513 tempest-DeleteServersTestJSON-933491727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-236b2689-8a19-4917-b631-adbbb3dacaf2" returned: 0 in 0.413s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:44:22 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-4c89cee5-b78f-4ec2-948e-b62382d26513 tempest-DeleteServersTestJSON-933491727 None] <== create_volume: return (1413ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:44:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4c89cee5-b78f-4ec2-948e-b62382d26513 tempest-DeleteServersTestJSON-933491727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.416s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:44:22 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4c89cee5-b78f-4ec2-948e-b62382d26513 tempest-DeleteServersTestJSON-933491727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf582eba-7e88-477c-a3b9-656f6d73f5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-236b2689-8a19-4917-b631-adbbb3dacaf2', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:44:22 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4c89cee5-b78f-4ec2-948e-b62382d26513 tempest-DeleteServersTestJSON-933491727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d64e8fb2-ada2-4c63-a5c0-111227b3a323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:44:22 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-4c89cee5-b78f-4ec2-948e-b62382d26513 tempest-DeleteServersTestJSON-933491727 None] Volume volume-236b2689-8a19-4917-b631-adbbb3dacaf2 (236b2689-8a19-4917-b631-adbbb3dacaf2): created successfully
Nov 06 11:44:22 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4c89cee5-b78f-4ec2-948e-b62382d26513 tempest-DeleteServersTestJSON-933491727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d64e8fb2-ada2-4c63-a5c0-111227b3a323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:44:22 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4c89cee5-b78f-4ec2-948e-b62382d26513 tempest-DeleteServersTestJSON-933491727 None] Flow 'volume_create_manager' (89237cfe-cc52-4614-98ec-3e95db8723a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:44:22 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-4c89cee5-b78f-4ec2-948e-b62382d26513 tempest-DeleteServersTestJSON-933491727 None] Created volume successfully.
Nov 06 11:44:23 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b3165224-1900-4c0a-96f6-cca9f4c2aa94 tempest-TaggedAttachmentsTest-1691297006 None] Acquiring lock "cinder-10fef99a-9c48-4364-ad00-8a1e9df9f7ca-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:44:23 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b3165224-1900-4c0a-96f6-cca9f4c2aa94 tempest-TaggedAttachmentsTest-1691297006 None] Lock "cinder-10fef99a-9c48-4364-ad00-8a1e9df9f7ca-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:44:23 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b3165224-1900-4c0a-96f6-cca9f4c2aa94 tempest-TaggedAttachmentsTest-1691297006 None] Acquiring lock "cinder-quobyte-10fef99a-9c48-4364-ad00-8a1e9df9f7ca" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:44:23 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b3165224-1900-4c0a-96f6-cca9f4c2aa94 tempest-TaggedAttachmentsTest-1691297006 None] Lock "cinder-quobyte-10fef99a-9c48-4364-ad00-8a1e9df9f7ca" acquired by "delete_volume" :: waited 0.042s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:44:23 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1a8326-bb50-43c0-b773-9f28baebe312]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:44:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b3165224-1900-4c0a-96f6-cca9f4c2aa94 tempest-TaggedAttachmentsTest-1691297006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-10fef99a-9c48-4364-ad00-8a1e9df9f7ca {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:44:23 devstack sudo[89564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-10fef99a-9c48-4364-ad00-8a1e9df9f7ca
Nov 06 11:44:23 devstack sudo[89564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:44:23 devstack sudo[89564]: pam_unix(sudo:session): session closed for user root
Nov 06 11:44:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b3165224-1900-4c0a-96f6-cca9f4c2aa94 tempest-TaggedAttachmentsTest-1691297006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-10fef99a-9c48-4364-ad00-8a1e9df9f7ca" returned: 0 in 0.411s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:44:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b3165224-1900-4c0a-96f6-cca9f4c2aa94 tempest-TaggedAttachmentsTest-1691297006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-10fef99a-9c48-4364-ad00-8a1e9df9f7ca {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:44:23 devstack sudo[89569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-10fef99a-9c48-4364-ad00-8a1e9df9f7ca
Nov 06 11:44:23 devstack sudo[89569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:44:24 devstack sudo[89569]: pam_unix(sudo:session): session closed for user root
Nov 06 11:44:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b3165224-1900-4c0a-96f6-cca9f4c2aa94 tempest-TaggedAttachmentsTest-1691297006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-10fef99a-9c48-4364-ad00-8a1e9df9f7ca" returned: 0 in 0.347s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:44:24 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b3165224-1900-4c0a-96f6-cca9f4c2aa94 tempest-TaggedAttachmentsTest-1691297006 None] Lock "cinder-quobyte-10fef99a-9c48-4364-ad00-8a1e9df9f7ca" released by "delete_volume" :: held 0.823s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:44:24 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-b3165224-1900-4c0a-96f6-cca9f4c2aa94 tempest-TaggedAttachmentsTest-1691297006 None] Created reservations ['6d6935ac-fb14-45c6-a481-b4e427d9a2c5', '681086ad-0766-4de8-a47f-77fabe3bb12b', 'ffa6bc91-9004-45d0-a802-ad769fb3ea77', '5083b739-fa0b-459d-9570-ec19715ba0fb'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:44:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b3165224-1900-4c0a-96f6-cca9f4c2aa94 tempest-TaggedAttachmentsTest-1691297006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:44:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b3165224-1900-4c0a-96f6-cca9f4c2aa94 tempest-TaggedAttachmentsTest-1691297006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:44:24 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b3165224-1900-4c0a-96f6-cca9f4c2aa94 tempest-TaggedAttachmentsTest-1691297006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:44:24 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b3165224-1900-4c0a-96f6-cca9f4c2aa94 tempest-TaggedAttachmentsTest-1691297006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:44:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b3165224-1900-4c0a-96f6-cca9f4c2aa94 tempest-TaggedAttachmentsTest-1691297006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:44:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b3165224-1900-4c0a-96f6-cca9f4c2aa94 tempest-TaggedAttachmentsTest-1691297006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:44:24 devstack sudo[89579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:44:24 devstack sudo[89579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:44:24 devstack sudo[89579]: pam_unix(sudo:session): session closed for user root
Nov 06 11:44:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b3165224-1900-4c0a-96f6-cca9f4c2aa94 tempest-TaggedAttachmentsTest-1691297006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.498s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:44:24 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-b3165224-1900-4c0a-96f6-cca9f4c2aa94 tempest-TaggedAttachmentsTest-1691297006 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:44:24 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-b3165224-1900-4c0a-96f6-cca9f4c2aa94 tempest-TaggedAttachmentsTest-1691297006 None] Deleted volume successfully.
Nov 06 11:44:24 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b3165224-1900-4c0a-96f6-cca9f4c2aa94 tempest-TaggedAttachmentsTest-1691297006 None] Lock "cinder-10fef99a-9c48-4364-ad00-8a1e9df9f7ca-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:44:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-88092498-71ac-44ef-8d8b-5e700ea597e1 req-414584de-3c13-4c02-b1b9-854d29f44e2a tempest-DeleteServersTestJSON-933491727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:44:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-88092498-71ac-44ef-8d8b-5e700ea597e1 req-414584de-3c13-4c02-b1b9-854d29f44e2a tempest-DeleteServersTestJSON-933491727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:44:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-88092498-71ac-44ef-8d8b-5e700ea597e1 req-414584de-3c13-4c02-b1b9-854d29f44e2a tempest-DeleteServersTestJSON-933491727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.072s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:44:26 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-88092498-71ac-44ef-8d8b-5e700ea597e1 req-414584de-3c13-4c02-b1b9-854d29f44e2a tempest-DeleteServersTestJSON-933491727 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50', 'name': 'volume-236b2689-8a19-4917-b631-adbbb3dacaf2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '25f9d377-09f0-4986-9a05-95b2bda083a7', 'enforce_multipath': True} {{(pid=87165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 11:44:26 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-88092498-71ac-44ef-8d8b-5e700ea597e1 req-414584de-3c13-4c02-b1b9-854d29f44e2a tempest-DeleteServersTestJSON-933491727 None] attachment_update completed successfully.
Nov 06 11:44:31 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-147f3b69-e1aa-4098-8fb5-4fc2876fb494 tempest-AttachVolumeShelveTestJSON-77602652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:44:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-147f3b69-e1aa-4098-8fb5-4fc2876fb494 tempest-AttachVolumeShelveTestJSON-77602652 None] Flow 'volume_create_manager' (314bfa04-65cc-4e90-9cdc-9557233e5cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:44:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-147f3b69-e1aa-4098-8fb5-4fc2876fb494 tempest-AttachVolumeShelveTestJSON-77602652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50ed82e3-6e1c-40b7-bdbd-856551c0644c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:44:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-147f3b69-e1aa-4098-8fb5-4fc2876fb494 tempest-AttachVolumeShelveTestJSON-77602652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50ed82e3-6e1c-40b7-bdbd-856551c0644c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:44:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1372969273',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0ee0ed2-3787-40ea-b46d-1716da9a3f15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48ff006c68c5419ea5380467cc5035af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:44:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:44:32Z,use_quota=True,user_id='6b73c27023904200895de20d3a913612',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:44:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-147f3b69-e1aa-4098-8fb5-4fc2876fb494 tempest-AttachVolumeShelveTestJSON-77602652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b6f483b-ce98-4aaf-8871-4adf4c18dfb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:44:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-147f3b69-e1aa-4098-8fb5-4fc2876fb494 tempest-AttachVolumeShelveTestJSON-77602652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b6f483b-ce98-4aaf-8871-4adf4c18dfb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:44:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-147f3b69-e1aa-4098-8fb5-4fc2876fb494 tempest-AttachVolumeShelveTestJSON-77602652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0ccd67d-6d4d-40ca-8f38-b8147f06e101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:44:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-147f3b69-e1aa-4098-8fb5-4fc2876fb494 tempest-AttachVolumeShelveTestJSON-77602652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0ccd67d-6d4d-40ca-8f38-b8147f06e101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0ee0ed2-3787-40ea-b46d-1716da9a3f15', 'volume_name': 'volume-b0ee0ed2-3787-40ea-b46d-1716da9a3f15', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:44:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-147f3b69-e1aa-4098-8fb5-4fc2876fb494 tempest-AttachVolumeShelveTestJSON-77602652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec99779a-dfd8-4e58-9a0f-d6c8f8a51961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:44:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-147f3b69-e1aa-4098-8fb5-4fc2876fb494 tempest-AttachVolumeShelveTestJSON-77602652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec99779a-dfd8-4e58-9a0f-d6c8f8a51961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:44:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-147f3b69-e1aa-4098-8fb5-4fc2876fb494 tempest-AttachVolumeShelveTestJSON-77602652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (359a4b59-051d-48a5-b92b-fb97da88b90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:44:32 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-147f3b69-e1aa-4098-8fb5-4fc2876fb494 tempest-AttachVolumeShelveTestJSON-77602652 None] Volume b0ee0ed2-3787-40ea-b46d-1716da9a3f15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0ee0ed2-3787-40ea-b46d-1716da9a3f15', 'volume_size': 1}
Nov 06 11:44:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-147f3b69-e1aa-4098-8fb5-4fc2876fb494 tempest-AttachVolumeShelveTestJSON-77602652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:44:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-147f3b69-e1aa-4098-8fb5-4fc2876fb494 tempest-AttachVolumeShelveTestJSON-77602652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:44:32 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-147f3b69-e1aa-4098-8fb5-4fc2876fb494 tempest-AttachVolumeShelveTestJSON-77602652 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:44:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1372969273',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0ee0ed2-3787-40ea-b46d-1716da9a3f15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48ff006c68c5419ea5380467cc5035af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:44:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:44:32Z,use_quota=True,user_id='6b73c27023904200895de20d3a913612',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:44:32 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-147f3b69-e1aa-4098-8fb5-4fc2876fb494 tempest-AttachVolumeShelveTestJSON-77602652 None] Creating volume b0ee0ed2-3787-40ea-b46d-1716da9a3f15 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:44:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-147f3b69-e1aa-4098-8fb5-4fc2876fb494 tempest-AttachVolumeShelveTestJSON-77602652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:44:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-147f3b69-e1aa-4098-8fb5-4fc2876fb494 tempest-AttachVolumeShelveTestJSON-77602652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:44:32 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-147f3b69-e1aa-4098-8fb5-4fc2876fb494 tempest-AttachVolumeShelveTestJSON-77602652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:44:32 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-147f3b69-e1aa-4098-8fb5-4fc2876fb494 tempest-AttachVolumeShelveTestJSON-77602652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:44:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-147f3b69-e1aa-4098-8fb5-4fc2876fb494 tempest-AttachVolumeShelveTestJSON-77602652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:44:32 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-147f3b69-e1aa-4098-8fb5-4fc2876fb494 tempest-AttachVolumeShelveTestJSON-77602652 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:44:32 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-147f3b69-e1aa-4098-8fb5-4fc2876fb494 tempest-AttachVolumeShelveTestJSON-77602652 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:44:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-147f3b69-e1aa-4098-8fb5-4fc2876fb494 tempest-AttachVolumeShelveTestJSON-77602652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b0ee0ed2-3787-40ea-b46d-1716da9a3f15 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:44:32 devstack sudo[90135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b0ee0ed2-3787-40ea-b46d-1716da9a3f15 1073741824
Nov 06 11:44:32 devstack sudo[90135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:44:32 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-ceb72f1f-54a3-41bc-b896-acac5af07e88 req-ba6673d8-e6f3-4a7b-86e6-cad331fc67ab tempest-DeleteServersTestJSON-933491727 None] Terminate volume connection completed successfully.
Nov 06 11:44:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-ceb72f1f-54a3-41bc-b896-acac5af07e88 req-ba6673d8-e6f3-4a7b-86e6-cad331fc67ab tempest-DeleteServersTestJSON-933491727 None] Deleting attachment 25f9d377-09f0-4986-9a05-95b2bda083a7. {{(pid=87165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 11:44:32 devstack sudo[90135]: pam_unix(sudo:session): session closed for user root
Nov 06 11:44:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-147f3b69-e1aa-4098-8fb5-4fc2876fb494 tempest-AttachVolumeShelveTestJSON-77602652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b0ee0ed2-3787-40ea-b46d-1716da9a3f15 1073741824" returned: 0 in 0.682s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:44:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-147f3b69-e1aa-4098-8fb5-4fc2876fb494 tempest-AttachVolumeShelveTestJSON-77602652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b0ee0ed2-3787-40ea-b46d-1716da9a3f15 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:44:32 devstack sudo[90145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b0ee0ed2-3787-40ea-b46d-1716da9a3f15
Nov 06 11:44:32 devstack sudo[90145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:44:33 devstack sudo[90145]: pam_unix(sudo:session): session closed for user root
Nov 06 11:44:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-147f3b69-e1aa-4098-8fb5-4fc2876fb494 tempest-AttachVolumeShelveTestJSON-77602652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b0ee0ed2-3787-40ea-b46d-1716da9a3f15" returned: 0 in 0.446s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:44:33 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-147f3b69-e1aa-4098-8fb5-4fc2876fb494 tempest-AttachVolumeShelveTestJSON-77602652 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:44:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-147f3b69-e1aa-4098-8fb5-4fc2876fb494 tempest-AttachVolumeShelveTestJSON-77602652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:44:33 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-147f3b69-e1aa-4098-8fb5-4fc2876fb494 tempest-AttachVolumeShelveTestJSON-77602652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (359a4b59-051d-48a5-b92b-fb97da88b90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0ee0ed2-3787-40ea-b46d-1716da9a3f15', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:44:33 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-147f3b69-e1aa-4098-8fb5-4fc2876fb494 tempest-AttachVolumeShelveTestJSON-77602652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (996427b7-aae5-459b-98c3-21249cee557f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:44:33 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-147f3b69-e1aa-4098-8fb5-4fc2876fb494 tempest-AttachVolumeShelveTestJSON-77602652 None] Volume volume-b0ee0ed2-3787-40ea-b46d-1716da9a3f15 (b0ee0ed2-3787-40ea-b46d-1716da9a3f15): created successfully
Nov 06 11:44:33 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-147f3b69-e1aa-4098-8fb5-4fc2876fb494 tempest-AttachVolumeShelveTestJSON-77602652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (996427b7-aae5-459b-98c3-21249cee557f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:44:33 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-147f3b69-e1aa-4098-8fb5-4fc2876fb494 tempest-AttachVolumeShelveTestJSON-77602652 None] Flow 'volume_create_manager' (314bfa04-65cc-4e90-9cdc-9557233e5cf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:44:33 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-147f3b69-e1aa-4098-8fb5-4fc2876fb494 tempest-AttachVolumeShelveTestJSON-77602652 None] Created volume successfully.
Nov 06 11:44:34 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-941cacf3-51d6-4741-9760-e6e926ea90d4 tempest-DeleteServersTestJSON-933491727 None] Acquiring lock "cinder-236b2689-8a19-4917-b631-adbbb3dacaf2-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:44:34 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-941cacf3-51d6-4741-9760-e6e926ea90d4 tempest-DeleteServersTestJSON-933491727 None] Lock "cinder-236b2689-8a19-4917-b631-adbbb3dacaf2-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:44:34 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-941cacf3-51d6-4741-9760-e6e926ea90d4 tempest-DeleteServersTestJSON-933491727 None] Acquiring lock "cinder-quobyte-236b2689-8a19-4917-b631-adbbb3dacaf2" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:44:34 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-941cacf3-51d6-4741-9760-e6e926ea90d4 tempest-DeleteServersTestJSON-933491727 None] Lock "cinder-quobyte-236b2689-8a19-4917-b631-adbbb3dacaf2" acquired by "delete_volume" :: waited 0.026s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:44:34 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[79eca16a-8287-4a85-bf52-732a6221a8b5]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:44:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-941cacf3-51d6-4741-9760-e6e926ea90d4 tempest-DeleteServersTestJSON-933491727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-236b2689-8a19-4917-b631-adbbb3dacaf2 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:44:34 devstack sudo[90156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-236b2689-8a19-4917-b631-adbbb3dacaf2
Nov 06 11:44:34 devstack sudo[90156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:44:35 devstack sudo[90156]: pam_unix(sudo:session): session closed for user root
Nov 06 11:44:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-941cacf3-51d6-4741-9760-e6e926ea90d4 tempest-DeleteServersTestJSON-933491727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-236b2689-8a19-4917-b631-adbbb3dacaf2" returned: 0 in 0.513s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:44:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-941cacf3-51d6-4741-9760-e6e926ea90d4 tempest-DeleteServersTestJSON-933491727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-236b2689-8a19-4917-b631-adbbb3dacaf2 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:44:35 devstack sudo[90161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-236b2689-8a19-4917-b631-adbbb3dacaf2
Nov 06 11:44:35 devstack sudo[90161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:44:35 devstack sudo[90161]: pam_unix(sudo:session): session closed for user root
Nov 06 11:44:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-941cacf3-51d6-4741-9760-e6e926ea90d4 tempest-DeleteServersTestJSON-933491727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-236b2689-8a19-4917-b631-adbbb3dacaf2" returned: 0 in 0.312s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:44:35 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-941cacf3-51d6-4741-9760-e6e926ea90d4 tempest-DeleteServersTestJSON-933491727 None] Lock "cinder-quobyte-236b2689-8a19-4917-b631-adbbb3dacaf2" released by "delete_volume" :: held 0.882s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:44:35 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-941cacf3-51d6-4741-9760-e6e926ea90d4 tempest-DeleteServersTestJSON-933491727 None] Created reservations ['30c43207-ac27-49b1-a29e-93384e8cef3a', '5d66db42-2214-4baa-a1cb-a5852333232f', '82262d71-8eaa-4d01-84bd-ea349ec48652', '6b6f2dba-3678-4e72-95ed-99ab1a7fe795'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:44:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-941cacf3-51d6-4741-9760-e6e926ea90d4 tempest-DeleteServersTestJSON-933491727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:44:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-941cacf3-51d6-4741-9760-e6e926ea90d4 tempest-DeleteServersTestJSON-933491727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:44:35 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-941cacf3-51d6-4741-9760-e6e926ea90d4 tempest-DeleteServersTestJSON-933491727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:44:35 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-941cacf3-51d6-4741-9760-e6e926ea90d4 tempest-DeleteServersTestJSON-933491727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:44:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-941cacf3-51d6-4741-9760-e6e926ea90d4 tempest-DeleteServersTestJSON-933491727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:44:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-941cacf3-51d6-4741-9760-e6e926ea90d4 tempest-DeleteServersTestJSON-933491727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:44:35 devstack sudo[90164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:44:35 devstack sudo[90164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:44:36 devstack sudo[90164]: pam_unix(sudo:session): session closed for user root
Nov 06 11:44:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-941cacf3-51d6-4741-9760-e6e926ea90d4 tempest-DeleteServersTestJSON-933491727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.448s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:44:36 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-941cacf3-51d6-4741-9760-e6e926ea90d4 tempest-DeleteServersTestJSON-933491727 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:44:36 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-941cacf3-51d6-4741-9760-e6e926ea90d4 tempest-DeleteServersTestJSON-933491727 None] Deleted volume successfully.
Nov 06 11:44:36 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-941cacf3-51d6-4741-9760-e6e926ea90d4 tempest-DeleteServersTestJSON-933491727 None] Lock "cinder-236b2689-8a19-4917-b631-adbbb3dacaf2-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:44:45 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:SELECT=21,cinder:UPDATE=25,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 11:44:46 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:UPDATE=22,cinder:SELECT=22,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 11:44:47 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-410528ca-3488-4f9b-bda9-ae751b029c63 req-6c81829f-959d-4a69-834a-0b9a4129e248 tempest-AttachVolumeShelveTestJSON-77602652 None] No connector for attachment 78556a3f-207d-467f-99b3-6a3764c83bed; skipping storage backend terminate_connection call. {{(pid=87165) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Nov 06 11:44:47 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-410528ca-3488-4f9b-bda9-ae751b029c63 req-6c81829f-959d-4a69-834a-0b9a4129e248 tempest-AttachVolumeShelveTestJSON-77602652 None] Deleting attachment 78556a3f-207d-467f-99b3-6a3764c83bed. {{(pid=87165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 11:44:52 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-75bc7fa4-da0c-4daf-b5d2-a78fe461fbdf tempest-GroupSnapshotsV319Test-1777621267 None] Group tempest-GroupSnapshotsV319Test-Group-749548965: creating
Nov 06 11:44:52 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-75bc7fa4-da0c-4daf-b5d2-a78fe461fbdf tempest-GroupSnapshotsV319Test-1777621267 None] Group tempest-GroupSnapshotsV319Test-Group-749548965: created successfully
Nov 06 11:44:52 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-75bc7fa4-da0c-4daf-b5d2-a78fe461fbdf tempest-GroupSnapshotsV319Test-1777621267 None] Create group completed successfully.
Nov 06 11:44:53 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ba09707-37e6-424d-973c-0aaba548c654 tempest-AttachVolumeNegativeTest-993089865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:44:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4ba09707-37e6-424d-973c-0aaba548c654 tempest-AttachVolumeNegativeTest-993089865 None] Flow 'volume_create_manager' (e286864f-33b2-4f0d-a02b-c84862d1bd1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:44:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4ba09707-37e6-424d-973c-0aaba548c654 tempest-AttachVolumeNegativeTest-993089865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19959c9e-48c3-43b7-965e-ccaf01bce927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:44:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4ba09707-37e6-424d-973c-0aaba548c654 tempest-AttachVolumeNegativeTest-993089865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19959c9e-48c3-43b7-965e-ccaf01bce927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-981932704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d1908df-d8e0-4ece-9338-8d7f6a4cfea4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3e5280a8be5403bb6364cec1e71368b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:44:53Z,use_quota=True,user_id='aac0f37412684b0ebdf18894bf8f8dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:44:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4ba09707-37e6-424d-973c-0aaba548c654 tempest-AttachVolumeNegativeTest-993089865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eff3d1b-4f9f-4b0d-aa38-59df3d1bb0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:44:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4ba09707-37e6-424d-973c-0aaba548c654 tempest-AttachVolumeNegativeTest-993089865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eff3d1b-4f9f-4b0d-aa38-59df3d1bb0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:44:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4ba09707-37e6-424d-973c-0aaba548c654 tempest-AttachVolumeNegativeTest-993089865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9a7271c-c67f-48df-93b4-f5d106ce82b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:44:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4ba09707-37e6-424d-973c-0aaba548c654 tempest-AttachVolumeNegativeTest-993089865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9a7271c-c67f-48df-93b4-f5d106ce82b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d1908df-d8e0-4ece-9338-8d7f6a4cfea4', 'volume_name': 'volume-9d1908df-d8e0-4ece-9338-8d7f6a4cfea4', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:44:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4ba09707-37e6-424d-973c-0aaba548c654 tempest-AttachVolumeNegativeTest-993089865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27ab701c-fcca-4bb4-9d7f-3a8cf5ea12a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:44:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4ba09707-37e6-424d-973c-0aaba548c654 tempest-AttachVolumeNegativeTest-993089865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27ab701c-fcca-4bb4-9d7f-3a8cf5ea12a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:44:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4ba09707-37e6-424d-973c-0aaba548c654 tempest-AttachVolumeNegativeTest-993089865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65dd89be-3abf-4658-b4f4-a19031ab6f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:44:53 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-4ba09707-37e6-424d-973c-0aaba548c654 tempest-AttachVolumeNegativeTest-993089865 None] Volume 9d1908df-d8e0-4ece-9338-8d7f6a4cfea4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d1908df-d8e0-4ece-9338-8d7f6a4cfea4', 'volume_size': 1}
Nov 06 11:44:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4ba09707-37e6-424d-973c-0aaba548c654 tempest-AttachVolumeNegativeTest-993089865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:44:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4ba09707-37e6-424d-973c-0aaba548c654 tempest-AttachVolumeNegativeTest-993089865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:44:53 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-4ba09707-37e6-424d-973c-0aaba548c654 tempest-AttachVolumeNegativeTest-993089865 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-981932704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d1908df-d8e0-4ece-9338-8d7f6a4cfea4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3e5280a8be5403bb6364cec1e71368b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:44:53Z,use_quota=True,user_id='aac0f37412684b0ebdf18894bf8f8dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:44:53 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-4ba09707-37e6-424d-973c-0aaba548c654 tempest-AttachVolumeNegativeTest-993089865 None] Creating volume 9d1908df-d8e0-4ece-9338-8d7f6a4cfea4 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:44:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4ba09707-37e6-424d-973c-0aaba548c654 tempest-AttachVolumeNegativeTest-993089865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:44:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4ba09707-37e6-424d-973c-0aaba548c654 tempest-AttachVolumeNegativeTest-993089865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:44:53 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-4ba09707-37e6-424d-973c-0aaba548c654 tempest-AttachVolumeNegativeTest-993089865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:44:53 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-4ba09707-37e6-424d-973c-0aaba548c654 tempest-AttachVolumeNegativeTest-993089865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:44:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4ba09707-37e6-424d-973c-0aaba548c654 tempest-AttachVolumeNegativeTest-993089865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:44:53 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-4ba09707-37e6-424d-973c-0aaba548c654 tempest-AttachVolumeNegativeTest-993089865 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:44:53 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-4ba09707-37e6-424d-973c-0aaba548c654 tempest-AttachVolumeNegativeTest-993089865 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:44:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4ba09707-37e6-424d-973c-0aaba548c654 tempest-AttachVolumeNegativeTest-993089865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9d1908df-d8e0-4ece-9338-8d7f6a4cfea4 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:44:53 devstack sudo[90254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9d1908df-d8e0-4ece-9338-8d7f6a4cfea4 1073741824
Nov 06 11:44:53 devstack sudo[90254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:44:54 devstack sudo[90254]: pam_unix(sudo:session): session closed for user root
Nov 06 11:44:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4ba09707-37e6-424d-973c-0aaba548c654 tempest-AttachVolumeNegativeTest-993089865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9d1908df-d8e0-4ece-9338-8d7f6a4cfea4 1073741824" returned: 0 in 0.732s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:44:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4ba09707-37e6-424d-973c-0aaba548c654 tempest-AttachVolumeNegativeTest-993089865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9d1908df-d8e0-4ece-9338-8d7f6a4cfea4 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:44:54 devstack sudo[90261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9d1908df-d8e0-4ece-9338-8d7f6a4cfea4
Nov 06 11:44:54 devstack sudo[90261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:44:54 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-7337512b-3b19-4e3b-870b-5bfd3ee46f47 tempest-GroupSnapshotsV319Test-1777621267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:44:54 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7337512b-3b19-4e3b-870b-5bfd3ee46f47 tempest-GroupSnapshotsV319Test-1777621267 None] Flow 'volume_create_manager' (9d9b19eb-e4db-4e37-8680-1ad04adab41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:44:54 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7337512b-3b19-4e3b-870b-5bfd3ee46f47 tempest-GroupSnapshotsV319Test-1777621267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf8b4cf8-2495-4ca4-a44d-002392917547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:44:54 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7337512b-3b19-4e3b-870b-5bfd3ee46f47 tempest-GroupSnapshotsV319Test-1777621267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf8b4cf8-2495-4ca4-a44d-002392917547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:44:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1165111505',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cefa844e-9ae8-4594-93de-06aed9fae5fb,host='devstack@QuobyteHD#QuobyteHD',id=81422648-e032-4c34-8387-81d11f4def51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6401a1bf3154522a07ee5e7eb0e4d87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:44:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:44:54Z,use_quota=True,user_id='5a0313392b9c4202bcad7eed893390ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d087469-b838-4aab-b95e-afed5fe364ad),volume_type_id=5d087469-b838-4aab-b95e-afed5fe364ad)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:44:54 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7337512b-3b19-4e3b-870b-5bfd3ee46f47 tempest-GroupSnapshotsV319Test-1777621267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78dcdc36-c9e9-46e6-a5e6-2c730d87bbd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:44:54 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7337512b-3b19-4e3b-870b-5bfd3ee46f47 tempest-GroupSnapshotsV319Test-1777621267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78dcdc36-c9e9-46e6-a5e6-2c730d87bbd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:44:54 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7337512b-3b19-4e3b-870b-5bfd3ee46f47 tempest-GroupSnapshotsV319Test-1777621267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38c934ae-e7b9-404c-8f90-40dbb07ea050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:44:54 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7337512b-3b19-4e3b-870b-5bfd3ee46f47 tempest-GroupSnapshotsV319Test-1777621267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38c934ae-e7b9-404c-8f90-40dbb07ea050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81422648-e032-4c34-8387-81d11f4def51', 'volume_name': 'volume-81422648-e032-4c34-8387-81d11f4def51', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:44:54 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7337512b-3b19-4e3b-870b-5bfd3ee46f47 tempest-GroupSnapshotsV319Test-1777621267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d44ddfd1-d91c-4b60-b16e-660c187b39c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:44:54 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7337512b-3b19-4e3b-870b-5bfd3ee46f47 tempest-GroupSnapshotsV319Test-1777621267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d44ddfd1-d91c-4b60-b16e-660c187b39c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:44:54 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7337512b-3b19-4e3b-870b-5bfd3ee46f47 tempest-GroupSnapshotsV319Test-1777621267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c1fc8ba-89ec-49c3-ab5a-959282d10212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:44:54 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-7337512b-3b19-4e3b-870b-5bfd3ee46f47 tempest-GroupSnapshotsV319Test-1777621267 None] Volume 81422648-e032-4c34-8387-81d11f4def51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81422648-e032-4c34-8387-81d11f4def51', 'volume_size': 1}
Nov 06 11:44:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-7337512b-3b19-4e3b-870b-5bfd3ee46f47 tempest-GroupSnapshotsV319Test-1777621267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:44:54 devstack sudo[90261]: pam_unix(sudo:session): session closed for user root
Nov 06 11:44:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4ba09707-37e6-424d-973c-0aaba548c654 tempest-AttachVolumeNegativeTest-993089865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9d1908df-d8e0-4ece-9338-8d7f6a4cfea4" returned: 0 in 0.308s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:44:54 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-4ba09707-37e6-424d-973c-0aaba548c654 tempest-AttachVolumeNegativeTest-993089865 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:44:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4ba09707-37e6-424d-973c-0aaba548c654 tempest-AttachVolumeNegativeTest-993089865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:44:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-7337512b-3b19-4e3b-870b-5bfd3ee46f47 tempest-GroupSnapshotsV319Test-1777621267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.035s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:44:54 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-7337512b-3b19-4e3b-870b-5bfd3ee46f47 tempest-GroupSnapshotsV319Test-1777621267 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=cefa844e-9ae8-4594-93de-06aed9fae5fb,created_at=2026-11-06T10:44:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1165111505',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cefa844e-9ae8-4594-93de-06aed9fae5fb,host='devstack@QuobyteHD#QuobyteHD',id=81422648-e032-4c34-8387-81d11f4def51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6401a1bf3154522a07ee5e7eb0e4d87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:44:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:44:54Z,use_quota=True,user_id='5a0313392b9c4202bcad7eed893390ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d087469-b838-4aab-b95e-afed5fe364ad),volume_type_id=5d087469-b838-4aab-b95e-afed5fe364ad)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:44:54 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-7337512b-3b19-4e3b-870b-5bfd3ee46f47 tempest-GroupSnapshotsV319Test-1777621267 None] Creating volume 81422648-e032-4c34-8387-81d11f4def51 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:44:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-7337512b-3b19-4e3b-870b-5bfd3ee46f47 tempest-GroupSnapshotsV319Test-1777621267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:44:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-7337512b-3b19-4e3b-870b-5bfd3ee46f47 tempest-GroupSnapshotsV319Test-1777621267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:44:54 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-7337512b-3b19-4e3b-870b-5bfd3ee46f47 tempest-GroupSnapshotsV319Test-1777621267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:44:54 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-7337512b-3b19-4e3b-870b-5bfd3ee46f47 tempest-GroupSnapshotsV319Test-1777621267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:44:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-7337512b-3b19-4e3b-870b-5bfd3ee46f47 tempest-GroupSnapshotsV319Test-1777621267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:44:54 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-7337512b-3b19-4e3b-870b-5bfd3ee46f47 tempest-GroupSnapshotsV319Test-1777621267 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:44:54 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-7337512b-3b19-4e3b-870b-5bfd3ee46f47 tempest-GroupSnapshotsV319Test-1777621267 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:44:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7337512b-3b19-4e3b-870b-5bfd3ee46f47 tempest-GroupSnapshotsV319Test-1777621267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-81422648-e032-4c34-8387-81d11f4def51 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:44:54 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4ba09707-37e6-424d-973c-0aaba548c654 tempest-AttachVolumeNegativeTest-993089865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65dd89be-3abf-4658-b4f4-a19031ab6f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d1908df-d8e0-4ece-9338-8d7f6a4cfea4', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:44:54 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4ba09707-37e6-424d-973c-0aaba548c654 tempest-AttachVolumeNegativeTest-993089865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02ef2625-fb2d-4d35-9d27-ef1c0e0d5ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:44:54 devstack sudo[90264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-81422648-e032-4c34-8387-81d11f4def51 1073741824
Nov 06 11:44:54 devstack sudo[90264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:44:54 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-4ba09707-37e6-424d-973c-0aaba548c654 tempest-AttachVolumeNegativeTest-993089865 None] Volume volume-9d1908df-d8e0-4ece-9338-8d7f6a4cfea4 (9d1908df-d8e0-4ece-9338-8d7f6a4cfea4): created successfully
Nov 06 11:44:54 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4ba09707-37e6-424d-973c-0aaba548c654 tempest-AttachVolumeNegativeTest-993089865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02ef2625-fb2d-4d35-9d27-ef1c0e0d5ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:44:54 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4ba09707-37e6-424d-973c-0aaba548c654 tempest-AttachVolumeNegativeTest-993089865 None] Flow 'volume_create_manager' (e286864f-33b2-4f0d-a02b-c84862d1bd1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:44:54 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-4ba09707-37e6-424d-973c-0aaba548c654 tempest-AttachVolumeNegativeTest-993089865 None] Created volume successfully.
Nov 06 11:44:55 devstack sudo[90264]: pam_unix(sudo:session): session closed for user root
Nov 06 11:44:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7337512b-3b19-4e3b-870b-5bfd3ee46f47 tempest-GroupSnapshotsV319Test-1777621267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-81422648-e032-4c34-8387-81d11f4def51 1073741824" returned: 0 in 0.572s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:44:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7337512b-3b19-4e3b-870b-5bfd3ee46f47 tempest-GroupSnapshotsV319Test-1777621267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-81422648-e032-4c34-8387-81d11f4def51 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:44:55 devstack sudo[90310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-81422648-e032-4c34-8387-81d11f4def51
Nov 06 11:44:55 devstack sudo[90310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:44:55 devstack sudo[90310]: pam_unix(sudo:session): session closed for user root
Nov 06 11:44:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7337512b-3b19-4e3b-870b-5bfd3ee46f47 tempest-GroupSnapshotsV319Test-1777621267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-81422648-e032-4c34-8387-81d11f4def51" returned: 0 in 0.423s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:44:55 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-7337512b-3b19-4e3b-870b-5bfd3ee46f47 tempest-GroupSnapshotsV319Test-1777621267 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:44:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-7337512b-3b19-4e3b-870b-5bfd3ee46f47 tempest-GroupSnapshotsV319Test-1777621267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:44:55 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7337512b-3b19-4e3b-870b-5bfd3ee46f47 tempest-GroupSnapshotsV319Test-1777621267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c1fc8ba-89ec-49c3-ab5a-959282d10212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81422648-e032-4c34-8387-81d11f4def51', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:44:55 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7337512b-3b19-4e3b-870b-5bfd3ee46f47 tempest-GroupSnapshotsV319Test-1777621267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea54a110-75d6-49fd-aaf6-524743882460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:44:55 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-7337512b-3b19-4e3b-870b-5bfd3ee46f47 tempest-GroupSnapshotsV319Test-1777621267 None] Volume volume-81422648-e032-4c34-8387-81d11f4def51 (81422648-e032-4c34-8387-81d11f4def51): created successfully
Nov 06 11:44:55 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7337512b-3b19-4e3b-870b-5bfd3ee46f47 tempest-GroupSnapshotsV319Test-1777621267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea54a110-75d6-49fd-aaf6-524743882460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:44:55 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7337512b-3b19-4e3b-870b-5bfd3ee46f47 tempest-GroupSnapshotsV319Test-1777621267 None] Flow 'volume_create_manager' (9d9b19eb-e4db-4e37-8680-1ad04adab41d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:44:55 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-7337512b-3b19-4e3b-870b-5bfd3ee46f47 tempest-GroupSnapshotsV319Test-1777621267 None] Created volume successfully.
Nov 06 11:44:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-ed5386b5-95d8-447c-8fbc-60ae1aef64e6 req-f84aadff-42fe-40dc-8c0d-828bf8301ba3 tempest-AttachVolumeNegativeTest-993089865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:44:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-ed5386b5-95d8-447c-8fbc-60ae1aef64e6 req-f84aadff-42fe-40dc-8c0d-828bf8301ba3 tempest-AttachVolumeNegativeTest-993089865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:44:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-ed5386b5-95d8-447c-8fbc-60ae1aef64e6 req-f84aadff-42fe-40dc-8c0d-828bf8301ba3 tempest-AttachVolumeNegativeTest-993089865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:44:56 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-ed5386b5-95d8-447c-8fbc-60ae1aef64e6 req-f84aadff-42fe-40dc-8c0d-828bf8301ba3 tempest-AttachVolumeNegativeTest-993089865 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50', 'name': 'volume-9d1908df-d8e0-4ece-9338-8d7f6a4cfea4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8154b6fd-6483-4d78-801c-62fdb209b446', 'enforce_multipath': True} {{(pid=87165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 11:44:56 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-ed5386b5-95d8-447c-8fbc-60ae1aef64e6 req-f84aadff-42fe-40dc-8c0d-828bf8301ba3 tempest-AttachVolumeNegativeTest-993089865 None] attachment_update completed successfully.
Nov 06 11:44:57 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-28c81cc3-68dc-47e1-a85b-fc76798856e5 tempest-GroupSnapshotsV319Test-1777621267 None] GroupSnapshot 5cb93fd0-53c2-4dee-a96d-86e0dd6e33aa: creating.
Nov 06 11:44:57 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-28c81cc3-68dc-47e1-a85b-fc76798856e5 tempest-GroupSnapshotsV319Test-1777621267 None] Group snapshot 5cb93fd0-53c2-4dee-a96d-86e0dd6e33aa: creating. {{(pid=87165) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 06 11:44:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-28c81cc3-68dc-47e1-a85b-fc76798856e5 tempest-GroupSnapshotsV319Test-1777621267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:44:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-28c81cc3-68dc-47e1-a85b-fc76798856e5 tempest-GroupSnapshotsV319Test-1777621267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:44:58 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-28c81cc3-68dc-47e1-a85b-fc76798856e5 tempest-GroupSnapshotsV319Test-1777621267 None] Creating offline snapshot 0f92aff9-1fa7-4285-bd6e-c1b3dd103d81 of volume 81422648-e032-4c34-8387-81d11f4def51 {{(pid=87165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 11:44:58 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3f55ed-f433-4a14-8cff-b8ab3ac2d6dc]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:44:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-28c81cc3-68dc-47e1-a85b-fc76798856e5 tempest-GroupSnapshotsV319Test-1777621267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-81422648-e032-4c34-8387-81d11f4def51 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:44:58 devstack sudo[90773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-81422648-e032-4c34-8387-81d11f4def51
Nov 06 11:44:58 devstack sudo[90773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:44:58 devstack sudo[90773]: pam_unix(sudo:session): session closed for user root
Nov 06 11:44:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-28c81cc3-68dc-47e1-a85b-fc76798856e5 tempest-GroupSnapshotsV319Test-1777621267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-81422648-e032-4c34-8387-81d11f4def51" returned: 0 in 0.572s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:44:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-28c81cc3-68dc-47e1-a85b-fc76798856e5 tempest-GroupSnapshotsV319Test-1777621267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-81422648-e032-4c34-8387-81d11f4def51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-81422648-e032-4c34-8387-81d11f4def51.0f92aff9-1fa7-4285-bd6e-c1b3dd103d81 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:44:58 devstack sudo[90778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-81422648-e032-4c34-8387-81d11f4def51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-81422648-e032-4c34-8387-81d11f4def51.0f92aff9-1fa7-4285-bd6e-c1b3dd103d81 1G
Nov 06 11:44:58 devstack sudo[90778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:44:59 devstack sudo[90778]: pam_unix(sudo:session): session closed for user root
Nov 06 11:44:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-28c81cc3-68dc-47e1-a85b-fc76798856e5 tempest-GroupSnapshotsV319Test-1777621267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-81422648-e032-4c34-8387-81d11f4def51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-81422648-e032-4c34-8387-81d11f4def51.0f92aff9-1fa7-4285-bd6e-c1b3dd103d81 1G" returned: 0 in 0.753s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:44:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-28c81cc3-68dc-47e1-a85b-fc76798856e5 tempest-GroupSnapshotsV319Test-1777621267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81422648-e032-4c34-8387-81d11f4def51 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-81422648-e032-4c34-8387-81d11f4def51.0f92aff9-1fa7-4285-bd6e-c1b3dd103d81 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:44:59 devstack sudo[90833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81422648-e032-4c34-8387-81d11f4def51 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-81422648-e032-4c34-8387-81d11f4def51.0f92aff9-1fa7-4285-bd6e-c1b3dd103d81
Nov 06 11:44:59 devstack sudo[90833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:45:00 devstack sudo[90833]: pam_unix(sudo:session): session closed for user root
Nov 06 11:45:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-28c81cc3-68dc-47e1-a85b-fc76798856e5 tempest-GroupSnapshotsV319Test-1777621267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81422648-e032-4c34-8387-81d11f4def51 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-81422648-e032-4c34-8387-81d11f4def51.0f92aff9-1fa7-4285-bd6e-c1b3dd103d81" returned: 0 in 0.717s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:45:00 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-28c81cc3-68dc-47e1-a85b-fc76798856e5 tempest-GroupSnapshotsV319Test-1777621267 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-81422648-e032-4c34-8387-81d11f4def51.0f92aff9-1fa7-4285-bd6e-c1b3dd103d81 is being set with open permissions: ugo+rw: NotImplementedError
Nov 06 11:45:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-28c81cc3-68dc-47e1-a85b-fc76798856e5 tempest-GroupSnapshotsV319Test-1777621267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-81422648-e032-4c34-8387-81d11f4def51.0f92aff9-1fa7-4285-bd6e-c1b3dd103d81 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:45:00 devstack sudo[90853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-81422648-e032-4c34-8387-81d11f4def51.0f92aff9-1fa7-4285-bd6e-c1b3dd103d81
Nov 06 11:45:00 devstack sudo[90853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:45:00 devstack sudo[90853]: pam_unix(sudo:session): session closed for user root
Nov 06 11:45:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-28c81cc3-68dc-47e1-a85b-fc76798856e5 tempest-GroupSnapshotsV319Test-1777621267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-81422648-e032-4c34-8387-81d11f4def51.0f92aff9-1fa7-4285-bd6e-c1b3dd103d81" returned: 0 in 0.394s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:45:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-28c81cc3-68dc-47e1-a85b-fc76798856e5 tempest-GroupSnapshotsV319Test-1777621267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-81422648-e032-4c34-8387-81d11f4def51.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:45:00 devstack sudo[90857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-81422648-e032-4c34-8387-81d11f4def51.info
Nov 06 11:45:00 devstack sudo[90857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:45:00 devstack sudo[90857]: pam_unix(sudo:session): session closed for user root
Nov 06 11:45:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-28c81cc3-68dc-47e1-a85b-fc76798856e5 tempest-GroupSnapshotsV319Test-1777621267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-81422648-e032-4c34-8387-81d11f4def51.info" returned: 0 in 0.375s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:45:00 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-28c81cc3-68dc-47e1-a85b-fc76798856e5 tempest-GroupSnapshotsV319Test-1777621267 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-81422648-e032-4c34-8387-81d11f4def51.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 06 11:45:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-28c81cc3-68dc-47e1-a85b-fc76798856e5 tempest-GroupSnapshotsV319Test-1777621267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-81422648-e032-4c34-8387-81d11f4def51.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:45:01 devstack sudo[90862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-81422648-e032-4c34-8387-81d11f4def51.info
Nov 06 11:45:01 devstack sudo[90862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:45:01 devstack sudo[90862]: pam_unix(sudo:session): session closed for user root
Nov 06 11:45:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-28c81cc3-68dc-47e1-a85b-fc76798856e5 tempest-GroupSnapshotsV319Test-1777621267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-81422648-e032-4c34-8387-81d11f4def51.info" returned: 0 in 0.429s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:45:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-28c81cc3-68dc-47e1-a85b-fc76798856e5 tempest-GroupSnapshotsV319Test-1777621267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.413s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:45:01 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-28c81cc3-68dc-47e1-a85b-fc76798856e5 tempest-GroupSnapshotsV319Test-1777621267 None] group_snapshot 5cb93fd0-53c2-4dee-a96d-86e0dd6e33aa: created successfully
Nov 06 11:45:03 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-97f50d90-52ff-4a95-ae4d-17b48f72784a tempest-GroupSnapshotsV319Test-1777621267 None] group_snapshot 5cb93fd0-53c2-4dee-a96d-86e0dd6e33aa: deleting
Nov 06 11:45:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-97f50d90-52ff-4a95-ae4d-17b48f72784a tempest-GroupSnapshotsV319Test-1777621267 None] group_snapshot 5cb93fd0-53c2-4dee-a96d-86e0dd6e33aa: deleting {{(pid=87165) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 06 11:45:03 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-97f50d90-52ff-4a95-ae4d-17b48f72784a tempest-GroupSnapshotsV319Test-1777621267 None] Acquiring lock "cinder-quobyte-81422648-e032-4c34-8387-81d11f4def51" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:45:03 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-97f50d90-52ff-4a95-ae4d-17b48f72784a tempest-GroupSnapshotsV319Test-1777621267 None] Lock "cinder-quobyte-81422648-e032-4c34-8387-81d11f4def51" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:45:03 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-97f50d90-52ff-4a95-ae4d-17b48f72784a tempest-GroupSnapshotsV319Test-1777621267 None] Acquiring lock "cinder-quobyte-0f92aff9-1fa7-4285-bd6e-c1b3dd103d81" by "_delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:45:03 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-97f50d90-52ff-4a95-ae4d-17b48f72784a tempest-GroupSnapshotsV319Test-1777621267 None] Lock "cinder-quobyte-0f92aff9-1fa7-4285-bd6e-c1b3dd103d81" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:45:03 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-97f50d90-52ff-4a95-ae4d-17b48f72784a tempest-GroupSnapshotsV319Test-1777621267 None] Deleting offline snapshot 0f92aff9-1fa7-4285-bd6e-c1b3dd103d81 of volume 81422648-e032-4c34-8387-81d11f4def51 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 11:45:03 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-97f50d90-52ff-4a95-ae4d-17b48f72784a tempest-GroupSnapshotsV319Test-1777621267 None] snapshot_file for this snap is: volume-81422648-e032-4c34-8387-81d11f4def51.0f92aff9-1fa7-4285-bd6e-c1b3dd103d81 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 11:45:03 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbb79ad-b05f-4153-9ef2-f465d76a4a69]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:45:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-97f50d90-52ff-4a95-ae4d-17b48f72784a tempest-GroupSnapshotsV319Test-1777621267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-81422648-e032-4c34-8387-81d11f4def51.0f92aff9-1fa7-4285-bd6e-c1b3dd103d81 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:45:03 devstack sudo[90873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-81422648-e032-4c34-8387-81d11f4def51.0f92aff9-1fa7-4285-bd6e-c1b3dd103d81
Nov 06 11:45:03 devstack sudo[90873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:45:04 devstack sudo[90873]: pam_unix(sudo:session): session closed for user root
Nov 06 11:45:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-97f50d90-52ff-4a95-ae4d-17b48f72784a tempest-GroupSnapshotsV319Test-1777621267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-81422648-e032-4c34-8387-81d11f4def51.0f92aff9-1fa7-4285-bd6e-c1b3dd103d81" returned: 0 in 0.587s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:45:04 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-97f50d90-52ff-4a95-ae4d-17b48f72784a tempest-GroupSnapshotsV319Test-1777621267 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81422648-e032-4c34-8387-81d11f4def51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:45:04 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f696b1-8e38-47b6-8602-981ec0d897b8]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:45:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-97f50d90-52ff-4a95-ae4d-17b48f72784a tempest-GroupSnapshotsV319Test-1777621267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-81422648-e032-4c34-8387-81d11f4def51 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:45:04 devstack sudo[90883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-81422648-e032-4c34-8387-81d11f4def51
Nov 06 11:45:04 devstack sudo[90883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:45:04 devstack sudo[90883]: pam_unix(sudo:session): session closed for user root
Nov 06 11:45:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-97f50d90-52ff-4a95-ae4d-17b48f72784a tempest-GroupSnapshotsV319Test-1777621267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-81422648-e032-4c34-8387-81d11f4def51" returned: 0 in 0.532s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:45:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-97f50d90-52ff-4a95-ae4d-17b48f72784a tempest-GroupSnapshotsV319Test-1777621267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-81422648-e032-4c34-8387-81d11f4def51.0f92aff9-1fa7-4285-bd6e-c1b3dd103d81 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:45:04 devstack sudo[90890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-81422648-e032-4c34-8387-81d11f4def51.0f92aff9-1fa7-4285-bd6e-c1b3dd103d81
Nov 06 11:45:04 devstack sudo[90890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:45:05 devstack sudo[90890]: pam_unix(sudo:session): session closed for user root
Nov 06 11:45:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-97f50d90-52ff-4a95-ae4d-17b48f72784a tempest-GroupSnapshotsV319Test-1777621267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-81422648-e032-4c34-8387-81d11f4def51.0f92aff9-1fa7-4285-bd6e-c1b3dd103d81" returned: 0 in 0.519s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:45:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-97f50d90-52ff-4a95-ae4d-17b48f72784a tempest-GroupSnapshotsV319Test-1777621267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-81422648-e032-4c34-8387-81d11f4def51.0f92aff9-1fa7-4285-bd6e-c1b3dd103d81 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:45:05 devstack sudo[90897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-81422648-e032-4c34-8387-81d11f4def51.0f92aff9-1fa7-4285-bd6e-c1b3dd103d81
Nov 06 11:45:05 devstack sudo[90897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:45:05 devstack sudo[90897]: pam_unix(sudo:session): session closed for user root
Nov 06 11:45:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-97f50d90-52ff-4a95-ae4d-17b48f72784a tempest-GroupSnapshotsV319Test-1777621267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-81422648-e032-4c34-8387-81d11f4def51.0f92aff9-1fa7-4285-bd6e-c1b3dd103d81" returned: 0 in 0.407s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:45:05 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-97f50d90-52ff-4a95-ae4d-17b48f72784a tempest-GroupSnapshotsV319Test-1777621267 None] Lock "cinder-quobyte-0f92aff9-1fa7-4285-bd6e-c1b3dd103d81" released by "_delete_snapshot" :: held 2.223s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:45:05 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-97f50d90-52ff-4a95-ae4d-17b48f72784a tempest-GroupSnapshotsV319Test-1777621267 None] Lock "cinder-quobyte-81422648-e032-4c34-8387-81d11f4def51" released by "delete_snapshot" :: held 2.258s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:45:05 devstack cinder-volume[87165]: WARNING cinder.quota [None req-97f50d90-52ff-4a95-ae4d-17b48f72784a tempest-GroupSnapshotsV319Test-1777621267 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2032172697 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2032172697, it is now deprecated. Please use the default quota class for default quota.
Nov 06 11:45:05 devstack cinder-volume[87165]: WARNING cinder.quota [None req-97f50d90-52ff-4a95-ae4d-17b48f72784a tempest-GroupSnapshotsV319Test-1777621267 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2032172697 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2032172697, it is now deprecated. Please use the default quota class for default quota.
Nov 06 11:45:05 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-97f50d90-52ff-4a95-ae4d-17b48f72784a tempest-GroupSnapshotsV319Test-1777621267 None] Created reservations ['2e907381-6b6f-4109-a4ab-8f0df6de9bc5', '85b8545b-33b6-42db-8b41-d93aac4b5732', '494a8c91-cf16-40fc-af6a-967d51c855ec', '6616daf4-9346-4113-a688-38c7ccae5443'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:45:06 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-97f50d90-52ff-4a95-ae4d-17b48f72784a tempest-GroupSnapshotsV319Test-1777621267 None] group_snapshot 5cb93fd0-53c2-4dee-a96d-86e0dd6e33aa: deleted successfully
Nov 06 11:45:07 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-2812b992-1f72-4769-aa3d-d7c84eee7ba4 tempest-GroupSnapshotsV319Test-1777621267 None] Acquiring lock "cinder-quobyte-81422648-e032-4c34-8387-81d11f4def51" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:45:07 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-2812b992-1f72-4769-aa3d-d7c84eee7ba4 tempest-GroupSnapshotsV319Test-1777621267 None] Lock "cinder-quobyte-81422648-e032-4c34-8387-81d11f4def51" acquired by "delete_volume" :: waited 0.033s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:45:07 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d715c57-f12d-4d5d-b0c2-83550f4f543b]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:45:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2812b992-1f72-4769-aa3d-d7c84eee7ba4 tempest-GroupSnapshotsV319Test-1777621267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-81422648-e032-4c34-8387-81d11f4def51 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:45:07 devstack sudo[90937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-81422648-e032-4c34-8387-81d11f4def51
Nov 06 11:45:07 devstack sudo[90937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:45:08 devstack sudo[90937]: pam_unix(sudo:session): session closed for user root
Nov 06 11:45:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2812b992-1f72-4769-aa3d-d7c84eee7ba4 tempest-GroupSnapshotsV319Test-1777621267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-81422648-e032-4c34-8387-81d11f4def51" returned: 0 in 0.623s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:45:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2812b992-1f72-4769-aa3d-d7c84eee7ba4 tempest-GroupSnapshotsV319Test-1777621267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-81422648-e032-4c34-8387-81d11f4def51 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:45:08 devstack sudo[90943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-81422648-e032-4c34-8387-81d11f4def51
Nov 06 11:45:08 devstack sudo[90943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:45:08 devstack sudo[90943]: pam_unix(sudo:session): session closed for user root
Nov 06 11:45:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2812b992-1f72-4769-aa3d-d7c84eee7ba4 tempest-GroupSnapshotsV319Test-1777621267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-81422648-e032-4c34-8387-81d11f4def51" returned: 0 in 0.395s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:45:08 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-2812b992-1f72-4769-aa3d-d7c84eee7ba4 tempest-GroupSnapshotsV319Test-1777621267 None] Lock "cinder-quobyte-81422648-e032-4c34-8387-81d11f4def51" released by "delete_volume" :: held 1.131s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:45:08 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-2812b992-1f72-4769-aa3d-d7c84eee7ba4 tempest-GroupSnapshotsV319Test-1777621267 None] Created reservations ['d4238f65-f38b-45bf-afb9-594616f89d9b'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:45:08 devstack cinder-volume[87165]: WARNING cinder.quota [None req-2812b992-1f72-4769-aa3d-d7c84eee7ba4 tempest-GroupSnapshotsV319Test-1777621267 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2032172697 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2032172697, it is now deprecated. Please use the default quota class for default quota.
Nov 06 11:45:08 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-2812b992-1f72-4769-aa3d-d7c84eee7ba4 tempest-GroupSnapshotsV319Test-1777621267 None] Created reservations ['89f8d1d5-654b-44d3-a8cf-4648ef4b9296', '8e5f868c-ef9a-4a65-a096-c8df7b43da99', '4b1fe16d-2712-43d3-b1b2-812040bcc7cb', 'a8da7eb2-4887-48b3-b390-1d895c3ac5d3'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:45:09 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-2812b992-1f72-4769-aa3d-d7c84eee7ba4 tempest-GroupSnapshotsV319Test-1777621267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:45:09 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-2812b992-1f72-4769-aa3d-d7c84eee7ba4 tempest-GroupSnapshotsV319Test-1777621267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:45:09 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-2812b992-1f72-4769-aa3d-d7c84eee7ba4 tempest-GroupSnapshotsV319Test-1777621267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:45:09 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-2812b992-1f72-4769-aa3d-d7c84eee7ba4 tempest-GroupSnapshotsV319Test-1777621267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:45:09 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-2812b992-1f72-4769-aa3d-d7c84eee7ba4 tempest-GroupSnapshotsV319Test-1777621267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:45:09 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2812b992-1f72-4769-aa3d-d7c84eee7ba4 tempest-GroupSnapshotsV319Test-1777621267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:45:09 devstack sudo[90948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:45:09 devstack sudo[90948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:45:09 devstack sudo[90948]: pam_unix(sudo:session): session closed for user root
Nov 06 11:45:09 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2812b992-1f72-4769-aa3d-d7c84eee7ba4 tempest-GroupSnapshotsV319Test-1777621267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.396s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:45:09 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-2812b992-1f72-4769-aa3d-d7c84eee7ba4 tempest-GroupSnapshotsV319Test-1777621267 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:45:09 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-2812b992-1f72-4769-aa3d-d7c84eee7ba4 tempest-GroupSnapshotsV319Test-1777621267 None] Delete group completed successfully.
Nov 06 11:45:17 devstack cinder-volume[87165]: DEBUG oslo_service.periodic_task [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 11:45:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:45:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:45:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:45:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:45:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:45:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:45:17 devstack sudo[91097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:45:17 devstack sudo[91097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:45:17 devstack sudo[91097]: pam_unix(sudo:session): session closed for user root
Nov 06 11:45:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.593s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:45:17 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:45:17 devstack cinder-volume[87165]: DEBUG oslo_service.periodic_task [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running periodic task VolumeManager._thread_info {{(pid=87165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 11:45:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] thread count: 8 {{(pid=87165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 11:45:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] thread info: [<_MainThread(MainThread, started 127732956901504)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127732842693056)>, <Thread(Thread-3 (stat_writer), started daemon 127732841891136)>, <Thread(Rabbit-heartbeat, started daemon 127732842515648)>, <Thread(Thread-5 (_runner), started daemon 127732840534464)>, <Thread(Thread-7 (_runner), started daemon 127732840636032)>, <Thread(fd_logger, started daemon 127732838664256)>, <Thread(privsep_reader, started daemon 127732838673408)>] {{(pid=87165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 11:45:19 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:SELECT=37,cinder:UPDATE=24,cinder:INSERT=6 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 11:45:19 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:SELECT=31,cinder:UPDATE=31,cinder:DELETE=2,cinder:INSERT=6 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 11:45:31 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0d13f04b-40d1-4393-bd4b-d2a97e272a63 tempest-AttachVolumeShelveTestJSON-77602652 None] Acquiring lock "cinder-b0ee0ed2-3787-40ea-b46d-1716da9a3f15-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:45:31 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0d13f04b-40d1-4393-bd4b-d2a97e272a63 tempest-AttachVolumeShelveTestJSON-77602652 None] Lock "cinder-b0ee0ed2-3787-40ea-b46d-1716da9a3f15-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:45:31 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0d13f04b-40d1-4393-bd4b-d2a97e272a63 tempest-AttachVolumeShelveTestJSON-77602652 None] Acquiring lock "cinder-quobyte-b0ee0ed2-3787-40ea-b46d-1716da9a3f15" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:45:31 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0d13f04b-40d1-4393-bd4b-d2a97e272a63 tempest-AttachVolumeShelveTestJSON-77602652 None] Lock "cinder-quobyte-b0ee0ed2-3787-40ea-b46d-1716da9a3f15" acquired by "delete_volume" :: waited 0.014s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:45:31 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a964b33e-142a-451f-8fee-5f3c785667a8]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:45:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0d13f04b-40d1-4393-bd4b-d2a97e272a63 tempest-AttachVolumeShelveTestJSON-77602652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b0ee0ed2-3787-40ea-b46d-1716da9a3f15 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:45:31 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-157ea727-de50-4dab-b899-7c7490dada87 tempest-GroupsV314Test-675388203 None] Group tempest-GroupsV314Test-Group-803556225: creating
Nov 06 11:45:31 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-157ea727-de50-4dab-b899-7c7490dada87 tempest-GroupsV314Test-675388203 None] Group tempest-GroupsV314Test-Group-803556225: created successfully
Nov 06 11:45:31 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-157ea727-de50-4dab-b899-7c7490dada87 tempest-GroupsV314Test-675388203 None] Create group completed successfully.
Nov 06 11:45:31 devstack sudo[91199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b0ee0ed2-3787-40ea-b46d-1716da9a3f15
Nov 06 11:45:31 devstack sudo[91199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:45:31 devstack sudo[91199]: pam_unix(sudo:session): session closed for user root
Nov 06 11:45:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0d13f04b-40d1-4393-bd4b-d2a97e272a63 tempest-AttachVolumeShelveTestJSON-77602652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b0ee0ed2-3787-40ea-b46d-1716da9a3f15" returned: 0 in 0.379s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:45:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0d13f04b-40d1-4393-bd4b-d2a97e272a63 tempest-AttachVolumeShelveTestJSON-77602652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b0ee0ed2-3787-40ea-b46d-1716da9a3f15 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:45:31 devstack sudo[91204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b0ee0ed2-3787-40ea-b46d-1716da9a3f15
Nov 06 11:45:31 devstack sudo[91204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:45:31 devstack sudo[91204]: pam_unix(sudo:session): session closed for user root
Nov 06 11:45:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0d13f04b-40d1-4393-bd4b-d2a97e272a63 tempest-AttachVolumeShelveTestJSON-77602652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b0ee0ed2-3787-40ea-b46d-1716da9a3f15" returned: 0 in 0.262s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:45:31 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0d13f04b-40d1-4393-bd4b-d2a97e272a63 tempest-AttachVolumeShelveTestJSON-77602652 None] Lock "cinder-quobyte-b0ee0ed2-3787-40ea-b46d-1716da9a3f15" released by "delete_volume" :: held 0.695s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:45:31 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-0d13f04b-40d1-4393-bd4b-d2a97e272a63 tempest-AttachVolumeShelveTestJSON-77602652 None] Created reservations ['5cd1c98a-7dda-455c-bf5d-ae9649bb30d2', '7bf494a2-7098-42d1-98b9-d437facc9485', '7adca40c-bf9b-4b1d-a246-5e6828162726', '49678d5f-ea67-4946-b23d-6d38b7458f35'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:45:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-0d13f04b-40d1-4393-bd4b-d2a97e272a63 tempest-AttachVolumeShelveTestJSON-77602652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:45:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-0d13f04b-40d1-4393-bd4b-d2a97e272a63 tempest-AttachVolumeShelveTestJSON-77602652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:45:31 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-0d13f04b-40d1-4393-bd4b-d2a97e272a63 tempest-AttachVolumeShelveTestJSON-77602652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:45:31 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-0d13f04b-40d1-4393-bd4b-d2a97e272a63 tempest-AttachVolumeShelveTestJSON-77602652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:45:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-0d13f04b-40d1-4393-bd4b-d2a97e272a63 tempest-AttachVolumeShelveTestJSON-77602652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:45:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0d13f04b-40d1-4393-bd4b-d2a97e272a63 tempest-AttachVolumeShelveTestJSON-77602652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:45:31 devstack sudo[91208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:45:31 devstack sudo[91208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:45:32 devstack sudo[91208]: pam_unix(sudo:session): session closed for user root
Nov 06 11:45:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0d13f04b-40d1-4393-bd4b-d2a97e272a63 tempest-AttachVolumeShelveTestJSON-77602652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.249s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:45:32 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-0d13f04b-40d1-4393-bd4b-d2a97e272a63 tempest-AttachVolumeShelveTestJSON-77602652 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:45:32 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-0d13f04b-40d1-4393-bd4b-d2a97e272a63 tempest-AttachVolumeShelveTestJSON-77602652 None] Deleted volume successfully.
Nov 06 11:45:32 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0d13f04b-40d1-4393-bd4b-d2a97e272a63 tempest-AttachVolumeShelveTestJSON-77602652 None] Lock "cinder-b0ee0ed2-3787-40ea-b46d-1716da9a3f15-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:45:32 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9cfe434-fe40-42a5-99c9-6c522c54f227 tempest-GroupsV314Test-675388203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:45:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f9cfe434-fe40-42a5-99c9-6c522c54f227 tempest-GroupsV314Test-675388203 None] Flow 'volume_create_manager' (0aef2c5a-2ecb-43d8-8abd-947b2e1dfc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:45:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f9cfe434-fe40-42a5-99c9-6c522c54f227 tempest-GroupsV314Test-675388203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85388695-219e-4dd6-8b06-266d8c3461ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:45:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f9cfe434-fe40-42a5-99c9-6c522c54f227 tempest-GroupsV314Test-675388203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85388695-219e-4dd6-8b06-266d8c3461ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1250235188',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8a47f915-9e87-4f9a-8524-5b84780a6086,host='devstack@QuobyteHD#QuobyteHD',id=7e5e2539-4fa9-4cbf-b28b-fb206beba313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b73816b4eb843b0b05fcecd4e867c95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:45:33Z,use_quota=True,user_id='82daf5dde13f43a08e5247536acfa3f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e7f57d7-184d-4868-95a2-d5be6c87cba4),volume_type_id=4e7f57d7-184d-4868-95a2-d5be6c87cba4)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:45:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f9cfe434-fe40-42a5-99c9-6c522c54f227 tempest-GroupsV314Test-675388203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1369e7fa-6644-475d-a329-e2e37b2c85d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:45:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f9cfe434-fe40-42a5-99c9-6c522c54f227 tempest-GroupsV314Test-675388203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1369e7fa-6644-475d-a329-e2e37b2c85d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:45:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f9cfe434-fe40-42a5-99c9-6c522c54f227 tempest-GroupsV314Test-675388203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da487d0e-bb31-4540-9ead-eaf5d73046b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:45:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f9cfe434-fe40-42a5-99c9-6c522c54f227 tempest-GroupsV314Test-675388203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da487d0e-bb31-4540-9ead-eaf5d73046b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e5e2539-4fa9-4cbf-b28b-fb206beba313', 'volume_name': 'volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:45:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f9cfe434-fe40-42a5-99c9-6c522c54f227 tempest-GroupsV314Test-675388203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5dedd6d-2fd1-4f00-9fb4-12b816c518b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:45:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f9cfe434-fe40-42a5-99c9-6c522c54f227 tempest-GroupsV314Test-675388203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5dedd6d-2fd1-4f00-9fb4-12b816c518b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:45:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f9cfe434-fe40-42a5-99c9-6c522c54f227 tempest-GroupsV314Test-675388203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9a4460f-4cb5-4a6f-8b6a-72ef6b67980f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:45:32 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-f9cfe434-fe40-42a5-99c9-6c522c54f227 tempest-GroupsV314Test-675388203 None] Volume 7e5e2539-4fa9-4cbf-b28b-fb206beba313: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313', 'volume_size': 1}
Nov 06 11:45:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f9cfe434-fe40-42a5-99c9-6c522c54f227 tempest-GroupsV314Test-675388203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:45:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f9cfe434-fe40-42a5-99c9-6c522c54f227 tempest-GroupsV314Test-675388203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:45:32 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-f9cfe434-fe40-42a5-99c9-6c522c54f227 tempest-GroupsV314Test-675388203 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=8a47f915-9e87-4f9a-8524-5b84780a6086,created_at=2026-11-06T10:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1250235188',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8a47f915-9e87-4f9a-8524-5b84780a6086,host='devstack@QuobyteHD#QuobyteHD',id=7e5e2539-4fa9-4cbf-b28b-fb206beba313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b73816b4eb843b0b05fcecd4e867c95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:45:33Z,use_quota=True,user_id='82daf5dde13f43a08e5247536acfa3f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e7f57d7-184d-4868-95a2-d5be6c87cba4),volume_type_id=4e7f57d7-184d-4868-95a2-d5be6c87cba4)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:45:32 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-f9cfe434-fe40-42a5-99c9-6c522c54f227 tempest-GroupsV314Test-675388203 None] Creating volume 7e5e2539-4fa9-4cbf-b28b-fb206beba313 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:45:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f9cfe434-fe40-42a5-99c9-6c522c54f227 tempest-GroupsV314Test-675388203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:45:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f9cfe434-fe40-42a5-99c9-6c522c54f227 tempest-GroupsV314Test-675388203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:45:32 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-f9cfe434-fe40-42a5-99c9-6c522c54f227 tempest-GroupsV314Test-675388203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:45:32 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-f9cfe434-fe40-42a5-99c9-6c522c54f227 tempest-GroupsV314Test-675388203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:45:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f9cfe434-fe40-42a5-99c9-6c522c54f227 tempest-GroupsV314Test-675388203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:45:32 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-f9cfe434-fe40-42a5-99c9-6c522c54f227 tempest-GroupsV314Test-675388203 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:45:32 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-f9cfe434-fe40-42a5-99c9-6c522c54f227 tempest-GroupsV314Test-675388203 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:45:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f9cfe434-fe40-42a5-99c9-6c522c54f227 tempest-GroupsV314Test-675388203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:45:32 devstack sudo[91211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313 1073741824
Nov 06 11:45:32 devstack sudo[91211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:45:33 devstack sudo[91211]: pam_unix(sudo:session): session closed for user root
Nov 06 11:45:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f9cfe434-fe40-42a5-99c9-6c522c54f227 tempest-GroupsV314Test-675388203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313 1073741824" returned: 0 in 0.453s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:45:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f9cfe434-fe40-42a5-99c9-6c522c54f227 tempest-GroupsV314Test-675388203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:45:33 devstack sudo[91217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313
Nov 06 11:45:33 devstack sudo[91217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:45:33 devstack sudo[91217]: pam_unix(sudo:session): session closed for user root
Nov 06 11:45:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f9cfe434-fe40-42a5-99c9-6c522c54f227 tempest-GroupsV314Test-675388203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313" returned: 0 in 0.282s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:45:33 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-f9cfe434-fe40-42a5-99c9-6c522c54f227 tempest-GroupsV314Test-675388203 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:45:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f9cfe434-fe40-42a5-99c9-6c522c54f227 tempest-GroupsV314Test-675388203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:45:33 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f9cfe434-fe40-42a5-99c9-6c522c54f227 tempest-GroupsV314Test-675388203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9a4460f-4cb5-4a6f-8b6a-72ef6b67980f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:45:33 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f9cfe434-fe40-42a5-99c9-6c522c54f227 tempest-GroupsV314Test-675388203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a30c6fdf-78c2-41f7-b3fc-835e25afe40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:45:33 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-f9cfe434-fe40-42a5-99c9-6c522c54f227 tempest-GroupsV314Test-675388203 None] Volume volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313 (7e5e2539-4fa9-4cbf-b28b-fb206beba313): created successfully
Nov 06 11:45:33 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f9cfe434-fe40-42a5-99c9-6c522c54f227 tempest-GroupsV314Test-675388203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a30c6fdf-78c2-41f7-b3fc-835e25afe40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:45:33 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f9cfe434-fe40-42a5-99c9-6c522c54f227 tempest-GroupsV314Test-675388203 None] Flow 'volume_create_manager' (0aef2c5a-2ecb-43d8-8abd-947b2e1dfc4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:45:33 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-f9cfe434-fe40-42a5-99c9-6c522c54f227 tempest-GroupsV314Test-675388203 None] Created volume successfully.
Nov 06 11:45:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:45:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:45:34 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] Cloning volume 7e5e2539-4fa9-4cbf-b28b-fb206beba313 to volume 1bed98c6-56f5-4219-bc22-e6f440fcdef0
Nov 06 11:45:34 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] Creating offline snapshot ec1be397-edf5-4004-8cd8-1dd1475009df of volume 7e5e2539-4fa9-4cbf-b28b-fb206beba313 {{(pid=87165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 11:45:34 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[958d1e7d-0e29-41d0-815a-7c36b3f66164]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:45:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:45:34 devstack sudo[91222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313
Nov 06 11:45:34 devstack sudo[91222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:45:35 devstack sudo[91222]: pam_unix(sudo:session): session closed for user root
Nov 06 11:45:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313" returned: 0 in 0.389s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:45:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313.ec1be397-edf5-4004-8cd8-1dd1475009df 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:45:35 devstack sudo[91227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313.ec1be397-edf5-4004-8cd8-1dd1475009df 1G
Nov 06 11:45:35 devstack sudo[91227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:45:35 devstack sudo[91227]: pam_unix(sudo:session): session closed for user root
Nov 06 11:45:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313.ec1be397-edf5-4004-8cd8-1dd1475009df 1G" returned: 0 in 0.400s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:45:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313.ec1be397-edf5-4004-8cd8-1dd1475009df {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:45:35 devstack sudo[91232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313.ec1be397-edf5-4004-8cd8-1dd1475009df
Nov 06 11:45:35 devstack sudo[91232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:45:35 devstack sudo[91232]: pam_unix(sudo:session): session closed for user root
Nov 06 11:45:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313.ec1be397-edf5-4004-8cd8-1dd1475009df" returned: 0 in 0.285s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:45:35 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313.ec1be397-edf5-4004-8cd8-1dd1475009df is being set with open permissions: ugo+rw: NotImplementedError
Nov 06 11:45:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313.ec1be397-edf5-4004-8cd8-1dd1475009df {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:45:35 devstack sudo[91239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313.ec1be397-edf5-4004-8cd8-1dd1475009df
Nov 06 11:45:35 devstack sudo[91239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:45:35 devstack sudo[91239]: pam_unix(sudo:session): session closed for user root
Nov 06 11:45:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313.ec1be397-edf5-4004-8cd8-1dd1475009df" returned: 0 in 0.232s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:45:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:45:36 devstack sudo[91243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313.info
Nov 06 11:45:36 devstack sudo[91243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:45:36 devstack sudo[91243]: pam_unix(sudo:session): session closed for user root
Nov 06 11:45:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313.info" returned: 0 in 0.331s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:45:36 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 06 11:45:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:45:36 devstack sudo[91246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313.info
Nov 06 11:45:36 devstack sudo[91246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:45:36 devstack sudo[91246]: pam_unix(sudo:session): session closed for user root
Nov 06 11:45:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313.info" returned: 0 in 0.350s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:45:36 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] Acquiring lock "cinder-quobyte-1bed98c6-56f5-4219-bc22-e6f440fcdef0" by "_copy_volume_from_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:45:36 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] Lock "cinder-quobyte-1bed98c6-56f5-4219-bc22-e6f440fcdef0" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:45:36 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] snapshot: ec1be397-edf5-4004-8cd8-1dd1475009df, volume: 1bed98c6-56f5-4219-bc22-e6f440fcdef0,  {{(pid=87165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 06 11:45:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:45:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:45:36 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:45:36 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:45:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:45:36 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fa5a37-3c2f-4869-82a0-cb700ac28fbd]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:45:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313.ec1be397-edf5-4004-8cd8-1dd1475009df {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:45:36 devstack sudo[91249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313.ec1be397-edf5-4004-8cd8-1dd1475009df
Nov 06 11:45:36 devstack sudo[91249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:45:37 devstack sudo[91249]: pam_unix(sudo:session): session closed for user root
Nov 06 11:45:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313.ec1be397-edf5-4004-8cd8-1dd1475009df" returned: 0 in 0.435s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:45:37 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:45:37 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b375baa-a73a-4f26-9eee-bae57d4ec8ef]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:45:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:45:37 devstack sudo[91254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313
Nov 06 11:45:37 devstack sudo[91254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:45:37 devstack sudo[91254]: pam_unix(sudo:session): session closed for user root
Nov 06 11:45:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313" returned: 0 in 0.562s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:45:37 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313 {{(pid=87165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 06 11:45:37 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] Creating direct copy from snapshot {{(pid=87165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 06 11:45:37 devstack cinder-volume[87165]: DEBUG cinder.utils [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] Path /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1bed98c6-56f5-4219-bc22-e6f440fcdef0 not found in is_blk_device check {{(pid=87165) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 06 11:45:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1bed98c6-56f5-4219-bc22-e6f440fcdef0 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:45:37 devstack sudo[91260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1bed98c6-56f5-4219-bc22-e6f440fcdef0
Nov 06 11:45:37 devstack sudo[91260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:45:40 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e4a97ed-cb48-458b-97cf-9d4234e6c8ba tempest-ServerActionsTestOtherA-2004102178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:45:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8e4a97ed-cb48-458b-97cf-9d4234e6c8ba tempest-ServerActionsTestOtherA-2004102178 None] Flow 'volume_create_manager' (e9612776-2d5f-4270-b724-239332116753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:45:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8e4a97ed-cb48-458b-97cf-9d4234e6c8ba tempest-ServerActionsTestOtherA-2004102178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4e52d7b-5c55-4398-a698-feede38096f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:45:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8e4a97ed-cb48-458b-97cf-9d4234e6c8ba tempest-ServerActionsTestOtherA-2004102178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4e52d7b-5c55-4398-a698-feede38096f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1990927279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09ad69a1-794b-4284-9835-05c87ec3c45d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef3e348d1844d75870ff73c0714265e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:45:41Z,use_quota=True,user_id='afa596603cec4a98815c9ba4368f3ebc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:45:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8e4a97ed-cb48-458b-97cf-9d4234e6c8ba tempest-ServerActionsTestOtherA-2004102178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0377db9-6bf9-4f85-8b56-34faeb82a9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:45:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8e4a97ed-cb48-458b-97cf-9d4234e6c8ba tempest-ServerActionsTestOtherA-2004102178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0377db9-6bf9-4f85-8b56-34faeb82a9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:45:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8e4a97ed-cb48-458b-97cf-9d4234e6c8ba tempest-ServerActionsTestOtherA-2004102178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b3d824a-931d-4597-ada4-883b20477c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:45:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8e4a97ed-cb48-458b-97cf-9d4234e6c8ba tempest-ServerActionsTestOtherA-2004102178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b3d824a-931d-4597-ada4-883b20477c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09ad69a1-794b-4284-9835-05c87ec3c45d', 'volume_name': 'volume-09ad69a1-794b-4284-9835-05c87ec3c45d', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:45:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8e4a97ed-cb48-458b-97cf-9d4234e6c8ba tempest-ServerActionsTestOtherA-2004102178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d78f2fbc-9751-487a-b147-796fd6b979ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:45:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8e4a97ed-cb48-458b-97cf-9d4234e6c8ba tempest-ServerActionsTestOtherA-2004102178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d78f2fbc-9751-487a-b147-796fd6b979ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:45:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8e4a97ed-cb48-458b-97cf-9d4234e6c8ba tempest-ServerActionsTestOtherA-2004102178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (571f30ce-9f6a-4461-8581-c6480c9fc01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:45:40 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-8e4a97ed-cb48-458b-97cf-9d4234e6c8ba tempest-ServerActionsTestOtherA-2004102178 None] Volume 09ad69a1-794b-4284-9835-05c87ec3c45d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09ad69a1-794b-4284-9835-05c87ec3c45d', 'volume_size': 1}
Nov 06 11:45:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-8e4a97ed-cb48-458b-97cf-9d4234e6c8ba tempest-ServerActionsTestOtherA-2004102178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:45:46 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-25d0428b-8fbd-4e1f-9f86-7e403ba690ff tempest-GroupSnapshotsTest-422127898 None] Group tempest-GroupSnapshotsTest-Group-559366021: creating
Nov 06 11:45:46 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-25d0428b-8fbd-4e1f-9f86-7e403ba690ff tempest-GroupSnapshotsTest-422127898 None] Group tempest-GroupSnapshotsTest-Group-559366021: created successfully
Nov 06 11:45:46 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-25d0428b-8fbd-4e1f-9f86-7e403ba690ff tempest-GroupSnapshotsTest-422127898 None] Create group completed successfully.
Nov 06 11:45:46 devstack sudo[91260]: pam_unix(sudo:session): session closed for user root
Nov 06 11:45:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1bed98c6-56f5-4219-bc22-e6f440fcdef0" returned: 0 in 9.044s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:45:46 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] Image conversion details: src /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313, size 1024.00 MB, duration 9.05 sec, destination /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1bed98c6-56f5-4219-bc22-e6f440fcdef0 {{(pid=87165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 11:45:46 devstack cinder-volume[87165]: INFO cinder.image.image_utils [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] Converted 1024.00 MB image at 113.21 MB/s
Nov 06 11:45:46 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1bed98c6-56f5-4219-bc22-e6f440fcdef0 is being set with open permissions: ugo+rw: NotImplementedError
Nov 06 11:45:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1bed98c6-56f5-4219-bc22-e6f440fcdef0 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:45:46 devstack sudo[91314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1bed98c6-56f5-4219-bc22-e6f440fcdef0
Nov 06 11:45:46 devstack sudo[91314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:45:47 devstack sudo[91314]: pam_unix(sudo:session): session closed for user root
Nov 06 11:45:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1bed98c6-56f5-4219-bc22-e6f440fcdef0" returned: 0 in 0.335s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:45:47 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] Lock "cinder-quobyte-1bed98c6-56f5-4219-bc22-e6f440fcdef0" released by "_copy_volume_from_snapshot" :: held 10.474s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:45:47 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] Acquiring lock "cinder-quobyte-ec1be397-edf5-4004-8cd8-1dd1475009df" by "_delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:45:47 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] Lock "cinder-quobyte-ec1be397-edf5-4004-8cd8-1dd1475009df" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:45:47 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] Deleting offline snapshot ec1be397-edf5-4004-8cd8-1dd1475009df of volume 7e5e2539-4fa9-4cbf-b28b-fb206beba313 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 11:45:47 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] snapshot_file for this snap is: volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313.ec1be397-edf5-4004-8cd8-1dd1475009df {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 11:45:47 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f33c627-a71d-47cd-a149-94f858265015]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:45:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313.ec1be397-edf5-4004-8cd8-1dd1475009df {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:45:47 devstack sudo[91323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313.ec1be397-edf5-4004-8cd8-1dd1475009df
Nov 06 11:45:47 devstack sudo[91323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:45:47 devstack sudo[91323]: pam_unix(sudo:session): session closed for user root
Nov 06 11:45:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313.ec1be397-edf5-4004-8cd8-1dd1475009df" returned: 0 in 0.411s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:45:47 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:45:47 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f476a4-9907-46dd-99b3-3f475bea7afe]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:45:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:45:47 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-559a7337-aa9a-44d1-87ee-098eb4f12c03 tempest-GroupSnapshotsTest-422127898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:45:47 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-559a7337-aa9a-44d1-87ee-098eb4f12c03 tempest-GroupSnapshotsTest-422127898 None] Flow 'volume_create_manager' (76e8fdc0-074a-4670-8473-72c688aa5a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:45:47 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-559a7337-aa9a-44d1-87ee-098eb4f12c03 tempest-GroupSnapshotsTest-422127898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2506f5d7-be81-43a9-a827-e9cf1ce07d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:45:47 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-559a7337-aa9a-44d1-87ee-098eb4f12c03 tempest-GroupSnapshotsTest-422127898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2506f5d7-be81-43a9-a827-e9cf1ce07d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:45:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1959567212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a5ecb2ff-17f3-4579-8c58-21e7ecaeb1c2,host='devstack@QuobyteHD#QuobyteHD',id=481dd628-3328-4c8a-a34a-b7fc761f68cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3266d51642f342d58f397aa7393a8e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:45:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:45:48Z,use_quota=True,user_id='eed02d9bb5d7479492dcb8e06e26c4b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(18ba48f1-1b34-4493-b61c-29ca40ca144b),volume_type_id=18ba48f1-1b34-4493-b61c-29ca40ca144b)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:45:47 devstack sudo[91331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313
Nov 06 11:45:47 devstack sudo[91331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:45:47 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-559a7337-aa9a-44d1-87ee-098eb4f12c03 tempest-GroupSnapshotsTest-422127898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bac81cb-3a9b-44b8-979f-6782c763f471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:45:47 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-559a7337-aa9a-44d1-87ee-098eb4f12c03 tempest-GroupSnapshotsTest-422127898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bac81cb-3a9b-44b8-979f-6782c763f471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:45:47 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-559a7337-aa9a-44d1-87ee-098eb4f12c03 tempest-GroupSnapshotsTest-422127898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58fc9b68-d02e-4072-ae1a-30be039d66e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:45:47 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-559a7337-aa9a-44d1-87ee-098eb4f12c03 tempest-GroupSnapshotsTest-422127898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58fc9b68-d02e-4072-ae1a-30be039d66e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '481dd628-3328-4c8a-a34a-b7fc761f68cf', 'volume_name': 'volume-481dd628-3328-4c8a-a34a-b7fc761f68cf', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:45:47 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-559a7337-aa9a-44d1-87ee-098eb4f12c03 tempest-GroupSnapshotsTest-422127898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8263330-804f-4215-b813-fa35d4aa5705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:45:47 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-559a7337-aa9a-44d1-87ee-098eb4f12c03 tempest-GroupSnapshotsTest-422127898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8263330-804f-4215-b813-fa35d4aa5705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:45:47 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-559a7337-aa9a-44d1-87ee-098eb4f12c03 tempest-GroupSnapshotsTest-422127898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (480c60bf-ac09-4b63-b8fd-ebf518dc7c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:45:47 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-559a7337-aa9a-44d1-87ee-098eb4f12c03 tempest-GroupSnapshotsTest-422127898 None] Volume 481dd628-3328-4c8a-a34a-b7fc761f68cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-481dd628-3328-4c8a-a34a-b7fc761f68cf', 'volume_size': 1}
Nov 06 11:45:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-559a7337-aa9a-44d1-87ee-098eb4f12c03 tempest-GroupSnapshotsTest-422127898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:45:48 devstack sudo[91331]: pam_unix(sudo:session): session closed for user root
Nov 06 11:45:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313" returned: 0 in 0.613s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:45:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313.ec1be397-edf5-4004-8cd8-1dd1475009df {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:45:48 devstack sudo[91336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313.ec1be397-edf5-4004-8cd8-1dd1475009df
Nov 06 11:45:48 devstack sudo[91336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:45:48 devstack sudo[91336]: pam_unix(sudo:session): session closed for user root
Nov 06 11:45:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313.ec1be397-edf5-4004-8cd8-1dd1475009df" returned: 0 in 0.409s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:45:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313.ec1be397-edf5-4004-8cd8-1dd1475009df {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:45:48 devstack sudo[91345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313.ec1be397-edf5-4004-8cd8-1dd1475009df
Nov 06 11:45:48 devstack sudo[91345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:45:49 devstack sudo[91345]: pam_unix(sudo:session): session closed for user root
Nov 06 11:45:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313.ec1be397-edf5-4004-8cd8-1dd1475009df" returned: 0 in 0.315s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:45:49 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] Lock "cinder-quobyte-ec1be397-edf5-4004-8cd8-1dd1475009df" released by "_delete_snapshot" :: held 1.888s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:45:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.596s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:45:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-8e4a97ed-cb48-458b-97cf-9d4234e6c8ba tempest-ServerActionsTestOtherA-2004102178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.290s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:45:49 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-8e4a97ed-cb48-458b-97cf-9d4234e6c8ba tempest-ServerActionsTestOtherA-2004102178 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1990927279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09ad69a1-794b-4284-9835-05c87ec3c45d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef3e348d1844d75870ff73c0714265e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:45:41Z,use_quota=True,user_id='afa596603cec4a98815c9ba4368f3ebc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:45:49 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-8e4a97ed-cb48-458b-97cf-9d4234e6c8ba tempest-ServerActionsTestOtherA-2004102178 None] Creating volume 09ad69a1-794b-4284-9835-05c87ec3c45d {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:45:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-8e4a97ed-cb48-458b-97cf-9d4234e6c8ba tempest-ServerActionsTestOtherA-2004102178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:45:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-8e4a97ed-cb48-458b-97cf-9d4234e6c8ba tempest-ServerActionsTestOtherA-2004102178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:45:49 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-8e4a97ed-cb48-458b-97cf-9d4234e6c8ba tempest-ServerActionsTestOtherA-2004102178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:45:49 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-8e4a97ed-cb48-458b-97cf-9d4234e6c8ba tempest-ServerActionsTestOtherA-2004102178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:45:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-8e4a97ed-cb48-458b-97cf-9d4234e6c8ba tempest-ServerActionsTestOtherA-2004102178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:45:49 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-8e4a97ed-cb48-458b-97cf-9d4234e6c8ba tempest-ServerActionsTestOtherA-2004102178 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:45:49 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-8e4a97ed-cb48-458b-97cf-9d4234e6c8ba tempest-ServerActionsTestOtherA-2004102178 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:45:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-8e4a97ed-cb48-458b-97cf-9d4234e6c8ba tempest-ServerActionsTestOtherA-2004102178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-09ad69a1-794b-4284-9835-05c87ec3c45d 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:45:49 devstack sudo[91361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-09ad69a1-794b-4284-9835-05c87ec3c45d 1073741824
Nov 06 11:45:49 devstack sudo[91361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:45:49 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-ccf6f939-a2ce-4c07-a59e-f29e623bd343 tempest-GroupsV314Test-675388203 None] Create group from source-group-8a47f915-9e87-4f9a-8524-5b84780a6086 completed successfully.
Nov 06 11:45:49 devstack sudo[91361]: pam_unix(sudo:session): session closed for user root
Nov 06 11:45:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-8e4a97ed-cb48-458b-97cf-9d4234e6c8ba tempest-ServerActionsTestOtherA-2004102178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-09ad69a1-794b-4284-9835-05c87ec3c45d 1073741824" returned: 0 in 0.523s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:45:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-8e4a97ed-cb48-458b-97cf-9d4234e6c8ba tempest-ServerActionsTestOtherA-2004102178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-09ad69a1-794b-4284-9835-05c87ec3c45d {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:45:49 devstack sudo[91367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-09ad69a1-794b-4284-9835-05c87ec3c45d
Nov 06 11:45:49 devstack sudo[91367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:45:50 devstack sudo[91367]: pam_unix(sudo:session): session closed for user root
Nov 06 11:45:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-8e4a97ed-cb48-458b-97cf-9d4234e6c8ba tempest-ServerActionsTestOtherA-2004102178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-09ad69a1-794b-4284-9835-05c87ec3c45d" returned: 0 in 0.245s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:45:50 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-8e4a97ed-cb48-458b-97cf-9d4234e6c8ba tempest-ServerActionsTestOtherA-2004102178 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:45:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-8e4a97ed-cb48-458b-97cf-9d4234e6c8ba tempest-ServerActionsTestOtherA-2004102178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:45:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-559a7337-aa9a-44d1-87ee-098eb4f12c03 tempest-GroupSnapshotsTest-422127898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.019s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:45:50 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-559a7337-aa9a-44d1-87ee-098eb4f12c03 tempest-GroupSnapshotsTest-422127898 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a5ecb2ff-17f3-4579-8c58-21e7ecaeb1c2,created_at=2026-11-06T10:45:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1959567212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a5ecb2ff-17f3-4579-8c58-21e7ecaeb1c2,host='devstack@QuobyteHD#QuobyteHD',id=481dd628-3328-4c8a-a34a-b7fc761f68cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3266d51642f342d58f397aa7393a8e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:45:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:45:48Z,use_quota=True,user_id='eed02d9bb5d7479492dcb8e06e26c4b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(18ba48f1-1b34-4493-b61c-29ca40ca144b),volume_type_id=18ba48f1-1b34-4493-b61c-29ca40ca144b)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:45:50 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-559a7337-aa9a-44d1-87ee-098eb4f12c03 tempest-GroupSnapshotsTest-422127898 None] Creating volume 481dd628-3328-4c8a-a34a-b7fc761f68cf {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:45:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-559a7337-aa9a-44d1-87ee-098eb4f12c03 tempest-GroupSnapshotsTest-422127898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:45:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-559a7337-aa9a-44d1-87ee-098eb4f12c03 tempest-GroupSnapshotsTest-422127898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:45:50 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-559a7337-aa9a-44d1-87ee-098eb4f12c03 tempest-GroupSnapshotsTest-422127898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:45:50 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-559a7337-aa9a-44d1-87ee-098eb4f12c03 tempest-GroupSnapshotsTest-422127898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:45:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-559a7337-aa9a-44d1-87ee-098eb4f12c03 tempest-GroupSnapshotsTest-422127898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:45:50 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-559a7337-aa9a-44d1-87ee-098eb4f12c03 tempest-GroupSnapshotsTest-422127898 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:45:50 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-559a7337-aa9a-44d1-87ee-098eb4f12c03 tempest-GroupSnapshotsTest-422127898 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:45:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-559a7337-aa9a-44d1-87ee-098eb4f12c03 tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:45:50 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8e4a97ed-cb48-458b-97cf-9d4234e6c8ba tempest-ServerActionsTestOtherA-2004102178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (571f30ce-9f6a-4461-8581-c6480c9fc01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09ad69a1-794b-4284-9835-05c87ec3c45d', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:45:50 devstack sudo[91370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf 1073741824
Nov 06 11:45:50 devstack sudo[91370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:45:50 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8e4a97ed-cb48-458b-97cf-9d4234e6c8ba tempest-ServerActionsTestOtherA-2004102178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be258c8b-ddcf-4fc8-8968-a682e94176c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:45:50 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-8e4a97ed-cb48-458b-97cf-9d4234e6c8ba tempest-ServerActionsTestOtherA-2004102178 None] Volume volume-09ad69a1-794b-4284-9835-05c87ec3c45d (09ad69a1-794b-4284-9835-05c87ec3c45d): created successfully
Nov 06 11:45:50 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8e4a97ed-cb48-458b-97cf-9d4234e6c8ba tempest-ServerActionsTestOtherA-2004102178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be258c8b-ddcf-4fc8-8968-a682e94176c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:45:50 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8e4a97ed-cb48-458b-97cf-9d4234e6c8ba tempest-ServerActionsTestOtherA-2004102178 None] Flow 'volume_create_manager' (e9612776-2d5f-4270-b724-239332116753) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:45:50 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-8e4a97ed-cb48-458b-97cf-9d4234e6c8ba tempest-ServerActionsTestOtherA-2004102178 None] Created volume successfully.
Nov 06 11:45:50 devstack sudo[91370]: pam_unix(sudo:session): session closed for user root
Nov 06 11:45:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-559a7337-aa9a-44d1-87ee-098eb4f12c03 tempest-GroupSnapshotsTest-422127898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf 1073741824" returned: 0 in 0.535s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:45:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-559a7337-aa9a-44d1-87ee-098eb4f12c03 tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:45:50 devstack sudo[91376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf
Nov 06 11:45:50 devstack sudo[91376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:45:50 devstack sudo[91376]: pam_unix(sudo:session): session closed for user root
Nov 06 11:45:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-559a7337-aa9a-44d1-87ee-098eb4f12c03 tempest-GroupSnapshotsTest-422127898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf" returned: 0 in 0.293s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:45:50 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-559a7337-aa9a-44d1-87ee-098eb4f12c03 tempest-GroupSnapshotsTest-422127898 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:45:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-559a7337-aa9a-44d1-87ee-098eb4f12c03 tempest-GroupSnapshotsTest-422127898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:45:50 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-559a7337-aa9a-44d1-87ee-098eb4f12c03 tempest-GroupSnapshotsTest-422127898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (480c60bf-ac09-4b63-b8fd-ebf518dc7c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-481dd628-3328-4c8a-a34a-b7fc761f68cf', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:45:50 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-559a7337-aa9a-44d1-87ee-098eb4f12c03 tempest-GroupSnapshotsTest-422127898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d4e5de8-96cc-442b-bde9-3807b2508057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:45:50 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-559a7337-aa9a-44d1-87ee-098eb4f12c03 tempest-GroupSnapshotsTest-422127898 None] Volume volume-481dd628-3328-4c8a-a34a-b7fc761f68cf (481dd628-3328-4c8a-a34a-b7fc761f68cf): created successfully
Nov 06 11:45:50 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-559a7337-aa9a-44d1-87ee-098eb4f12c03 tempest-GroupSnapshotsTest-422127898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d4e5de8-96cc-442b-bde9-3807b2508057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:45:50 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-559a7337-aa9a-44d1-87ee-098eb4f12c03 tempest-GroupSnapshotsTest-422127898 None] Flow 'volume_create_manager' (76e8fdc0-074a-4670-8473-72c688aa5a89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:45:50 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-559a7337-aa9a-44d1-87ee-098eb4f12c03 tempest-GroupSnapshotsTest-422127898 None] Created volume successfully.
Nov 06 11:45:50 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-3b469bfb-1e1d-41c9-be46-17eb6e672fc9 tempest-GroupsV314Test-675388203 None] Acquiring lock "cinder-quobyte-1bed98c6-56f5-4219-bc22-e6f440fcdef0" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:45:51 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-3b469bfb-1e1d-41c9-be46-17eb6e672fc9 tempest-GroupsV314Test-675388203 None] Lock "cinder-quobyte-1bed98c6-56f5-4219-bc22-e6f440fcdef0" acquired by "delete_volume" :: waited 0.022s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:45:51 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8110c299-a16e-42b9-8955-86df05c436f7]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:45:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3b469bfb-1e1d-41c9-be46-17eb6e672fc9 tempest-GroupsV314Test-675388203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1bed98c6-56f5-4219-bc22-e6f440fcdef0 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:45:51 devstack sudo[91381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1bed98c6-56f5-4219-bc22-e6f440fcdef0
Nov 06 11:45:51 devstack sudo[91381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:45:51 devstack sudo[91381]: pam_unix(sudo:session): session closed for user root
Nov 06 11:45:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3b469bfb-1e1d-41c9-be46-17eb6e672fc9 tempest-GroupsV314Test-675388203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1bed98c6-56f5-4219-bc22-e6f440fcdef0" returned: 0 in 0.675s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:45:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3b469bfb-1e1d-41c9-be46-17eb6e672fc9 tempest-GroupsV314Test-675388203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1bed98c6-56f5-4219-bc22-e6f440fcdef0 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:45:51 devstack sudo[91424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1bed98c6-56f5-4219-bc22-e6f440fcdef0
Nov 06 11:45:51 devstack sudo[91424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:45:52 devstack sudo[91424]: pam_unix(sudo:session): session closed for user root
Nov 06 11:45:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3b469bfb-1e1d-41c9-be46-17eb6e672fc9 tempest-GroupsV314Test-675388203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1bed98c6-56f5-4219-bc22-e6f440fcdef0" returned: 0 in 0.338s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:45:52 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-3b469bfb-1e1d-41c9-be46-17eb6e672fc9 tempest-GroupsV314Test-675388203 None] Lock "cinder-quobyte-1bed98c6-56f5-4219-bc22-e6f440fcdef0" released by "delete_volume" :: held 1.083s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:45:52 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-9995797a-7cfd-4b02-bf54-36c484a43a27 tempest-GroupSnapshotsTest-422127898 None] GroupSnapshot bcb22143-d171-4e7a-b3de-5fe5ac3365e4: creating.
Nov 06 11:45:52 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9995797a-7cfd-4b02-bf54-36c484a43a27 tempest-GroupSnapshotsTest-422127898 None] Group snapshot bcb22143-d171-4e7a-b3de-5fe5ac3365e4: creating. {{(pid=87165) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 06 11:45:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9995797a-7cfd-4b02-bf54-36c484a43a27 tempest-GroupSnapshotsTest-422127898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:45:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9995797a-7cfd-4b02-bf54-36c484a43a27 tempest-GroupSnapshotsTest-422127898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:45:52 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-9995797a-7cfd-4b02-bf54-36c484a43a27 tempest-GroupSnapshotsTest-422127898 None] Creating offline snapshot 4d89fe23-7873-4392-9864-e1d828331144 of volume 481dd628-3328-4c8a-a34a-b7fc761f68cf {{(pid=87165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 11:45:52 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d15802d-076a-4d03-829f-ac7cfaf8b5f2]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:45:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9995797a-7cfd-4b02-bf54-36c484a43a27 tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:45:52 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-3b469bfb-1e1d-41c9-be46-17eb6e672fc9 tempest-GroupsV314Test-675388203 None] Created reservations ['306dfa0f-218e-4095-a4d8-decec2603d49'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:45:52 devstack cinder-volume[87165]: WARNING cinder.quota [None req-3b469bfb-1e1d-41c9-be46-17eb6e672fc9 tempest-GroupsV314Test-675388203 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1671956075 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1671956075, it is now deprecated. Please use the default quota class for default quota.
Nov 06 11:45:52 devstack cinder-volume[87165]: WARNING cinder.quota [None req-3b469bfb-1e1d-41c9-be46-17eb6e672fc9 tempest-GroupsV314Test-675388203 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1671956075 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1671956075, it is now deprecated. Please use the default quota class for default quota.
Nov 06 11:45:52 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-3b469bfb-1e1d-41c9-be46-17eb6e672fc9 tempest-GroupsV314Test-675388203 None] Created reservations ['2524c66b-b3a0-4587-be5c-85b68d333b16', '435660fc-b50f-466d-acb1-fc51e559a458', 'a2311ab1-1068-4939-9fc7-dc92c3bba080', 'fa82ba74-61b0-4b8f-a785-5ed1c7fff14a'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:45:52 devstack sudo[91431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf
Nov 06 11:45:52 devstack sudo[91431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:45:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3b469bfb-1e1d-41c9-be46-17eb6e672fc9 tempest-GroupsV314Test-675388203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:45:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3b469bfb-1e1d-41c9-be46-17eb6e672fc9 tempest-GroupsV314Test-675388203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:45:52 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-3b469bfb-1e1d-41c9-be46-17eb6e672fc9 tempest-GroupsV314Test-675388203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:45:52 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-3b469bfb-1e1d-41c9-be46-17eb6e672fc9 tempest-GroupsV314Test-675388203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:45:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3b469bfb-1e1d-41c9-be46-17eb6e672fc9 tempest-GroupsV314Test-675388203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:45:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3b469bfb-1e1d-41c9-be46-17eb6e672fc9 tempest-GroupsV314Test-675388203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:45:52 devstack sudo[91434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:45:52 devstack sudo[91434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:45:52 devstack sudo[91431]: pam_unix(sudo:session): session closed for user root
Nov 06 11:45:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9995797a-7cfd-4b02-bf54-36c484a43a27 tempest-GroupSnapshotsTest-422127898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf" returned: 0 in 0.458s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:45:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9995797a-7cfd-4b02-bf54-36c484a43a27 tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf.4d89fe23-7873-4392-9864-e1d828331144 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:45:52 devstack sudo[91441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf.4d89fe23-7873-4392-9864-e1d828331144 1G
Nov 06 11:45:52 devstack sudo[91441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:45:52 devstack sudo[91434]: pam_unix(sudo:session): session closed for user root
Nov 06 11:45:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3b469bfb-1e1d-41c9-be46-17eb6e672fc9 tempest-GroupsV314Test-675388203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.278s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:45:52 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-3b469bfb-1e1d-41c9-be46-17eb6e672fc9 tempest-GroupsV314Test-675388203 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:45:52 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-3b469bfb-1e1d-41c9-be46-17eb6e672fc9 tempest-GroupsV314Test-675388203 None] Delete group completed successfully.
Nov 06 11:45:53 devstack sudo[91441]: pam_unix(sudo:session): session closed for user root
Nov 06 11:45:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9995797a-7cfd-4b02-bf54-36c484a43a27 tempest-GroupSnapshotsTest-422127898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf.4d89fe23-7873-4392-9864-e1d828331144 1G" returned: 0 in 0.657s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:45:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9995797a-7cfd-4b02-bf54-36c484a43a27 tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-481dd628-3328-4c8a-a34a-b7fc761f68cf -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf.4d89fe23-7873-4392-9864-e1d828331144 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:45:53 devstack sudo[91452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-481dd628-3328-4c8a-a34a-b7fc761f68cf -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf.4d89fe23-7873-4392-9864-e1d828331144
Nov 06 11:45:53 devstack sudo[91452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:45:54 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-049eebfc-e16d-404d-afa1-3e2ac1fd2d12 tempest-GroupsV314Test-675388203 None] Acquiring lock "cinder-quobyte-7e5e2539-4fa9-4cbf-b28b-fb206beba313" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:45:54 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-049eebfc-e16d-404d-afa1-3e2ac1fd2d12 tempest-GroupsV314Test-675388203 None] Lock "cinder-quobyte-7e5e2539-4fa9-4cbf-b28b-fb206beba313" acquired by "delete_volume" :: waited 0.061s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:45:54 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[53dcec6a-bd5f-424d-9d22-0b32b8e89295]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:45:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-049eebfc-e16d-404d-afa1-3e2ac1fd2d12 tempest-GroupsV314Test-675388203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:45:54 devstack sudo[91452]: pam_unix(sudo:session): session closed for user root
Nov 06 11:45:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9995797a-7cfd-4b02-bf54-36c484a43a27 tempest-GroupSnapshotsTest-422127898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-481dd628-3328-4c8a-a34a-b7fc761f68cf -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf.4d89fe23-7873-4392-9864-e1d828331144" returned: 0 in 0.844s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:45:54 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-9995797a-7cfd-4b02-bf54-36c484a43a27 tempest-GroupSnapshotsTest-422127898 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf.4d89fe23-7873-4392-9864-e1d828331144 is being set with open permissions: ugo+rw: NotImplementedError
Nov 06 11:45:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9995797a-7cfd-4b02-bf54-36c484a43a27 tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf.4d89fe23-7873-4392-9864-e1d828331144 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:45:54 devstack sudo[91481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf.4d89fe23-7873-4392-9864-e1d828331144
Nov 06 11:45:54 devstack sudo[91481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:45:54 devstack sudo[91480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313
Nov 06 11:45:54 devstack sudo[91480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:45:54 devstack sudo[91481]: pam_unix(sudo:session): session closed for user root
Nov 06 11:45:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9995797a-7cfd-4b02-bf54-36c484a43a27 tempest-GroupSnapshotsTest-422127898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf.4d89fe23-7873-4392-9864-e1d828331144" returned: 0 in 0.579s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:45:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9995797a-7cfd-4b02-bf54-36c484a43a27 tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:45:54 devstack sudo[91494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf.info
Nov 06 11:45:54 devstack sudo[91494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:45:54 devstack sudo[91480]: pam_unix(sudo:session): session closed for user root
Nov 06 11:45:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-049eebfc-e16d-404d-afa1-3e2ac1fd2d12 tempest-GroupsV314Test-675388203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313" returned: 0 in 0.722s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:45:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-049eebfc-e16d-404d-afa1-3e2ac1fd2d12 tempest-GroupsV314Test-675388203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:45:55 devstack sudo[91496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313
Nov 06 11:45:55 devstack sudo[91496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:45:55 devstack sudo[91494]: pam_unix(sudo:session): session closed for user root
Nov 06 11:45:55 devstack sudo[91496]: pam_unix(sudo:session): session closed for user root
Nov 06 11:45:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9995797a-7cfd-4b02-bf54-36c484a43a27 tempest-GroupSnapshotsTest-422127898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf.info" returned: 0 in 0.603s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:45:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-049eebfc-e16d-404d-afa1-3e2ac1fd2d12 tempest-GroupsV314Test-675388203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7e5e2539-4fa9-4cbf-b28b-fb206beba313" returned: 0 in 0.532s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:45:55 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-9995797a-7cfd-4b02-bf54-36c484a43a27 tempest-GroupSnapshotsTest-422127898 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 06 11:45:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9995797a-7cfd-4b02-bf54-36c484a43a27 tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:45:55 devstack sudo[91508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf.info
Nov 06 11:45:55 devstack sudo[91508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:45:55 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-049eebfc-e16d-404d-afa1-3e2ac1fd2d12 tempest-GroupsV314Test-675388203 None] Lock "cinder-quobyte-7e5e2539-4fa9-4cbf-b28b-fb206beba313" released by "delete_volume" :: held 1.456s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:45:55 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-049eebfc-e16d-404d-afa1-3e2ac1fd2d12 tempest-GroupsV314Test-675388203 None] Created reservations ['e2dd86e0-22b8-4c31-8742-7d2d7cb8b706'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:45:55 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-049eebfc-e16d-404d-afa1-3e2ac1fd2d12 tempest-GroupsV314Test-675388203 None] Created reservations ['a4b3e717-6edf-499c-b964-9b602d6014b7', '3762f9e8-cb8a-4946-a180-924dd95b1bc4', '7c606717-878f-4c98-9371-a14cb211fd17', '570412e4-5908-4991-83e0-631b361a7795'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:45:55 devstack sudo[91508]: pam_unix(sudo:session): session closed for user root
Nov 06 11:45:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9995797a-7cfd-4b02-bf54-36c484a43a27 tempest-GroupSnapshotsTest-422127898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf.info" returned: 0 in 0.416s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:45:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9995797a-7cfd-4b02-bf54-36c484a43a27 tempest-GroupSnapshotsTest-422127898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.772s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:45:56 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-9995797a-7cfd-4b02-bf54-36c484a43a27 tempest-GroupSnapshotsTest-422127898 None] group_snapshot bcb22143-d171-4e7a-b3de-5fe5ac3365e4: created successfully
Nov 06 11:45:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-049eebfc-e16d-404d-afa1-3e2ac1fd2d12 tempest-GroupsV314Test-675388203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:45:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-049eebfc-e16d-404d-afa1-3e2ac1fd2d12 tempest-GroupsV314Test-675388203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:45:56 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-049eebfc-e16d-404d-afa1-3e2ac1fd2d12 tempest-GroupsV314Test-675388203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:45:56 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-049eebfc-e16d-404d-afa1-3e2ac1fd2d12 tempest-GroupsV314Test-675388203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:45:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-049eebfc-e16d-404d-afa1-3e2ac1fd2d12 tempest-GroupsV314Test-675388203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:45:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-049eebfc-e16d-404d-afa1-3e2ac1fd2d12 tempest-GroupsV314Test-675388203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:45:56 devstack sudo[91541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:45:56 devstack sudo[91541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:45:56 devstack sudo[91541]: pam_unix(sudo:session): session closed for user root
Nov 06 11:45:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-049eebfc-e16d-404d-afa1-3e2ac1fd2d12 tempest-GroupsV314Test-675388203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.496s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:45:56 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-049eebfc-e16d-404d-afa1-3e2ac1fd2d12 tempest-GroupsV314Test-675388203 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:45:56 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-049eebfc-e16d-404d-afa1-3e2ac1fd2d12 tempest-GroupsV314Test-675388203 None] Delete group completed successfully.
Nov 06 11:45:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-337aeea2-166b-4d49-bc47-527b6ff61229 tempest-GroupSnapshotsTest-422127898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:45:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-337aeea2-166b-4d49-bc47-527b6ff61229 tempest-GroupSnapshotsTest-422127898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:45:57 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-337aeea2-166b-4d49-bc47-527b6ff61229 tempest-GroupSnapshotsTest-422127898 None] Acquiring lock "cinder-quobyte-4d89fe23-7873-4392-9864-e1d828331144-c2d79942-3349-4366-959c-d95b5387fdea" by "_create_volume_from_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:45:57 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-337aeea2-166b-4d49-bc47-527b6ff61229 tempest-GroupSnapshotsTest-422127898 None] Lock "cinder-quobyte-4d89fe23-7873-4392-9864-e1d828331144-c2d79942-3349-4366-959c-d95b5387fdea" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:45:57 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-337aeea2-166b-4d49-bc47-527b6ff61229 tempest-GroupSnapshotsTest-422127898 None] Creating volume c2d79942-3349-4366-959c-d95b5387fdea from snapshot 4d89fe23-7873-4392-9864-e1d828331144 {{(pid=87165) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 06 11:45:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-337aeea2-166b-4d49-bc47-527b6ff61229 tempest-GroupSnapshotsTest-422127898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:45:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-337aeea2-166b-4d49-bc47-527b6ff61229 tempest-GroupSnapshotsTest-422127898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:45:57 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-337aeea2-166b-4d49-bc47-527b6ff61229 tempest-GroupSnapshotsTest-422127898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:45:57 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-337aeea2-166b-4d49-bc47-527b6ff61229 tempest-GroupSnapshotsTest-422127898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:45:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-337aeea2-166b-4d49-bc47-527b6ff61229 tempest-GroupSnapshotsTest-422127898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:45:57 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-337aeea2-166b-4d49-bc47-527b6ff61229 tempest-GroupSnapshotsTest-422127898 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:45:57 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-337aeea2-166b-4d49-bc47-527b6ff61229 tempest-GroupSnapshotsTest-422127898 None] Acquiring lock "cinder-quobyte-c2d79942-3349-4366-959c-d95b5387fdea" by "_copy_volume_from_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:45:57 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-337aeea2-166b-4d49-bc47-527b6ff61229 tempest-GroupSnapshotsTest-422127898 None] Lock "cinder-quobyte-c2d79942-3349-4366-959c-d95b5387fdea" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:45:57 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-337aeea2-166b-4d49-bc47-527b6ff61229 tempest-GroupSnapshotsTest-422127898 None] snapshot: 4d89fe23-7873-4392-9864-e1d828331144, volume: c2d79942-3349-4366-959c-d95b5387fdea,  {{(pid=87165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 06 11:45:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-337aeea2-166b-4d49-bc47-527b6ff61229 tempest-GroupSnapshotsTest-422127898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:45:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-337aeea2-166b-4d49-bc47-527b6ff61229 tempest-GroupSnapshotsTest-422127898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:45:57 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-337aeea2-166b-4d49-bc47-527b6ff61229 tempest-GroupSnapshotsTest-422127898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:45:58 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-337aeea2-166b-4d49-bc47-527b6ff61229 tempest-GroupSnapshotsTest-422127898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:45:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-337aeea2-166b-4d49-bc47-527b6ff61229 tempest-GroupSnapshotsTest-422127898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:45:58 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[67525a0d-f61e-458d-9383-721db01aad4c]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:45:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-337aeea2-166b-4d49-bc47-527b6ff61229 tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf.4d89fe23-7873-4392-9864-e1d828331144 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:45:58 devstack sudo[91550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf.4d89fe23-7873-4392-9864-e1d828331144
Nov 06 11:45:58 devstack sudo[91550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:45:58 devstack sudo[91550]: pam_unix(sudo:session): session closed for user root
Nov 06 11:45:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-337aeea2-166b-4d49-bc47-527b6ff61229 tempest-GroupSnapshotsTest-422127898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf.4d89fe23-7873-4392-9864-e1d828331144" returned: 0 in 0.703s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:45:58 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-337aeea2-166b-4d49-bc47-527b6ff61229 tempest-GroupSnapshotsTest-422127898 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-481dd628-3328-4c8a-a34a-b7fc761f68cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:45:58 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f21766-9d92-4f61-8beb-aee55eb15a84]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:45:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-337aeea2-166b-4d49-bc47-527b6ff61229 tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:45:58 devstack sudo[91555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf
Nov 06 11:45:58 devstack sudo[91555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:45:59 devstack sudo[91555]: pam_unix(sudo:session): session closed for user root
Nov 06 11:45:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-337aeea2-166b-4d49-bc47-527b6ff61229 tempest-GroupSnapshotsTest-422127898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf" returned: 0 in 0.560s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:45:59 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-337aeea2-166b-4d49-bc47-527b6ff61229 tempest-GroupSnapshotsTest-422127898 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf {{(pid=87165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 06 11:45:59 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-337aeea2-166b-4d49-bc47-527b6ff61229 tempest-GroupSnapshotsTest-422127898 None] Creating direct copy from snapshot {{(pid=87165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 06 11:45:59 devstack cinder-volume[87165]: DEBUG cinder.utils [None req-337aeea2-166b-4d49-bc47-527b6ff61229 tempest-GroupSnapshotsTest-422127898 None] Path /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c2d79942-3349-4366-959c-d95b5387fdea not found in is_blk_device check {{(pid=87165) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 06 11:45:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-337aeea2-166b-4d49-bc47-527b6ff61229 tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c2d79942-3349-4366-959c-d95b5387fdea {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:45:59 devstack sudo[91562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c2d79942-3349-4366-959c-d95b5387fdea
Nov 06 11:45:59 devstack sudo[91562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:45:59 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-ff292abc-4fc7-4b23-8667-dabd7ec8a9a8 req-420e427d-8547-46a4-9f21-17d9e7525390 tempest-AttachVolumeNegativeTest-993089865 None] Terminate volume connection completed successfully.
Nov 06 11:45:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-ff292abc-4fc7-4b23-8667-dabd7ec8a9a8 req-420e427d-8547-46a4-9f21-17d9e7525390 tempest-AttachVolumeNegativeTest-993089865 None] Deleting attachment 8154b6fd-6483-4d78-801c-62fdb209b446. {{(pid=87165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 11:46:07 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:UPDATE=56,cinder:SELECT=49,cinder:INSERT=8,cinder:DELETE=1 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 11:46:09 devstack sudo[91562]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:09 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-337aeea2-166b-4d49-bc47-527b6ff61229 tempest-GroupSnapshotsTest-422127898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c2d79942-3349-4366-959c-d95b5387fdea" returned: 0 in 10.167s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:09 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-337aeea2-166b-4d49-bc47-527b6ff61229 tempest-GroupSnapshotsTest-422127898 None] Image conversion details: src /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf, size 1024.00 MB, duration 10.17 sec, destination /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c2d79942-3349-4366-959c-d95b5387fdea {{(pid=87165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 11:46:09 devstack cinder-volume[87165]: INFO cinder.image.image_utils [None req-337aeea2-166b-4d49-bc47-527b6ff61229 tempest-GroupSnapshotsTest-422127898 None] Converted 1024.00 MB image at 100.71 MB/s
Nov 06 11:46:09 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-337aeea2-166b-4d49-bc47-527b6ff61229 tempest-GroupSnapshotsTest-422127898 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c2d79942-3349-4366-959c-d95b5387fdea is being set with open permissions: ugo+rw: NotImplementedError
Nov 06 11:46:09 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-337aeea2-166b-4d49-bc47-527b6ff61229 tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c2d79942-3349-4366-959c-d95b5387fdea {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:09 devstack sudo[91648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c2d79942-3349-4366-959c-d95b5387fdea
Nov 06 11:46:09 devstack sudo[91648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:09 devstack sudo[91648]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:09 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-337aeea2-166b-4d49-bc47-527b6ff61229 tempest-GroupSnapshotsTest-422127898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c2d79942-3349-4366-959c-d95b5387fdea" returned: 0 in 0.271s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:09 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-337aeea2-166b-4d49-bc47-527b6ff61229 tempest-GroupSnapshotsTest-422127898 None] Lock "cinder-quobyte-c2d79942-3349-4366-959c-d95b5387fdea" released by "_copy_volume_from_snapshot" :: held 11.846s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:46:09 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-337aeea2-166b-4d49-bc47-527b6ff61229 tempest-GroupSnapshotsTest-422127898 None] Lock "cinder-quobyte-4d89fe23-7873-4392-9864-e1d828331144-c2d79942-3349-4366-959c-d95b5387fdea" released by "_create_volume_from_snapshot" :: held 11.978s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:46:09 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-337aeea2-166b-4d49-bc47-527b6ff61229 tempest-GroupSnapshotsTest-422127898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.008s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:46:09 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-337aeea2-166b-4d49-bc47-527b6ff61229 tempest-GroupSnapshotsTest-422127898 None] Create group from source-snapshot-bcb22143-d171-4e7a-b3de-5fe5ac3365e4 completed successfully.
Nov 06 11:46:11 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-408b5b1c-139f-4324-a75b-9a33b9b1f9e6 tempest-GroupSnapshotsTest-422127898 None] Acquiring lock "cinder-quobyte-c2d79942-3349-4366-959c-d95b5387fdea" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:46:11 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-408b5b1c-139f-4324-a75b-9a33b9b1f9e6 tempest-GroupSnapshotsTest-422127898 None] Lock "cinder-quobyte-c2d79942-3349-4366-959c-d95b5387fdea" acquired by "delete_volume" :: waited 0.024s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:46:11 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f47209-2492-47c6-a9aa-a678e81d5dad]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:46:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-408b5b1c-139f-4324-a75b-9a33b9b1f9e6 tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c2d79942-3349-4366-959c-d95b5387fdea {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:11 devstack sudo[91651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c2d79942-3349-4366-959c-d95b5387fdea
Nov 06 11:46:11 devstack sudo[91651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:12 devstack sudo[91651]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-408b5b1c-139f-4324-a75b-9a33b9b1f9e6 tempest-GroupSnapshotsTest-422127898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c2d79942-3349-4366-959c-d95b5387fdea" returned: 0 in 0.397s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-408b5b1c-139f-4324-a75b-9a33b9b1f9e6 tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c2d79942-3349-4366-959c-d95b5387fdea {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:12 devstack sudo[91656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c2d79942-3349-4366-959c-d95b5387fdea
Nov 06 11:46:12 devstack sudo[91656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:12 devstack sudo[91656]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-408b5b1c-139f-4324-a75b-9a33b9b1f9e6 tempest-GroupSnapshotsTest-422127898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c2d79942-3349-4366-959c-d95b5387fdea" returned: 0 in 0.285s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:12 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-408b5b1c-139f-4324-a75b-9a33b9b1f9e6 tempest-GroupSnapshotsTest-422127898 None] Lock "cinder-quobyte-c2d79942-3349-4366-959c-d95b5387fdea" released by "delete_volume" :: held 0.745s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:46:12 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-408b5b1c-139f-4324-a75b-9a33b9b1f9e6 tempest-GroupSnapshotsTest-422127898 None] Created reservations ['abfc7e83-7506-4d7a-9570-9d9347313bbc'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:46:12 devstack cinder-volume[87165]: WARNING cinder.quota [None req-408b5b1c-139f-4324-a75b-9a33b9b1f9e6 tempest-GroupSnapshotsTest-422127898 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-895352819 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-895352819, it is now deprecated. Please use the default quota class for default quota.
Nov 06 11:46:12 devstack cinder-volume[87165]: WARNING cinder.quota [None req-408b5b1c-139f-4324-a75b-9a33b9b1f9e6 tempest-GroupSnapshotsTest-422127898 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-895352819 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-895352819, it is now deprecated. Please use the default quota class for default quota.
Nov 06 11:46:12 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-408b5b1c-139f-4324-a75b-9a33b9b1f9e6 tempest-GroupSnapshotsTest-422127898 None] Created reservations ['46666170-0473-4bab-977c-ab479ac47473', '0de6a2a3-3491-4ae2-b4ae-a1d70461e18f', '1277abdf-5e33-4963-93e0-07c228db2063', '9f7de123-baeb-48c6-aa26-5b4c83802709'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:46:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-408b5b1c-139f-4324-a75b-9a33b9b1f9e6 tempest-GroupSnapshotsTest-422127898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:46:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-408b5b1c-139f-4324-a75b-9a33b9b1f9e6 tempest-GroupSnapshotsTest-422127898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:46:12 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-408b5b1c-139f-4324-a75b-9a33b9b1f9e6 tempest-GroupSnapshotsTest-422127898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:46:12 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-408b5b1c-139f-4324-a75b-9a33b9b1f9e6 tempest-GroupSnapshotsTest-422127898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:46:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-408b5b1c-139f-4324-a75b-9a33b9b1f9e6 tempest-GroupSnapshotsTest-422127898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:46:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-408b5b1c-139f-4324-a75b-9a33b9b1f9e6 tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:12 devstack sudo[91659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:46:12 devstack sudo[91659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:12 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-04d33c7c-38f3-4df9-80b6-30a0da3389b6 tempest-GroupSnapshotsTest-422127898 None] group_snapshot bcb22143-d171-4e7a-b3de-5fe5ac3365e4: deleting
Nov 06 11:46:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-04d33c7c-38f3-4df9-80b6-30a0da3389b6 tempest-GroupSnapshotsTest-422127898 None] group_snapshot bcb22143-d171-4e7a-b3de-5fe5ac3365e4: deleting {{(pid=87165) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 06 11:46:13 devstack sudo[91659]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-408b5b1c-139f-4324-a75b-9a33b9b1f9e6 tempest-GroupSnapshotsTest-422127898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.336s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:13 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-408b5b1c-139f-4324-a75b-9a33b9b1f9e6 tempest-GroupSnapshotsTest-422127898 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:46:13 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-04d33c7c-38f3-4df9-80b6-30a0da3389b6 tempest-GroupSnapshotsTest-422127898 None] Acquiring lock "cinder-quobyte-481dd628-3328-4c8a-a34a-b7fc761f68cf" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:46:13 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-408b5b1c-139f-4324-a75b-9a33b9b1f9e6 tempest-GroupSnapshotsTest-422127898 None] Delete group completed successfully.
Nov 06 11:46:13 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-04d33c7c-38f3-4df9-80b6-30a0da3389b6 tempest-GroupSnapshotsTest-422127898 None] Lock "cinder-quobyte-481dd628-3328-4c8a-a34a-b7fc761f68cf" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:46:13 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-04d33c7c-38f3-4df9-80b6-30a0da3389b6 tempest-GroupSnapshotsTest-422127898 None] Acquiring lock "cinder-quobyte-4d89fe23-7873-4392-9864-e1d828331144" by "_delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:46:13 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-04d33c7c-38f3-4df9-80b6-30a0da3389b6 tempest-GroupSnapshotsTest-422127898 None] Lock "cinder-quobyte-4d89fe23-7873-4392-9864-e1d828331144" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:46:13 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-04d33c7c-38f3-4df9-80b6-30a0da3389b6 tempest-GroupSnapshotsTest-422127898 None] Deleting offline snapshot 4d89fe23-7873-4392-9864-e1d828331144 of volume 481dd628-3328-4c8a-a34a-b7fc761f68cf {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 11:46:13 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-04d33c7c-38f3-4df9-80b6-30a0da3389b6 tempest-GroupSnapshotsTest-422127898 None] snapshot_file for this snap is: volume-481dd628-3328-4c8a-a34a-b7fc761f68cf.4d89fe23-7873-4392-9864-e1d828331144 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 11:46:13 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb23f48-d055-4313-bdce-0e427f73fd61]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:46:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-04d33c7c-38f3-4df9-80b6-30a0da3389b6 tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf.4d89fe23-7873-4392-9864-e1d828331144 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:13 devstack sudo[91665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf.4d89fe23-7873-4392-9864-e1d828331144
Nov 06 11:46:13 devstack sudo[91665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:13 devstack sudo[91665]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-04d33c7c-38f3-4df9-80b6-30a0da3389b6 tempest-GroupSnapshotsTest-422127898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf.4d89fe23-7873-4392-9864-e1d828331144" returned: 0 in 0.421s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:13 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-04d33c7c-38f3-4df9-80b6-30a0da3389b6 tempest-GroupSnapshotsTest-422127898 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-481dd628-3328-4c8a-a34a-b7fc761f68cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:46:13 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[234b1c79-f70b-400e-a07c-17df1d636c4a]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:46:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-04d33c7c-38f3-4df9-80b6-30a0da3389b6 tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:13 devstack sudo[91671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf
Nov 06 11:46:13 devstack sudo[91671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:14 devstack sudo[91671]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-04d33c7c-38f3-4df9-80b6-30a0da3389b6 tempest-GroupSnapshotsTest-422127898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf" returned: 0 in 0.564s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-04d33c7c-38f3-4df9-80b6-30a0da3389b6 tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf.4d89fe23-7873-4392-9864-e1d828331144 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:14 devstack sudo[91678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf.4d89fe23-7873-4392-9864-e1d828331144
Nov 06 11:46:14 devstack sudo[91678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:14 devstack sudo[91678]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-04d33c7c-38f3-4df9-80b6-30a0da3389b6 tempest-GroupSnapshotsTest-422127898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf.4d89fe23-7873-4392-9864-e1d828331144" returned: 0 in 0.525s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-04d33c7c-38f3-4df9-80b6-30a0da3389b6 tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf.4d89fe23-7873-4392-9864-e1d828331144 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:14 devstack sudo[91683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf.4d89fe23-7873-4392-9864-e1d828331144
Nov 06 11:46:14 devstack sudo[91683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:15 devstack sudo[91683]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-04d33c7c-38f3-4df9-80b6-30a0da3389b6 tempest-GroupSnapshotsTest-422127898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf.4d89fe23-7873-4392-9864-e1d828331144" returned: 0 in 0.373s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:15 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-04d33c7c-38f3-4df9-80b6-30a0da3389b6 tempest-GroupSnapshotsTest-422127898 None] Lock "cinder-quobyte-4d89fe23-7873-4392-9864-e1d828331144" released by "_delete_snapshot" :: held 2.059s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:46:15 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-04d33c7c-38f3-4df9-80b6-30a0da3389b6 tempest-GroupSnapshotsTest-422127898 None] Lock "cinder-quobyte-481dd628-3328-4c8a-a34a-b7fc761f68cf" released by "delete_snapshot" :: held 2.115s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:46:15 devstack cinder-volume[87165]: WARNING cinder.quota [None req-04d33c7c-38f3-4df9-80b6-30a0da3389b6 tempest-GroupSnapshotsTest-422127898 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-895352819 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-895352819, it is now deprecated. Please use the default quota class for default quota.
Nov 06 11:46:15 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-04d33c7c-38f3-4df9-80b6-30a0da3389b6 tempest-GroupSnapshotsTest-422127898 None] Created reservations ['d2434571-ada1-40fe-be3d-52c454e291d2', '7ca3939e-f9c9-43df-82e7-df178d376c22', '19b9b3aa-ca11-46bb-819c-bdc827cf7e29', '0591222c-1287-430c-8beb-914ae3374e90'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:46:15 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-04d33c7c-38f3-4df9-80b6-30a0da3389b6 tempest-GroupSnapshotsTest-422127898 None] group_snapshot bcb22143-d171-4e7a-b3de-5fe5ac3365e4: deleted successfully
Nov 06 11:46:16 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-6cb9ab73-321e-47ab-bab2-9588f4ffee93 tempest-GroupSnapshotsTest-422127898 None] Acquiring lock "cinder-quobyte-481dd628-3328-4c8a-a34a-b7fc761f68cf" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:46:16 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-6cb9ab73-321e-47ab-bab2-9588f4ffee93 tempest-GroupSnapshotsTest-422127898 None] Lock "cinder-quobyte-481dd628-3328-4c8a-a34a-b7fc761f68cf" acquired by "delete_volume" :: waited 0.027s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:46:16 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c10a6a-0bbd-42be-bbd6-8def8a156d18]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:46:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6cb9ab73-321e-47ab-bab2-9588f4ffee93 tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:17 devstack sudo[91704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf
Nov 06 11:46:17 devstack sudo[91704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:17 devstack cinder-volume[87165]: DEBUG oslo_service.periodic_task [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 11:46:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:46:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:46:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:46:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:46:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:46:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:17 devstack sudo[91706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:46:17 devstack sudo[91706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:17 devstack sudo[91704]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6cb9ab73-321e-47ab-bab2-9588f4ffee93 tempest-GroupSnapshotsTest-422127898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf" returned: 0 in 0.514s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6cb9ab73-321e-47ab-bab2-9588f4ffee93 tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:17 devstack sudo[91706]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.380s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:17 devstack sudo[91715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf
Nov 06 11:46:17 devstack sudo[91715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:17 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:46:17 devstack cinder-volume[87165]: DEBUG oslo_service.periodic_task [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running periodic task VolumeManager._thread_info {{(pid=87165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 11:46:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] thread count: 8 {{(pid=87165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 11:46:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] thread info: [<_MainThread(MainThread, started 127732956901504)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127732842693056)>, <Thread(Thread-3 (stat_writer), started daemon 127732841891136)>, <Thread(Rabbit-heartbeat, started daemon 127732842515648)>, <Thread(Thread-5 (_runner), started daemon 127732840534464)>, <Thread(Thread-7 (_runner), started daemon 127732840636032)>, <Thread(fd_logger, started daemon 127732838664256)>, <Thread(privsep_reader, started daemon 127732838673408)>] {{(pid=87165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 11:46:17 devstack sudo[91715]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6cb9ab73-321e-47ab-bab2-9588f4ffee93 tempest-GroupSnapshotsTest-422127898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-481dd628-3328-4c8a-a34a-b7fc761f68cf" returned: 0 in 0.328s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:17 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-6cb9ab73-321e-47ab-bab2-9588f4ffee93 tempest-GroupSnapshotsTest-422127898 None] Lock "cinder-quobyte-481dd628-3328-4c8a-a34a-b7fc761f68cf" released by "delete_volume" :: held 0.978s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:46:17 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-6cb9ab73-321e-47ab-bab2-9588f4ffee93 tempest-GroupSnapshotsTest-422127898 None] Created reservations ['4e0d8c48-e723-4904-98f5-0ab7d0ac7416'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:46:18 devstack cinder-volume[87165]: WARNING cinder.db.api [None req-6cb9ab73-321e-47ab-bab2-9588f4ffee93 tempest-GroupSnapshotsTest-422127898 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-895352819']
Nov 06 11:46:18 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-6cb9ab73-321e-47ab-bab2-9588f4ffee93 tempest-GroupSnapshotsTest-422127898 None] Created reservations ['ccd58280-129e-43d2-94b8-6266bc767e76', '85e3272e-04a1-4745-81d8-381a9e950620', 'df5ce55e-4c95-42e6-92ca-dc1bde9e79d2', 'f68a1a37-57dc-4246-b198-81fe3390f2bb'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:46:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6cb9ab73-321e-47ab-bab2-9588f4ffee93 tempest-GroupSnapshotsTest-422127898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:46:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6cb9ab73-321e-47ab-bab2-9588f4ffee93 tempest-GroupSnapshotsTest-422127898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:46:18 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-6cb9ab73-321e-47ab-bab2-9588f4ffee93 tempest-GroupSnapshotsTest-422127898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:46:18 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-6cb9ab73-321e-47ab-bab2-9588f4ffee93 tempest-GroupSnapshotsTest-422127898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:46:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6cb9ab73-321e-47ab-bab2-9588f4ffee93 tempest-GroupSnapshotsTest-422127898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:46:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6cb9ab73-321e-47ab-bab2-9588f4ffee93 tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:18 devstack sudo[91761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:46:18 devstack sudo[91761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:19 devstack sudo[91761]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6cb9ab73-321e-47ab-bab2-9588f4ffee93 tempest-GroupSnapshotsTest-422127898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.636s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:19 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-6cb9ab73-321e-47ab-bab2-9588f4ffee93 tempest-GroupSnapshotsTest-422127898 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:46:19 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-6cb9ab73-321e-47ab-bab2-9588f4ffee93 tempest-GroupSnapshotsTest-422127898 None] Delete group completed successfully.
Nov 06 11:46:19 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-6e9aa878-f7da-4132-be58-0c9b4e5446b6 tempest-GroupSnapshotsTest-422127898 None] Group tempest-GroupSnapshotsTest-Group-1903452096: creating
Nov 06 11:46:19 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-6e9aa878-f7da-4132-be58-0c9b4e5446b6 tempest-GroupSnapshotsTest-422127898 None] Group tempest-GroupSnapshotsTest-Group-1903452096: created successfully
Nov 06 11:46:19 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-6e9aa878-f7da-4132-be58-0c9b4e5446b6 tempest-GroupSnapshotsTest-422127898 None] Create group completed successfully.
Nov 06 11:46:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-419be4cc-0059-474e-8e28-df133ebe9c80 req-c97a03a2-411b-4df7-8b5f-35cd89814eff tempest-ServerActionsTestOtherA-2004102178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:46:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-419be4cc-0059-474e-8e28-df133ebe9c80 req-c97a03a2-411b-4df7-8b5f-35cd89814eff tempest-ServerActionsTestOtherA-2004102178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:46:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-419be4cc-0059-474e-8e28-df133ebe9c80 req-c97a03a2-411b-4df7-8b5f-35cd89814eff tempest-ServerActionsTestOtherA-2004102178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:46:20 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-419be4cc-0059-474e-8e28-df133ebe9c80 req-c97a03a2-411b-4df7-8b5f-35cd89814eff tempest-ServerActionsTestOtherA-2004102178 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50', 'name': 'volume-09ad69a1-794b-4284-9835-05c87ec3c45d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '940dc518-85e4-4c1d-8f53-604502741f12', 'enforce_multipath': True} {{(pid=87165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 11:46:20 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-419be4cc-0059-474e-8e28-df133ebe9c80 req-c97a03a2-411b-4df7-8b5f-35cd89814eff tempest-ServerActionsTestOtherA-2004102178 None] attachment_update completed successfully.
Nov 06 11:46:21 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef1fee4c-1e1c-4a9c-8cf1-6b5106112c77 tempest-GroupSnapshotsTest-422127898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:46:21 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ef1fee4c-1e1c-4a9c-8cf1-6b5106112c77 tempest-GroupSnapshotsTest-422127898 None] Flow 'volume_create_manager' (c9c9d2c3-2e28-4995-ab87-e9b1cc1d0071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:46:21 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ef1fee4c-1e1c-4a9c-8cf1-6b5106112c77 tempest-GroupSnapshotsTest-422127898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75d31d55-012d-4713-b42d-f4f913e47153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:46:21 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ef1fee4c-1e1c-4a9c-8cf1-6b5106112c77 tempest-GroupSnapshotsTest-422127898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75d31d55-012d-4713-b42d-f4f913e47153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-987327927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=bcdc81ef-7fcd-4f31-ab7b-22edc7d5e067,host='devstack@QuobyteHD#QuobyteHD',id=77b65ac4-8df2-41a8-8ca7-4835c7ae4795,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3266d51642f342d58f397aa7393a8e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:46:22Z,use_quota=True,user_id='eed02d9bb5d7479492dcb8e06e26c4b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02c1d19a-9487-42b1-b0ce-cfbb353afd82),volume_type_id=02c1d19a-9487-42b1-b0ce-cfbb353afd82)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:46:21 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ef1fee4c-1e1c-4a9c-8cf1-6b5106112c77 tempest-GroupSnapshotsTest-422127898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (029ba068-b32f-44cd-8e4b-9fb6d5e053a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:46:21 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ef1fee4c-1e1c-4a9c-8cf1-6b5106112c77 tempest-GroupSnapshotsTest-422127898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (029ba068-b32f-44cd-8e4b-9fb6d5e053a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:46:21 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ef1fee4c-1e1c-4a9c-8cf1-6b5106112c77 tempest-GroupSnapshotsTest-422127898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20ea6a4b-3c4a-46bc-96c5-6ebb074fb56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:46:21 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ef1fee4c-1e1c-4a9c-8cf1-6b5106112c77 tempest-GroupSnapshotsTest-422127898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20ea6a4b-3c4a-46bc-96c5-6ebb074fb56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77b65ac4-8df2-41a8-8ca7-4835c7ae4795', 'volume_name': 'volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:46:21 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ef1fee4c-1e1c-4a9c-8cf1-6b5106112c77 tempest-GroupSnapshotsTest-422127898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1037b888-7af4-4b57-a514-f5e3192ec062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:46:21 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ef1fee4c-1e1c-4a9c-8cf1-6b5106112c77 tempest-GroupSnapshotsTest-422127898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1037b888-7af4-4b57-a514-f5e3192ec062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:46:21 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ef1fee4c-1e1c-4a9c-8cf1-6b5106112c77 tempest-GroupSnapshotsTest-422127898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (242380f8-2b3c-49ac-b0f4-6d9d8dfc91ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:46:21 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-ef1fee4c-1e1c-4a9c-8cf1-6b5106112c77 tempest-GroupSnapshotsTest-422127898 None] Volume 77b65ac4-8df2-41a8-8ca7-4835c7ae4795: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795', 'volume_size': 1}
Nov 06 11:46:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ef1fee4c-1e1c-4a9c-8cf1-6b5106112c77 tempest-GroupSnapshotsTest-422127898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:46:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ef1fee4c-1e1c-4a9c-8cf1-6b5106112c77 tempest-GroupSnapshotsTest-422127898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:46:22 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ef1fee4c-1e1c-4a9c-8cf1-6b5106112c77 tempest-GroupSnapshotsTest-422127898 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=bcdc81ef-7fcd-4f31-ab7b-22edc7d5e067,created_at=2026-11-06T10:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-987327927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=bcdc81ef-7fcd-4f31-ab7b-22edc7d5e067,host='devstack@QuobyteHD#QuobyteHD',id=77b65ac4-8df2-41a8-8ca7-4835c7ae4795,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3266d51642f342d58f397aa7393a8e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:46:22Z,use_quota=True,user_id='eed02d9bb5d7479492dcb8e06e26c4b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02c1d19a-9487-42b1-b0ce-cfbb353afd82),volume_type_id=02c1d19a-9487-42b1-b0ce-cfbb353afd82)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:46:22 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-ef1fee4c-1e1c-4a9c-8cf1-6b5106112c77 tempest-GroupSnapshotsTest-422127898 None] Creating volume 77b65ac4-8df2-41a8-8ca7-4835c7ae4795 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:46:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ef1fee4c-1e1c-4a9c-8cf1-6b5106112c77 tempest-GroupSnapshotsTest-422127898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:46:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ef1fee4c-1e1c-4a9c-8cf1-6b5106112c77 tempest-GroupSnapshotsTest-422127898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:46:22 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ef1fee4c-1e1c-4a9c-8cf1-6b5106112c77 tempest-GroupSnapshotsTest-422127898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:46:22 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ef1fee4c-1e1c-4a9c-8cf1-6b5106112c77 tempest-GroupSnapshotsTest-422127898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:46:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ef1fee4c-1e1c-4a9c-8cf1-6b5106112c77 tempest-GroupSnapshotsTest-422127898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:46:22 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ef1fee4c-1e1c-4a9c-8cf1-6b5106112c77 tempest-GroupSnapshotsTest-422127898 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:46:22 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-ef1fee4c-1e1c-4a9c-8cf1-6b5106112c77 tempest-GroupSnapshotsTest-422127898 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:46:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ef1fee4c-1e1c-4a9c-8cf1-6b5106112c77 tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:22 devstack sudo[92218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795 1073741824
Nov 06 11:46:22 devstack sudo[92218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:22 devstack sudo[92218]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ef1fee4c-1e1c-4a9c-8cf1-6b5106112c77 tempest-GroupSnapshotsTest-422127898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795 1073741824" returned: 0 in 0.961s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ef1fee4c-1e1c-4a9c-8cf1-6b5106112c77 tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:23 devstack sudo[92224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795
Nov 06 11:46:23 devstack sudo[92224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:23 devstack sudo[92224]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ef1fee4c-1e1c-4a9c-8cf1-6b5106112c77 tempest-GroupSnapshotsTest-422127898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795" returned: 0 in 0.487s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:23 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ef1fee4c-1e1c-4a9c-8cf1-6b5106112c77 tempest-GroupSnapshotsTest-422127898 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:46:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ef1fee4c-1e1c-4a9c-8cf1-6b5106112c77 tempest-GroupSnapshotsTest-422127898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.602s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:46:23 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ef1fee4c-1e1c-4a9c-8cf1-6b5106112c77 tempest-GroupSnapshotsTest-422127898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (242380f8-2b3c-49ac-b0f4-6d9d8dfc91ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:46:23 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ef1fee4c-1e1c-4a9c-8cf1-6b5106112c77 tempest-GroupSnapshotsTest-422127898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20681c80-d113-4580-9051-c06ef889fca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:46:23 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-ef1fee4c-1e1c-4a9c-8cf1-6b5106112c77 tempest-GroupSnapshotsTest-422127898 None] Volume volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795 (77b65ac4-8df2-41a8-8ca7-4835c7ae4795): created successfully
Nov 06 11:46:23 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ef1fee4c-1e1c-4a9c-8cf1-6b5106112c77 tempest-GroupSnapshotsTest-422127898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20681c80-d113-4580-9051-c06ef889fca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:46:23 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ef1fee4c-1e1c-4a9c-8cf1-6b5106112c77 tempest-GroupSnapshotsTest-422127898 None] Flow 'volume_create_manager' (c9c9d2c3-2e28-4995-ab87-e9b1cc1d0071) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:46:23 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-ef1fee4c-1e1c-4a9c-8cf1-6b5106112c77 tempest-GroupSnapshotsTest-422127898 None] Created volume successfully.
Nov 06 11:46:25 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-25dc450c-d62d-4160-9e9e-f922a02729d5 req-c509eb8d-791e-4d91-8f15-99644807c5dc tempest-ServerActionsTestOtherA-2004102178 None] Terminate volume connection completed successfully.
Nov 06 11:46:25 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-25dc450c-d62d-4160-9e9e-f922a02729d5 req-c509eb8d-791e-4d91-8f15-99644807c5dc tempest-ServerActionsTestOtherA-2004102178 None] Deleting attachment 940dc518-85e4-4c1d-8f53-604502741f12. {{(pid=87165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 11:46:26 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c67633d-6ce3-4bbc-809c-baf0c5ffc14d tempest-GroupSnapshotsTest-422127898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:46:26 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-0c67633d-6ce3-4bbc-809c-baf0c5ffc14d tempest-GroupSnapshotsTest-422127898 None] Flow 'volume_create_manager' (d1b34ef8-8bab-4341-8b16-0b74e04f69c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:46:26 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-0c67633d-6ce3-4bbc-809c-baf0c5ffc14d tempest-GroupSnapshotsTest-422127898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1b855ba-5cf1-46a7-9f22-47543048dab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:46:26 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-0c67633d-6ce3-4bbc-809c-baf0c5ffc14d tempest-GroupSnapshotsTest-422127898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1b855ba-5cf1-46a7-9f22-47543048dab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-353177902',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=bcdc81ef-7fcd-4f31-ab7b-22edc7d5e067,host='devstack@QuobyteHD#QuobyteHD',id=d76d31aa-9ef6-4660-9324-096d7b3ae9df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3266d51642f342d58f397aa7393a8e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:46:26Z,use_quota=True,user_id='eed02d9bb5d7479492dcb8e06e26c4b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02c1d19a-9487-42b1-b0ce-cfbb353afd82),volume_type_id=02c1d19a-9487-42b1-b0ce-cfbb353afd82)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:46:26 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-0c67633d-6ce3-4bbc-809c-baf0c5ffc14d tempest-GroupSnapshotsTest-422127898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68a1d290-5541-472a-9b9b-2969ed7d7b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:46:26 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-0c67633d-6ce3-4bbc-809c-baf0c5ffc14d tempest-GroupSnapshotsTest-422127898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68a1d290-5541-472a-9b9b-2969ed7d7b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:46:26 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-0c67633d-6ce3-4bbc-809c-baf0c5ffc14d tempest-GroupSnapshotsTest-422127898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee04332a-3e05-460e-a3e9-fe2b2b366234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:46:26 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-0c67633d-6ce3-4bbc-809c-baf0c5ffc14d tempest-GroupSnapshotsTest-422127898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee04332a-3e05-460e-a3e9-fe2b2b366234) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd76d31aa-9ef6-4660-9324-096d7b3ae9df', 'volume_name': 'volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:46:26 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-0c67633d-6ce3-4bbc-809c-baf0c5ffc14d tempest-GroupSnapshotsTest-422127898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (211c1ea3-713d-4fca-95b7-5abc1c7427a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:46:26 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-0c67633d-6ce3-4bbc-809c-baf0c5ffc14d tempest-GroupSnapshotsTest-422127898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (211c1ea3-713d-4fca-95b7-5abc1c7427a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:46:26 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-0c67633d-6ce3-4bbc-809c-baf0c5ffc14d tempest-GroupSnapshotsTest-422127898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbfa9b53-c1ce-4c09-b86a-7bfa3236acfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:46:26 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-0c67633d-6ce3-4bbc-809c-baf0c5ffc14d tempest-GroupSnapshotsTest-422127898 None] Volume d76d31aa-9ef6-4660-9324-096d7b3ae9df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df', 'volume_size': 1}
Nov 06 11:46:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-0c67633d-6ce3-4bbc-809c-baf0c5ffc14d tempest-GroupSnapshotsTest-422127898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:46:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-0c67633d-6ce3-4bbc-809c-baf0c5ffc14d tempest-GroupSnapshotsTest-422127898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:46:26 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-0c67633d-6ce3-4bbc-809c-baf0c5ffc14d tempest-GroupSnapshotsTest-422127898 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=bcdc81ef-7fcd-4f31-ab7b-22edc7d5e067,created_at=2026-11-06T10:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-353177902',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=bcdc81ef-7fcd-4f31-ab7b-22edc7d5e067,host='devstack@QuobyteHD#QuobyteHD',id=d76d31aa-9ef6-4660-9324-096d7b3ae9df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3266d51642f342d58f397aa7393a8e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:46:26Z,use_quota=True,user_id='eed02d9bb5d7479492dcb8e06e26c4b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02c1d19a-9487-42b1-b0ce-cfbb353afd82),volume_type_id=02c1d19a-9487-42b1-b0ce-cfbb353afd82)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:46:26 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-0c67633d-6ce3-4bbc-809c-baf0c5ffc14d tempest-GroupSnapshotsTest-422127898 None] Creating volume d76d31aa-9ef6-4660-9324-096d7b3ae9df {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:46:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-0c67633d-6ce3-4bbc-809c-baf0c5ffc14d tempest-GroupSnapshotsTest-422127898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:46:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-0c67633d-6ce3-4bbc-809c-baf0c5ffc14d tempest-GroupSnapshotsTest-422127898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:46:26 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-0c67633d-6ce3-4bbc-809c-baf0c5ffc14d tempest-GroupSnapshotsTest-422127898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:46:26 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-0c67633d-6ce3-4bbc-809c-baf0c5ffc14d tempest-GroupSnapshotsTest-422127898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:46:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-0c67633d-6ce3-4bbc-809c-baf0c5ffc14d tempest-GroupSnapshotsTest-422127898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:46:26 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-0c67633d-6ce3-4bbc-809c-baf0c5ffc14d tempest-GroupSnapshotsTest-422127898 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:46:26 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-0c67633d-6ce3-4bbc-809c-baf0c5ffc14d tempest-GroupSnapshotsTest-422127898 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:46:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0c67633d-6ce3-4bbc-809c-baf0c5ffc14d tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:26 devstack sudo[92288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df 1073741824
Nov 06 11:46:26 devstack sudo[92288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-25dc450c-d62d-4160-9e9e-f922a02729d5 req-0a27136d-c7a0-47cf-9327-808c58d3f78c tempest-ServerActionsTestOtherA-2004102178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:46:27 devstack sudo[92288]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0c67633d-6ce3-4bbc-809c-baf0c5ffc14d tempest-GroupSnapshotsTest-422127898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df 1073741824" returned: 0 in 0.925s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0c67633d-6ce3-4bbc-809c-baf0c5ffc14d tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:27 devstack sudo[92299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df
Nov 06 11:46:27 devstack sudo[92299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:27 devstack sudo[92299]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0c67633d-6ce3-4bbc-809c-baf0c5ffc14d tempest-GroupSnapshotsTest-422127898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df" returned: 0 in 0.246s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:27 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-0c67633d-6ce3-4bbc-809c-baf0c5ffc14d tempest-GroupSnapshotsTest-422127898 None] <== create_volume: return (1256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:46:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-0c67633d-6ce3-4bbc-809c-baf0c5ffc14d tempest-GroupSnapshotsTest-422127898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.265s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:46:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-25dc450c-d62d-4160-9e9e-f922a02729d5 req-0a27136d-c7a0-47cf-9327-808c58d3f78c tempest-ServerActionsTestOtherA-2004102178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.700s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:46:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-25dc450c-d62d-4160-9e9e-f922a02729d5 req-0a27136d-c7a0-47cf-9327-808c58d3f78c tempest-ServerActionsTestOtherA-2004102178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:46:27 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-0c67633d-6ce3-4bbc-809c-baf0c5ffc14d tempest-GroupSnapshotsTest-422127898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbfa9b53-c1ce-4c09-b86a-7bfa3236acfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:46:27 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-0c67633d-6ce3-4bbc-809c-baf0c5ffc14d tempest-GroupSnapshotsTest-422127898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5f696f5-f297-46d3-abe6-858ecf07ce1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:46:27 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-0c67633d-6ce3-4bbc-809c-baf0c5ffc14d tempest-GroupSnapshotsTest-422127898 None] Volume volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df (d76d31aa-9ef6-4660-9324-096d7b3ae9df): created successfully
Nov 06 11:46:27 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-0c67633d-6ce3-4bbc-809c-baf0c5ffc14d tempest-GroupSnapshotsTest-422127898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5f696f5-f297-46d3-abe6-858ecf07ce1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:46:27 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-0c67633d-6ce3-4bbc-809c-baf0c5ffc14d tempest-GroupSnapshotsTest-422127898 None] Flow 'volume_create_manager' (d1b34ef8-8bab-4341-8b16-0b74e04f69c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:46:27 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-0c67633d-6ce3-4bbc-809c-baf0c5ffc14d tempest-GroupSnapshotsTest-422127898 None] Created volume successfully.
Nov 06 11:46:27 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-25dc450c-d62d-4160-9e9e-f922a02729d5 req-0a27136d-c7a0-47cf-9327-808c58d3f78c tempest-ServerActionsTestOtherA-2004102178 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50', 'name': 'volume-09ad69a1-794b-4284-9835-05c87ec3c45d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7749bef6-e176-43f5-aa26-70dedf4272db', 'enforce_multipath': True} {{(pid=87165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 11:46:27 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-25dc450c-d62d-4160-9e9e-f922a02729d5 req-0a27136d-c7a0-47cf-9327-808c58d3f78c tempest-ServerActionsTestOtherA-2004102178 None] attachment_update completed successfully.
Nov 06 11:46:28 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-2d47c23d-b3ef-42ee-ba03-97e717d38c85 tempest-GroupSnapshotsTest-422127898 None] Update group completed successfully.
Nov 06 11:46:29 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:SELECT=93,cinder:UPDATE=78,cinder:INSERT=20,cinder:DELETE=3 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 11:46:30 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-9371bcf5-b841-4c9b-8324-76ed20fb4683 tempest-GroupSnapshotsTest-422127898 None] Update group completed successfully.
Nov 06 11:46:30 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-b21e0f11-457e-4522-a024-290ce6a31ccf tempest-VolumesServicesTestJSON-742623686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:46:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b21e0f11-457e-4522-a024-290ce6a31ccf tempest-VolumesServicesTestJSON-742623686 None] Flow 'volume_create_manager' (7f188291-84f4-484e-b7f0-4e7da5f234e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:46:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b21e0f11-457e-4522-a024-290ce6a31ccf tempest-VolumesServicesTestJSON-742623686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ce31705-0f44-4b9d-bff8-cbb1f2b81376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:46:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b21e0f11-457e-4522-a024-290ce6a31ccf tempest-VolumesServicesTestJSON-742623686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ce31705-0f44-4b9d-bff8-cbb1f2b81376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-961535371',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01b24d0a-36f7-4439-9f1d-bacedd6500c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='915ba08297df425bb3dacd9563c8fea6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:46:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:46:31Z,use_quota=True,user_id='4b0a66cb19ef4037a8dfa0f7f9d0c2ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:46:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b21e0f11-457e-4522-a024-290ce6a31ccf tempest-VolumesServicesTestJSON-742623686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b186ba8-7b3e-45c4-a585-07b4bd059fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:46:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b21e0f11-457e-4522-a024-290ce6a31ccf tempest-VolumesServicesTestJSON-742623686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b186ba8-7b3e-45c4-a585-07b4bd059fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:46:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b21e0f11-457e-4522-a024-290ce6a31ccf tempest-VolumesServicesTestJSON-742623686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6666480-f592-472e-85d0-06cc8916444e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:46:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b21e0f11-457e-4522-a024-290ce6a31ccf tempest-VolumesServicesTestJSON-742623686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6666480-f592-472e-85d0-06cc8916444e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01b24d0a-36f7-4439-9f1d-bacedd6500c6', 'volume_name': 'volume-01b24d0a-36f7-4439-9f1d-bacedd6500c6', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:46:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b21e0f11-457e-4522-a024-290ce6a31ccf tempest-VolumesServicesTestJSON-742623686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00873840-5eac-4b22-b464-8f15b45adaa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:46:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b21e0f11-457e-4522-a024-290ce6a31ccf tempest-VolumesServicesTestJSON-742623686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00873840-5eac-4b22-b464-8f15b45adaa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:46:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b21e0f11-457e-4522-a024-290ce6a31ccf tempest-VolumesServicesTestJSON-742623686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90156dd2-8429-4e04-903a-6614d8259be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:46:31 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-b21e0f11-457e-4522-a024-290ce6a31ccf tempest-VolumesServicesTestJSON-742623686 None] Volume 01b24d0a-36f7-4439-9f1d-bacedd6500c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01b24d0a-36f7-4439-9f1d-bacedd6500c6', 'volume_size': 1}
Nov 06 11:46:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b21e0f11-457e-4522-a024-290ce6a31ccf tempest-VolumesServicesTestJSON-742623686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:46:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b21e0f11-457e-4522-a024-290ce6a31ccf tempest-VolumesServicesTestJSON-742623686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:46:31 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b21e0f11-457e-4522-a024-290ce6a31ccf tempest-VolumesServicesTestJSON-742623686 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-961535371',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01b24d0a-36f7-4439-9f1d-bacedd6500c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='915ba08297df425bb3dacd9563c8fea6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:46:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:46:31Z,use_quota=True,user_id='4b0a66cb19ef4037a8dfa0f7f9d0c2ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:46:31 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-b21e0f11-457e-4522-a024-290ce6a31ccf tempest-VolumesServicesTestJSON-742623686 None] Creating volume 01b24d0a-36f7-4439-9f1d-bacedd6500c6 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:46:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b21e0f11-457e-4522-a024-290ce6a31ccf tempest-VolumesServicesTestJSON-742623686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:46:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b21e0f11-457e-4522-a024-290ce6a31ccf tempest-VolumesServicesTestJSON-742623686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:46:31 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b21e0f11-457e-4522-a024-290ce6a31ccf tempest-VolumesServicesTestJSON-742623686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:46:31 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b21e0f11-457e-4522-a024-290ce6a31ccf tempest-VolumesServicesTestJSON-742623686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:46:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b21e0f11-457e-4522-a024-290ce6a31ccf tempest-VolumesServicesTestJSON-742623686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:46:31 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b21e0f11-457e-4522-a024-290ce6a31ccf tempest-VolumesServicesTestJSON-742623686 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:46:31 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-b21e0f11-457e-4522-a024-290ce6a31ccf tempest-VolumesServicesTestJSON-742623686 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:46:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b21e0f11-457e-4522-a024-290ce6a31ccf tempest-VolumesServicesTestJSON-742623686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-01b24d0a-36f7-4439-9f1d-bacedd6500c6 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:31 devstack sudo[92771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-01b24d0a-36f7-4439-9f1d-bacedd6500c6 1073741824
Nov 06 11:46:31 devstack sudo[92771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:31 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-b5e2cd4d-b220-4ba0-8d80-8a01ba560139 tempest-GroupSnapshotsTest-422127898 None] Update group completed successfully.
Nov 06 11:46:31 devstack sudo[92771]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b21e0f11-457e-4522-a024-290ce6a31ccf tempest-VolumesServicesTestJSON-742623686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-01b24d0a-36f7-4439-9f1d-bacedd6500c6 1073741824" returned: 0 in 0.618s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b21e0f11-457e-4522-a024-290ce6a31ccf tempest-VolumesServicesTestJSON-742623686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-01b24d0a-36f7-4439-9f1d-bacedd6500c6 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:31 devstack sudo[92777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-01b24d0a-36f7-4439-9f1d-bacedd6500c6
Nov 06 11:46:31 devstack sudo[92777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:32 devstack sudo[92777]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b21e0f11-457e-4522-a024-290ce6a31ccf tempest-VolumesServicesTestJSON-742623686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-01b24d0a-36f7-4439-9f1d-bacedd6500c6" returned: 0 in 0.436s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:32 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b21e0f11-457e-4522-a024-290ce6a31ccf tempest-VolumesServicesTestJSON-742623686 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:46:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b21e0f11-457e-4522-a024-290ce6a31ccf tempest-VolumesServicesTestJSON-742623686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:46:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b21e0f11-457e-4522-a024-290ce6a31ccf tempest-VolumesServicesTestJSON-742623686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90156dd2-8429-4e04-903a-6614d8259be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01b24d0a-36f7-4439-9f1d-bacedd6500c6', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:46:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b21e0f11-457e-4522-a024-290ce6a31ccf tempest-VolumesServicesTestJSON-742623686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90f9479a-6932-46d8-a0e5-006e83c4bfa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:46:32 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-b21e0f11-457e-4522-a024-290ce6a31ccf tempest-VolumesServicesTestJSON-742623686 None] Volume volume-01b24d0a-36f7-4439-9f1d-bacedd6500c6 (01b24d0a-36f7-4439-9f1d-bacedd6500c6): created successfully
Nov 06 11:46:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b21e0f11-457e-4522-a024-290ce6a31ccf tempest-VolumesServicesTestJSON-742623686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90f9479a-6932-46d8-a0e5-006e83c4bfa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:46:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b21e0f11-457e-4522-a024-290ce6a31ccf tempest-VolumesServicesTestJSON-742623686 None] Flow 'volume_create_manager' (7f188291-84f4-484e-b7f0-4e7da5f234e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:46:32 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-b21e0f11-457e-4522-a024-290ce6a31ccf tempest-VolumesServicesTestJSON-742623686 None] Created volume successfully.
Nov 06 11:46:32 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-d9b0342b-12df-46d7-9137-4fb819bf0145 tempest-GroupSnapshotsTest-422127898 None] Update group completed successfully.
Nov 06 11:46:33 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-42c34fec-e7c1-44c6-a388-c59a934ddfc0 tempest-VolumesServicesTestJSON-742623686 None] Acquiring lock "cinder-01b24d0a-36f7-4439-9f1d-bacedd6500c6-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:46:33 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-42c34fec-e7c1-44c6-a388-c59a934ddfc0 tempest-VolumesServicesTestJSON-742623686 None] Lock "cinder-01b24d0a-36f7-4439-9f1d-bacedd6500c6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:46:33 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-42c34fec-e7c1-44c6-a388-c59a934ddfc0 tempest-VolumesServicesTestJSON-742623686 None] Acquiring lock "cinder-quobyte-01b24d0a-36f7-4439-9f1d-bacedd6500c6" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:46:33 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-42c34fec-e7c1-44c6-a388-c59a934ddfc0 tempest-VolumesServicesTestJSON-742623686 None] Lock "cinder-quobyte-01b24d0a-36f7-4439-9f1d-bacedd6500c6" acquired by "delete_volume" :: waited 0.022s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:46:33 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4afaf7-c295-483d-ae03-9060c10674d6]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:46:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-42c34fec-e7c1-44c6-a388-c59a934ddfc0 tempest-VolumesServicesTestJSON-742623686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-01b24d0a-36f7-4439-9f1d-bacedd6500c6 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:33 devstack sudo[92807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-01b24d0a-36f7-4439-9f1d-bacedd6500c6
Nov 06 11:46:33 devstack sudo[92807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:33 devstack sudo[92807]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-42c34fec-e7c1-44c6-a388-c59a934ddfc0 tempest-VolumesServicesTestJSON-742623686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-01b24d0a-36f7-4439-9f1d-bacedd6500c6" returned: 0 in 0.532s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-42c34fec-e7c1-44c6-a388-c59a934ddfc0 tempest-VolumesServicesTestJSON-742623686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-01b24d0a-36f7-4439-9f1d-bacedd6500c6 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:33 devstack sudo[92812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-01b24d0a-36f7-4439-9f1d-bacedd6500c6
Nov 06 11:46:33 devstack sudo[92812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:34 devstack sudo[92812]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-42c34fec-e7c1-44c6-a388-c59a934ddfc0 tempest-VolumesServicesTestJSON-742623686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-01b24d0a-36f7-4439-9f1d-bacedd6500c6" returned: 0 in 0.310s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:34 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-42c34fec-e7c1-44c6-a388-c59a934ddfc0 tempest-VolumesServicesTestJSON-742623686 None] Lock "cinder-quobyte-01b24d0a-36f7-4439-9f1d-bacedd6500c6" released by "delete_volume" :: held 0.908s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:46:34 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-817105d4-6a43-43e1-a748-4827a8721a5f tempest-GroupSnapshotsTest-422127898 None] GroupSnapshot 0d424fb9-ae78-4930-a316-f32e593ae023: creating.
Nov 06 11:46:34 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-42c34fec-e7c1-44c6-a388-c59a934ddfc0 tempest-VolumesServicesTestJSON-742623686 None] Created reservations ['4444fb3f-8a4f-492f-a7ae-16e91b55da23', '6c89907b-91f9-4ede-be8c-20ab4b858010', '8d319a06-0434-4ca9-bf05-5cb7b9ae9e87', '8eb8932b-c1f5-47b5-8cfc-8d1cd1a0d9bd'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:46:34 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-817105d4-6a43-43e1-a748-4827a8721a5f tempest-GroupSnapshotsTest-422127898 None] Group snapshot 0d424fb9-ae78-4930-a316-f32e593ae023: creating. {{(pid=87165) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 06 11:46:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-817105d4-6a43-43e1-a748-4827a8721a5f tempest-GroupSnapshotsTest-422127898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:46:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-817105d4-6a43-43e1-a748-4827a8721a5f tempest-GroupSnapshotsTest-422127898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:46:34 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-817105d4-6a43-43e1-a748-4827a8721a5f tempest-GroupSnapshotsTest-422127898 None] Creating offline snapshot 0a648602-7761-430c-a670-1b5de9c0ecbf of volume d76d31aa-9ef6-4660-9324-096d7b3ae9df {{(pid=87165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 11:46:34 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c968b78-bde1-4301-b745-28a6fcea2be9]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:46:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-817105d4-6a43-43e1-a748-4827a8721a5f tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-42c34fec-e7c1-44c6-a388-c59a934ddfc0 tempest-VolumesServicesTestJSON-742623686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:46:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-42c34fec-e7c1-44c6-a388-c59a934ddfc0 tempest-VolumesServicesTestJSON-742623686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:46:34 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-42c34fec-e7c1-44c6-a388-c59a934ddfc0 tempest-VolumesServicesTestJSON-742623686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:46:34 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-42c34fec-e7c1-44c6-a388-c59a934ddfc0 tempest-VolumesServicesTestJSON-742623686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:46:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-42c34fec-e7c1-44c6-a388-c59a934ddfc0 tempest-VolumesServicesTestJSON-742623686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:46:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-42c34fec-e7c1-44c6-a388-c59a934ddfc0 tempest-VolumesServicesTestJSON-742623686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:34 devstack sudo[92817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:46:34 devstack sudo[92817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:34 devstack sudo[92816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df
Nov 06 11:46:34 devstack sudo[92816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:34 devstack sudo[92817]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-42c34fec-e7c1-44c6-a388-c59a934ddfc0 tempest-VolumesServicesTestJSON-742623686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.269s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:34 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-42c34fec-e7c1-44c6-a388-c59a934ddfc0 tempest-VolumesServicesTestJSON-742623686 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:46:34 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-42c34fec-e7c1-44c6-a388-c59a934ddfc0 tempest-VolumesServicesTestJSON-742623686 None] Deleted volume successfully.
Nov 06 11:46:34 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-42c34fec-e7c1-44c6-a388-c59a934ddfc0 tempest-VolumesServicesTestJSON-742623686 None] Lock "cinder-01b24d0a-36f7-4439-9f1d-bacedd6500c6-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:46:34 devstack sudo[92816]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-817105d4-6a43-43e1-a748-4827a8721a5f tempest-GroupSnapshotsTest-422127898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df" returned: 0 in 0.417s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-817105d4-6a43-43e1-a748-4827a8721a5f tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df.0a648602-7761-430c-a670-1b5de9c0ecbf 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:34 devstack sudo[92824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df.0a648602-7761-430c-a670-1b5de9c0ecbf 1G
Nov 06 11:46:34 devstack sudo[92824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:35 devstack sudo[92824]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-817105d4-6a43-43e1-a748-4827a8721a5f tempest-GroupSnapshotsTest-422127898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df.0a648602-7761-430c-a670-1b5de9c0ecbf 1G" returned: 0 in 0.389s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-817105d4-6a43-43e1-a748-4827a8721a5f tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df.0a648602-7761-430c-a670-1b5de9c0ecbf {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:35 devstack sudo[92829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df.0a648602-7761-430c-a670-1b5de9c0ecbf
Nov 06 11:46:35 devstack sudo[92829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:35 devstack sudo[92829]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-817105d4-6a43-43e1-a748-4827a8721a5f tempest-GroupSnapshotsTest-422127898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df.0a648602-7761-430c-a670-1b5de9c0ecbf" returned: 0 in 0.325s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:35 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-817105d4-6a43-43e1-a748-4827a8721a5f tempest-GroupSnapshotsTest-422127898 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df.0a648602-7761-430c-a670-1b5de9c0ecbf is being set with open permissions: ugo+rw: NotImplementedError
Nov 06 11:46:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-817105d4-6a43-43e1-a748-4827a8721a5f tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df.0a648602-7761-430c-a670-1b5de9c0ecbf {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:35 devstack sudo[92835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df.0a648602-7761-430c-a670-1b5de9c0ecbf
Nov 06 11:46:35 devstack sudo[92835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:35 devstack sudo[92835]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-817105d4-6a43-43e1-a748-4827a8721a5f tempest-GroupSnapshotsTest-422127898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df.0a648602-7761-430c-a670-1b5de9c0ecbf" returned: 0 in 0.253s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-817105d4-6a43-43e1-a748-4827a8721a5f tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:35 devstack sudo[92838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df.info
Nov 06 11:46:35 devstack sudo[92838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:36 devstack sudo[92838]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-817105d4-6a43-43e1-a748-4827a8721a5f tempest-GroupSnapshotsTest-422127898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df.info" returned: 0 in 0.266s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:36 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-817105d4-6a43-43e1-a748-4827a8721a5f tempest-GroupSnapshotsTest-422127898 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 06 11:46:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-817105d4-6a43-43e1-a748-4827a8721a5f tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:36 devstack sudo[92841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df.info
Nov 06 11:46:36 devstack sudo[92841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:36 devstack sudo[92841]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-817105d4-6a43-43e1-a748-4827a8721a5f tempest-GroupSnapshotsTest-422127898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df.info" returned: 0 in 0.262s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-817105d4-6a43-43e1-a748-4827a8721a5f tempest-GroupSnapshotsTest-422127898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.029s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:46:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-817105d4-6a43-43e1-a748-4827a8721a5f tempest-GroupSnapshotsTest-422127898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:46:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-817105d4-6a43-43e1-a748-4827a8721a5f tempest-GroupSnapshotsTest-422127898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:46:36 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-817105d4-6a43-43e1-a748-4827a8721a5f tempest-GroupSnapshotsTest-422127898 None] Creating offline snapshot 3af2f5ce-51b5-44bc-b929-f4381dbff1e7 of volume 77b65ac4-8df2-41a8-8ca7-4835c7ae4795 {{(pid=87165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 11:46:36 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6025a3-9c40-456a-a2a6-24856eaeb750]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:46:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-817105d4-6a43-43e1-a748-4827a8721a5f tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:36 devstack sudo[92844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795
Nov 06 11:46:36 devstack sudo[92844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:36 devstack sudo[92844]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-817105d4-6a43-43e1-a748-4827a8721a5f tempest-GroupSnapshotsTest-422127898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795" returned: 0 in 0.387s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-817105d4-6a43-43e1-a748-4827a8721a5f tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795.3af2f5ce-51b5-44bc-b929-f4381dbff1e7 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:36 devstack sudo[92849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795.3af2f5ce-51b5-44bc-b929-f4381dbff1e7 1G
Nov 06 11:46:36 devstack sudo[92849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:37 devstack sudo[92849]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-817105d4-6a43-43e1-a748-4827a8721a5f tempest-GroupSnapshotsTest-422127898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795.3af2f5ce-51b5-44bc-b929-f4381dbff1e7 1G" returned: 0 in 0.461s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-817105d4-6a43-43e1-a748-4827a8721a5f tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795.3af2f5ce-51b5-44bc-b929-f4381dbff1e7 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:37 devstack sudo[92858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795.3af2f5ce-51b5-44bc-b929-f4381dbff1e7
Nov 06 11:46:37 devstack sudo[92858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:37 devstack sudo[92858]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-817105d4-6a43-43e1-a748-4827a8721a5f tempest-GroupSnapshotsTest-422127898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795.3af2f5ce-51b5-44bc-b929-f4381dbff1e7" returned: 0 in 0.332s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:37 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-817105d4-6a43-43e1-a748-4827a8721a5f tempest-GroupSnapshotsTest-422127898 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795.3af2f5ce-51b5-44bc-b929-f4381dbff1e7 is being set with open permissions: ugo+rw: NotImplementedError
Nov 06 11:46:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-817105d4-6a43-43e1-a748-4827a8721a5f tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795.3af2f5ce-51b5-44bc-b929-f4381dbff1e7 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:37 devstack sudo[92863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795.3af2f5ce-51b5-44bc-b929-f4381dbff1e7
Nov 06 11:46:37 devstack sudo[92863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:37 devstack sudo[92863]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-817105d4-6a43-43e1-a748-4827a8721a5f tempest-GroupSnapshotsTest-422127898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795.3af2f5ce-51b5-44bc-b929-f4381dbff1e7" returned: 0 in 0.268s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-817105d4-6a43-43e1-a748-4827a8721a5f tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:37 devstack sudo[92866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795.info
Nov 06 11:46:37 devstack sudo[92866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:38 devstack sudo[92866]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-817105d4-6a43-43e1-a748-4827a8721a5f tempest-GroupSnapshotsTest-422127898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795.info" returned: 0 in 0.251s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:38 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-817105d4-6a43-43e1-a748-4827a8721a5f tempest-GroupSnapshotsTest-422127898 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 06 11:46:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-817105d4-6a43-43e1-a748-4827a8721a5f tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:38 devstack sudo[92869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795.info
Nov 06 11:46:38 devstack sudo[92869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:38 devstack sudo[92869]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-817105d4-6a43-43e1-a748-4827a8721a5f tempest-GroupSnapshotsTest-422127898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795.info" returned: 0 in 0.318s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-817105d4-6a43-43e1-a748-4827a8721a5f tempest-GroupSnapshotsTest-422127898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.151s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:46:38 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-817105d4-6a43-43e1-a748-4827a8721a5f tempest-GroupSnapshotsTest-422127898 None] group_snapshot 0d424fb9-ae78-4930-a316-f32e593ae023: created successfully
Nov 06 11:46:39 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-24dc1aed-a19b-46be-b7bf-78f188bb91ec tempest-GroupSnapshotsTest-422127898 None] group_snapshot 0d424fb9-ae78-4930-a316-f32e593ae023: deleting
Nov 06 11:46:39 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-24dc1aed-a19b-46be-b7bf-78f188bb91ec tempest-GroupSnapshotsTest-422127898 None] group_snapshot 0d424fb9-ae78-4930-a316-f32e593ae023: deleting {{(pid=87165) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 06 11:46:40 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-24dc1aed-a19b-46be-b7bf-78f188bb91ec tempest-GroupSnapshotsTest-422127898 None] Acquiring lock "cinder-quobyte-d76d31aa-9ef6-4660-9324-096d7b3ae9df" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:46:40 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-24dc1aed-a19b-46be-b7bf-78f188bb91ec tempest-GroupSnapshotsTest-422127898 None] Lock "cinder-quobyte-d76d31aa-9ef6-4660-9324-096d7b3ae9df" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:46:40 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-24dc1aed-a19b-46be-b7bf-78f188bb91ec tempest-GroupSnapshotsTest-422127898 None] Acquiring lock "cinder-quobyte-0a648602-7761-430c-a670-1b5de9c0ecbf" by "_delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:46:40 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-24dc1aed-a19b-46be-b7bf-78f188bb91ec tempest-GroupSnapshotsTest-422127898 None] Lock "cinder-quobyte-0a648602-7761-430c-a670-1b5de9c0ecbf" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:46:40 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-24dc1aed-a19b-46be-b7bf-78f188bb91ec tempest-GroupSnapshotsTest-422127898 None] Deleting offline snapshot 0a648602-7761-430c-a670-1b5de9c0ecbf of volume d76d31aa-9ef6-4660-9324-096d7b3ae9df {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 11:46:40 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-24dc1aed-a19b-46be-b7bf-78f188bb91ec tempest-GroupSnapshotsTest-422127898 None] snapshot_file for this snap is: volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df.0a648602-7761-430c-a670-1b5de9c0ecbf {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 11:46:40 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eab01d9-448a-4f17-bcf9-de87bb49504d]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:46:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-24dc1aed-a19b-46be-b7bf-78f188bb91ec tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df.0a648602-7761-430c-a670-1b5de9c0ecbf {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:40 devstack sudo[92872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df.0a648602-7761-430c-a670-1b5de9c0ecbf
Nov 06 11:46:40 devstack sudo[92872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:40 devstack sudo[92872]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-24dc1aed-a19b-46be-b7bf-78f188bb91ec tempest-GroupSnapshotsTest-422127898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df.0a648602-7761-430c-a670-1b5de9c0ecbf" returned: 0 in 0.651s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:40 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-24dc1aed-a19b-46be-b7bf-78f188bb91ec tempest-GroupSnapshotsTest-422127898 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:46:40 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5193dc7d-aa6a-47a4-b1b8-bd3165a6eaa8]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:46:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-24dc1aed-a19b-46be-b7bf-78f188bb91ec tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:40 devstack sudo[92877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df
Nov 06 11:46:40 devstack sudo[92877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:41 devstack sudo[92877]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-24dc1aed-a19b-46be-b7bf-78f188bb91ec tempest-GroupSnapshotsTest-422127898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df" returned: 0 in 0.435s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-24dc1aed-a19b-46be-b7bf-78f188bb91ec tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df.0a648602-7761-430c-a670-1b5de9c0ecbf {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:41 devstack sudo[92882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df.0a648602-7761-430c-a670-1b5de9c0ecbf
Nov 06 11:46:41 devstack sudo[92882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:41 devstack sudo[92882]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-24dc1aed-a19b-46be-b7bf-78f188bb91ec tempest-GroupSnapshotsTest-422127898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df.0a648602-7761-430c-a670-1b5de9c0ecbf" returned: 0 in 0.400s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-24dc1aed-a19b-46be-b7bf-78f188bb91ec tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df.0a648602-7761-430c-a670-1b5de9c0ecbf {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:41 devstack sudo[92888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df.0a648602-7761-430c-a670-1b5de9c0ecbf
Nov 06 11:46:41 devstack sudo[92888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:41 devstack sudo[92888]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-24dc1aed-a19b-46be-b7bf-78f188bb91ec tempest-GroupSnapshotsTest-422127898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df.0a648602-7761-430c-a670-1b5de9c0ecbf" returned: 0 in 0.269s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:41 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-24dc1aed-a19b-46be-b7bf-78f188bb91ec tempest-GroupSnapshotsTest-422127898 None] Lock "cinder-quobyte-0a648602-7761-430c-a670-1b5de9c0ecbf" released by "_delete_snapshot" :: held 1.935s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:46:41 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-24dc1aed-a19b-46be-b7bf-78f188bb91ec tempest-GroupSnapshotsTest-422127898 None] Lock "cinder-quobyte-d76d31aa-9ef6-4660-9324-096d7b3ae9df" released by "delete_snapshot" :: held 1.967s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:46:42 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-24dc1aed-a19b-46be-b7bf-78f188bb91ec tempest-GroupSnapshotsTest-422127898 None] Acquiring lock "cinder-quobyte-77b65ac4-8df2-41a8-8ca7-4835c7ae4795" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:46:42 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-24dc1aed-a19b-46be-b7bf-78f188bb91ec tempest-GroupSnapshotsTest-422127898 None] Lock "cinder-quobyte-77b65ac4-8df2-41a8-8ca7-4835c7ae4795" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:46:42 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-24dc1aed-a19b-46be-b7bf-78f188bb91ec tempest-GroupSnapshotsTest-422127898 None] Acquiring lock "cinder-quobyte-3af2f5ce-51b5-44bc-b929-f4381dbff1e7" by "_delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:46:42 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-24dc1aed-a19b-46be-b7bf-78f188bb91ec tempest-GroupSnapshotsTest-422127898 None] Lock "cinder-quobyte-3af2f5ce-51b5-44bc-b929-f4381dbff1e7" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:46:42 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-24dc1aed-a19b-46be-b7bf-78f188bb91ec tempest-GroupSnapshotsTest-422127898 None] Deleting offline snapshot 3af2f5ce-51b5-44bc-b929-f4381dbff1e7 of volume 77b65ac4-8df2-41a8-8ca7-4835c7ae4795 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 11:46:42 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-24dc1aed-a19b-46be-b7bf-78f188bb91ec tempest-GroupSnapshotsTest-422127898 None] snapshot_file for this snap is: volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795.3af2f5ce-51b5-44bc-b929-f4381dbff1e7 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 11:46:42 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fd0032-652f-4ff6-a490-1dfe8c1cf6b6]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:46:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-24dc1aed-a19b-46be-b7bf-78f188bb91ec tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795.3af2f5ce-51b5-44bc-b929-f4381dbff1e7 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:42 devstack sudo[92891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795.3af2f5ce-51b5-44bc-b929-f4381dbff1e7
Nov 06 11:46:42 devstack sudo[92891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:42 devstack sudo[92891]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-24dc1aed-a19b-46be-b7bf-78f188bb91ec tempest-GroupSnapshotsTest-422127898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795.3af2f5ce-51b5-44bc-b929-f4381dbff1e7" returned: 0 in 0.579s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:42 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-24dc1aed-a19b-46be-b7bf-78f188bb91ec tempest-GroupSnapshotsTest-422127898 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:46:42 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf753fe6-941c-4a0f-b72d-c218e44492af]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:46:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-24dc1aed-a19b-46be-b7bf-78f188bb91ec tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:42 devstack sudo[92897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795
Nov 06 11:46:42 devstack sudo[92897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:43 devstack sudo[92897]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-24dc1aed-a19b-46be-b7bf-78f188bb91ec tempest-GroupSnapshotsTest-422127898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795" returned: 0 in 0.471s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-24dc1aed-a19b-46be-b7bf-78f188bb91ec tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795.3af2f5ce-51b5-44bc-b929-f4381dbff1e7 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:43 devstack sudo[92902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795.3af2f5ce-51b5-44bc-b929-f4381dbff1e7
Nov 06 11:46:43 devstack sudo[92902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:43 devstack sudo[92902]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-24dc1aed-a19b-46be-b7bf-78f188bb91ec tempest-GroupSnapshotsTest-422127898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795.3af2f5ce-51b5-44bc-b929-f4381dbff1e7" returned: 0 in 0.401s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-24dc1aed-a19b-46be-b7bf-78f188bb91ec tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795.3af2f5ce-51b5-44bc-b929-f4381dbff1e7 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:43 devstack sudo[92909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795.3af2f5ce-51b5-44bc-b929-f4381dbff1e7
Nov 06 11:46:43 devstack sudo[92909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:43 devstack sudo[92909]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-24dc1aed-a19b-46be-b7bf-78f188bb91ec tempest-GroupSnapshotsTest-422127898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795.3af2f5ce-51b5-44bc-b929-f4381dbff1e7" returned: 0 in 0.314s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:43 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-24dc1aed-a19b-46be-b7bf-78f188bb91ec tempest-GroupSnapshotsTest-422127898 None] Lock "cinder-quobyte-3af2f5ce-51b5-44bc-b929-f4381dbff1e7" released by "_delete_snapshot" :: held 1.920s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:46:43 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-24dc1aed-a19b-46be-b7bf-78f188bb91ec tempest-GroupSnapshotsTest-422127898 None] Lock "cinder-quobyte-77b65ac4-8df2-41a8-8ca7-4835c7ae4795" released by "delete_snapshot" :: held 1.960s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:46:44 devstack cinder-volume[87165]: WARNING cinder.quota [None req-24dc1aed-a19b-46be-b7bf-78f188bb91ec tempest-GroupSnapshotsTest-422127898 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-68757982 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-68757982, it is now deprecated. Please use the default quota class for default quota.
Nov 06 11:46:44 devstack cinder-volume[87165]: WARNING cinder.quota [None req-24dc1aed-a19b-46be-b7bf-78f188bb91ec tempest-GroupSnapshotsTest-422127898 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-68757982 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-68757982, it is now deprecated. Please use the default quota class for default quota.
Nov 06 11:46:44 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-24dc1aed-a19b-46be-b7bf-78f188bb91ec tempest-GroupSnapshotsTest-422127898 None] Created reservations ['6c00bd1d-bb47-4d0c-bc08-ad7a3921b2a2', '85c8e219-fa25-478c-862e-bb1a69095ec1', '7f745fcc-610c-4310-b3c5-3edbe45571b4', 'bfb7abef-54e7-4a19-9505-1c11b1aabcad'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:46:44 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-24dc1aed-a19b-46be-b7bf-78f188bb91ec tempest-GroupSnapshotsTest-422127898 None] Created reservations ['e51efb23-477a-4600-a2ae-ac30633c2d2c', 'f041363b-dc72-4457-a009-058de0919463', '84b0b45f-110e-4a6b-86a5-11375f7a5f5b', 'a61b955e-8aa2-4864-affc-ac034b10455e'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:46:44 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-24dc1aed-a19b-46be-b7bf-78f188bb91ec tempest-GroupSnapshotsTest-422127898 None] group_snapshot 0d424fb9-ae78-4930-a316-f32e593ae023: deleted successfully
Nov 06 11:46:44 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a88d943-3a32-402a-b0cf-5b8718f11577 tempest-AttachVolumeNegativeTest-993089865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:46:44 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8a88d943-3a32-402a-b0cf-5b8718f11577 tempest-AttachVolumeNegativeTest-993089865 None] Flow 'volume_create_manager' (0811e4d5-87ff-4c9c-9441-eeeb06b98bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:46:44 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8a88d943-3a32-402a-b0cf-5b8718f11577 tempest-AttachVolumeNegativeTest-993089865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2907dd33-2945-4f4f-99d4-f183b5c0c589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:46:44 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8a88d943-3a32-402a-b0cf-5b8718f11577 tempest-AttachVolumeNegativeTest-993089865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2907dd33-2945-4f4f-99d4-f183b5c0c589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-790433938',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4ab6ad3-c16f-4e6f-b019-8379970e5dae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3e5280a8be5403bb6364cec1e71368b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:46:45Z,use_quota=True,user_id='aac0f37412684b0ebdf18894bf8f8dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:46:44 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8a88d943-3a32-402a-b0cf-5b8718f11577 tempest-AttachVolumeNegativeTest-993089865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e7618da-e7e3-451a-aa07-715d7058766a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:46:45 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8a88d943-3a32-402a-b0cf-5b8718f11577 tempest-AttachVolumeNegativeTest-993089865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e7618da-e7e3-451a-aa07-715d7058766a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:46:45 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8a88d943-3a32-402a-b0cf-5b8718f11577 tempest-AttachVolumeNegativeTest-993089865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (967c422e-a68e-48b4-b4aa-824c5740d365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:46:45 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8a88d943-3a32-402a-b0cf-5b8718f11577 tempest-AttachVolumeNegativeTest-993089865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (967c422e-a68e-48b4-b4aa-824c5740d365) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4ab6ad3-c16f-4e6f-b019-8379970e5dae', 'volume_name': 'volume-d4ab6ad3-c16f-4e6f-b019-8379970e5dae', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:46:45 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8a88d943-3a32-402a-b0cf-5b8718f11577 tempest-AttachVolumeNegativeTest-993089865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34a3eceb-e39d-4531-99bf-e68720284cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:46:45 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8a88d943-3a32-402a-b0cf-5b8718f11577 tempest-AttachVolumeNegativeTest-993089865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34a3eceb-e39d-4531-99bf-e68720284cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:46:45 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8a88d943-3a32-402a-b0cf-5b8718f11577 tempest-AttachVolumeNegativeTest-993089865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e2e4f7f-00e3-4ed8-ab73-8fad18bc3dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:46:45 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-8a88d943-3a32-402a-b0cf-5b8718f11577 tempest-AttachVolumeNegativeTest-993089865 None] Volume d4ab6ad3-c16f-4e6f-b019-8379970e5dae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4ab6ad3-c16f-4e6f-b019-8379970e5dae', 'volume_size': 1}
Nov 06 11:46:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-8a88d943-3a32-402a-b0cf-5b8718f11577 tempest-AttachVolumeNegativeTest-993089865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:46:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-8a88d943-3a32-402a-b0cf-5b8718f11577 tempest-AttachVolumeNegativeTest-993089865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:46:45 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-8a88d943-3a32-402a-b0cf-5b8718f11577 tempest-AttachVolumeNegativeTest-993089865 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-790433938',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4ab6ad3-c16f-4e6f-b019-8379970e5dae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3e5280a8be5403bb6364cec1e71368b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:46:45Z,use_quota=True,user_id='aac0f37412684b0ebdf18894bf8f8dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:46:45 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-8a88d943-3a32-402a-b0cf-5b8718f11577 tempest-AttachVolumeNegativeTest-993089865 None] Creating volume d4ab6ad3-c16f-4e6f-b019-8379970e5dae {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:46:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-8a88d943-3a32-402a-b0cf-5b8718f11577 tempest-AttachVolumeNegativeTest-993089865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:46:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-8a88d943-3a32-402a-b0cf-5b8718f11577 tempest-AttachVolumeNegativeTest-993089865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:46:45 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-8a88d943-3a32-402a-b0cf-5b8718f11577 tempest-AttachVolumeNegativeTest-993089865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:46:45 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-8a88d943-3a32-402a-b0cf-5b8718f11577 tempest-AttachVolumeNegativeTest-993089865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:46:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-8a88d943-3a32-402a-b0cf-5b8718f11577 tempest-AttachVolumeNegativeTest-993089865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:46:45 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-8a88d943-3a32-402a-b0cf-5b8718f11577 tempest-AttachVolumeNegativeTest-993089865 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:46:45 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-8a88d943-3a32-402a-b0cf-5b8718f11577 tempest-AttachVolumeNegativeTest-993089865 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:46:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-8a88d943-3a32-402a-b0cf-5b8718f11577 tempest-AttachVolumeNegativeTest-993089865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d4ab6ad3-c16f-4e6f-b019-8379970e5dae 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:45 devstack sudo[92938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d4ab6ad3-c16f-4e6f-b019-8379970e5dae 1073741824
Nov 06 11:46:45 devstack sudo[92938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:45 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d45d3a2e-4df7-411f-b405-f50007d63d0f tempest-GroupSnapshotsTest-422127898 None] Acquiring lock "cinder-quobyte-77b65ac4-8df2-41a8-8ca7-4835c7ae4795" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:46:45 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d45d3a2e-4df7-411f-b405-f50007d63d0f tempest-GroupSnapshotsTest-422127898 None] Lock "cinder-quobyte-77b65ac4-8df2-41a8-8ca7-4835c7ae4795" acquired by "delete_volume" :: waited 0.027s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:46:45 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74a10dd-8c62-400b-8111-27e2493ab9d3]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:46:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d45d3a2e-4df7-411f-b405-f50007d63d0f tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:45 devstack sudo[92945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795
Nov 06 11:46:45 devstack sudo[92945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:45 devstack sudo[92938]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-8a88d943-3a32-402a-b0cf-5b8718f11577 tempest-AttachVolumeNegativeTest-993089865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d4ab6ad3-c16f-4e6f-b019-8379970e5dae 1073741824" returned: 0 in 0.775s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-8a88d943-3a32-402a-b0cf-5b8718f11577 tempest-AttachVolumeNegativeTest-993089865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d4ab6ad3-c16f-4e6f-b019-8379970e5dae {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:45 devstack sudo[92948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d4ab6ad3-c16f-4e6f-b019-8379970e5dae
Nov 06 11:46:45 devstack sudo[92948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:46 devstack sudo[92945]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d45d3a2e-4df7-411f-b405-f50007d63d0f tempest-GroupSnapshotsTest-422127898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795" returned: 0 in 0.570s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d45d3a2e-4df7-411f-b405-f50007d63d0f tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:46 devstack sudo[92954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795
Nov 06 11:46:46 devstack sudo[92954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:46 devstack sudo[92948]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-8a88d943-3a32-402a-b0cf-5b8718f11577 tempest-AttachVolumeNegativeTest-993089865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d4ab6ad3-c16f-4e6f-b019-8379970e5dae" returned: 0 in 0.367s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:46 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-8a88d943-3a32-402a-b0cf-5b8718f11577 tempest-AttachVolumeNegativeTest-993089865 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:46:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-8a88d943-3a32-402a-b0cf-5b8718f11577 tempest-AttachVolumeNegativeTest-993089865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:46:46 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8a88d943-3a32-402a-b0cf-5b8718f11577 tempest-AttachVolumeNegativeTest-993089865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e2e4f7f-00e3-4ed8-ab73-8fad18bc3dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4ab6ad3-c16f-4e6f-b019-8379970e5dae', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:46:46 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8a88d943-3a32-402a-b0cf-5b8718f11577 tempest-AttachVolumeNegativeTest-993089865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (042f6fdb-317c-4614-b947-ea55735a8052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:46:46 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-8a88d943-3a32-402a-b0cf-5b8718f11577 tempest-AttachVolumeNegativeTest-993089865 None] Volume volume-d4ab6ad3-c16f-4e6f-b019-8379970e5dae (d4ab6ad3-c16f-4e6f-b019-8379970e5dae): created successfully
Nov 06 11:46:46 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8a88d943-3a32-402a-b0cf-5b8718f11577 tempest-AttachVolumeNegativeTest-993089865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (042f6fdb-317c-4614-b947-ea55735a8052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:46:46 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8a88d943-3a32-402a-b0cf-5b8718f11577 tempest-AttachVolumeNegativeTest-993089865 None] Flow 'volume_create_manager' (0811e4d5-87ff-4c9c-9441-eeeb06b98bcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:46:46 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-8a88d943-3a32-402a-b0cf-5b8718f11577 tempest-AttachVolumeNegativeTest-993089865 None] Created volume successfully.
Nov 06 11:46:46 devstack sudo[92954]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d45d3a2e-4df7-411f-b405-f50007d63d0f tempest-GroupSnapshotsTest-422127898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-77b65ac4-8df2-41a8-8ca7-4835c7ae4795" returned: 0 in 0.349s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:46 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d45d3a2e-4df7-411f-b405-f50007d63d0f tempest-GroupSnapshotsTest-422127898 None] Lock "cinder-quobyte-77b65ac4-8df2-41a8-8ca7-4835c7ae4795" released by "delete_volume" :: held 1.059s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:46:46 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d45d3a2e-4df7-411f-b405-f50007d63d0f tempest-GroupSnapshotsTest-422127898 None] Acquiring lock "cinder-quobyte-d76d31aa-9ef6-4660-9324-096d7b3ae9df" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:46:46 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d45d3a2e-4df7-411f-b405-f50007d63d0f tempest-GroupSnapshotsTest-422127898 None] Lock "cinder-quobyte-d76d31aa-9ef6-4660-9324-096d7b3ae9df" acquired by "delete_volume" :: waited 0.019s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:46:46 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c8d27f-01f4-43e5-a428-40cc43192c28]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:46:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d45d3a2e-4df7-411f-b405-f50007d63d0f tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:46 devstack sudo[92964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df
Nov 06 11:46:46 devstack sudo[92964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:47 devstack sudo[92964]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d45d3a2e-4df7-411f-b405-f50007d63d0f tempest-GroupSnapshotsTest-422127898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df" returned: 0 in 0.474s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d45d3a2e-4df7-411f-b405-f50007d63d0f tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:47 devstack sudo[92979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df
Nov 06 11:46:47 devstack sudo[92979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:47 devstack sudo[92979]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d45d3a2e-4df7-411f-b405-f50007d63d0f tempest-GroupSnapshotsTest-422127898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d76d31aa-9ef6-4660-9324-096d7b3ae9df" returned: 0 in 0.356s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:47 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d45d3a2e-4df7-411f-b405-f50007d63d0f tempest-GroupSnapshotsTest-422127898 None] Lock "cinder-quobyte-d76d31aa-9ef6-4660-9324-096d7b3ae9df" released by "delete_volume" :: held 0.940s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:46:47 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-d45d3a2e-4df7-411f-b405-f50007d63d0f tempest-GroupSnapshotsTest-422127898 None] Created reservations ['d2af4b8e-9235-40a4-901e-2035afbb666c'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:46:47 devstack cinder-volume[87165]: WARNING cinder.quota [None req-d45d3a2e-4df7-411f-b405-f50007d63d0f tempest-GroupSnapshotsTest-422127898 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-68757982 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-68757982, it is now deprecated. Please use the default quota class for default quota.
Nov 06 11:46:47 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-d45d3a2e-4df7-411f-b405-f50007d63d0f tempest-GroupSnapshotsTest-422127898 None] Created reservations ['b4515670-33e0-4e63-bc16-9f3bb7ed99ff', 'f8069572-d407-4467-bf03-733bfd807d3e', 'fa1cc62e-2563-48b0-87d4-e541416886a0', '09af80b1-aabb-4680-9e54-673397ca78a8'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:46:47 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-d45d3a2e-4df7-411f-b405-f50007d63d0f tempest-GroupSnapshotsTest-422127898 None] Created reservations ['d3f224ee-465a-4ac3-8776-1047026b6b2c', 'cbeaf173-eda3-42a6-ae48-d45558cce83e', '74e60019-0fb9-4bc4-ac83-8d8ef2868792', '2cb5c8d1-aaed-40f9-b680-b111c44f499a'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:46:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d45d3a2e-4df7-411f-b405-f50007d63d0f tempest-GroupSnapshotsTest-422127898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:46:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d45d3a2e-4df7-411f-b405-f50007d63d0f tempest-GroupSnapshotsTest-422127898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:46:48 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-d45d3a2e-4df7-411f-b405-f50007d63d0f tempest-GroupSnapshotsTest-422127898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:46:48 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-d45d3a2e-4df7-411f-b405-f50007d63d0f tempest-GroupSnapshotsTest-422127898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:46:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d45d3a2e-4df7-411f-b405-f50007d63d0f tempest-GroupSnapshotsTest-422127898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:46:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d45d3a2e-4df7-411f-b405-f50007d63d0f tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:48 devstack sudo[93001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:46:48 devstack sudo[93001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-88afa4f8-aed8-4477-b940-2d1362377e6e req-35219962-d49e-45a0-aff5-f94d550fd6a9 tempest-AttachVolumeNegativeTest-993089865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:46:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-88afa4f8-aed8-4477-b940-2d1362377e6e req-35219962-d49e-45a0-aff5-f94d550fd6a9 tempest-AttachVolumeNegativeTest-993089865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:46:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-88afa4f8-aed8-4477-b940-2d1362377e6e req-35219962-d49e-45a0-aff5-f94d550fd6a9 tempest-AttachVolumeNegativeTest-993089865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:46:48 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-88afa4f8-aed8-4477-b940-2d1362377e6e req-35219962-d49e-45a0-aff5-f94d550fd6a9 tempest-AttachVolumeNegativeTest-993089865 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50', 'name': 'volume-d4ab6ad3-c16f-4e6f-b019-8379970e5dae', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '09dcbaa8-d75f-4c87-b732-6b3cc84d63d5', 'enforce_multipath': True} {{(pid=87165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 11:46:48 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-88afa4f8-aed8-4477-b940-2d1362377e6e req-35219962-d49e-45a0-aff5-f94d550fd6a9 tempest-AttachVolumeNegativeTest-993089865 None] attachment_update completed successfully.
Nov 06 11:46:48 devstack sudo[93001]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d45d3a2e-4df7-411f-b405-f50007d63d0f tempest-GroupSnapshotsTest-422127898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.381s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:48 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-d45d3a2e-4df7-411f-b405-f50007d63d0f tempest-GroupSnapshotsTest-422127898 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:46:48 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-d45d3a2e-4df7-411f-b405-f50007d63d0f tempest-GroupSnapshotsTest-422127898 None] Delete group completed successfully.
Nov 06 11:46:49 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-a1249e72-9baf-45ab-8dae-b10f3d1d3046 tempest-GroupSnapshotsTest-422127898 None] Group tempest-GroupSnapshotsTest-Group-1004812248: creating
Nov 06 11:46:49 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-a1249e72-9baf-45ab-8dae-b10f3d1d3046 tempest-GroupSnapshotsTest-422127898 None] Group tempest-GroupSnapshotsTest-Group-1004812248: created successfully
Nov 06 11:46:49 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-a1249e72-9baf-45ab-8dae-b10f3d1d3046 tempest-GroupSnapshotsTest-422127898 None] Create group completed successfully.
Nov 06 11:46:50 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-7b825c78-7890-486a-9ddb-7b58ed9c8362 req-d1ea1d89-0a59-442d-9ab4-dcea9a887317 tempest-AttachVolumeNegativeTest-993089865 None] Terminate volume connection completed successfully.
Nov 06 11:46:50 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-7b825c78-7890-486a-9ddb-7b58ed9c8362 req-d1ea1d89-0a59-442d-9ab4-dcea9a887317 tempest-AttachVolumeNegativeTest-993089865 None] Deleting attachment 09dcbaa8-d75f-4c87-b732-6b3cc84d63d5. {{(pid=87165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 11:46:51 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbbc041e-a31c-469b-85c2-c8016aa58ccb tempest-GroupSnapshotsTest-422127898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:46:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-bbbc041e-a31c-469b-85c2-c8016aa58ccb tempest-GroupSnapshotsTest-422127898 None] Flow 'volume_create_manager' (3d599d52-8ded-4cea-adc5-9ccf978993ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:46:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-bbbc041e-a31c-469b-85c2-c8016aa58ccb tempest-GroupSnapshotsTest-422127898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8755c2e4-483b-4316-bbc4-ce2ae64cfb9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:46:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-bbbc041e-a31c-469b-85c2-c8016aa58ccb tempest-GroupSnapshotsTest-422127898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8755c2e4-483b-4316-bbc4-ce2ae64cfb9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:46:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1577992745',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d4e71c45-402f-46d5-b879-7fd6e045aa45,host='devstack@QuobyteHD#QuobyteHD',id=0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3266d51642f342d58f397aa7393a8e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:46:52Z,use_quota=True,user_id='eed02d9bb5d7479492dcb8e06e26c4b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dbc37c1-9a21-4f74-872e-32e71e81c9c1),volume_type_id=4dbc37c1-9a21-4f74-872e-32e71e81c9c1)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:46:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-bbbc041e-a31c-469b-85c2-c8016aa58ccb tempest-GroupSnapshotsTest-422127898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4c823e7-e61a-4762-8a6a-00efe017c1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:46:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-bbbc041e-a31c-469b-85c2-c8016aa58ccb tempest-GroupSnapshotsTest-422127898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4c823e7-e61a-4762-8a6a-00efe017c1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:46:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-bbbc041e-a31c-469b-85c2-c8016aa58ccb tempest-GroupSnapshotsTest-422127898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c8ac294-79c1-4d4c-997b-2924aa84604f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:46:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-bbbc041e-a31c-469b-85c2-c8016aa58ccb tempest-GroupSnapshotsTest-422127898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c8ac294-79c1-4d4c-997b-2924aa84604f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408', 'volume_name': 'volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:46:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-bbbc041e-a31c-469b-85c2-c8016aa58ccb tempest-GroupSnapshotsTest-422127898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d063a875-3b6e-4ac9-9833-68f51c580a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:46:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-bbbc041e-a31c-469b-85c2-c8016aa58ccb tempest-GroupSnapshotsTest-422127898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d063a875-3b6e-4ac9-9833-68f51c580a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:46:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-bbbc041e-a31c-469b-85c2-c8016aa58ccb tempest-GroupSnapshotsTest-422127898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cd11711-de6d-4e9f-ae5b-fd0c7ad673f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:46:51 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-bbbc041e-a31c-469b-85c2-c8016aa58ccb tempest-GroupSnapshotsTest-422127898 None] Volume 0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408', 'volume_size': 1}
Nov 06 11:46:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-bbbc041e-a31c-469b-85c2-c8016aa58ccb tempest-GroupSnapshotsTest-422127898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:46:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-bbbc041e-a31c-469b-85c2-c8016aa58ccb tempest-GroupSnapshotsTest-422127898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:46:51 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-bbbc041e-a31c-469b-85c2-c8016aa58ccb tempest-GroupSnapshotsTest-422127898 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d4e71c45-402f-46d5-b879-7fd6e045aa45,created_at=2026-11-06T10:46:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1577992745',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d4e71c45-402f-46d5-b879-7fd6e045aa45,host='devstack@QuobyteHD#QuobyteHD',id=0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3266d51642f342d58f397aa7393a8e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:46:52Z,use_quota=True,user_id='eed02d9bb5d7479492dcb8e06e26c4b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dbc37c1-9a21-4f74-872e-32e71e81c9c1),volume_type_id=4dbc37c1-9a21-4f74-872e-32e71e81c9c1)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:46:51 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-bbbc041e-a31c-469b-85c2-c8016aa58ccb tempest-GroupSnapshotsTest-422127898 None] Creating volume 0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:46:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-bbbc041e-a31c-469b-85c2-c8016aa58ccb tempest-GroupSnapshotsTest-422127898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:46:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-bbbc041e-a31c-469b-85c2-c8016aa58ccb tempest-GroupSnapshotsTest-422127898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:46:51 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-bbbc041e-a31c-469b-85c2-c8016aa58ccb tempest-GroupSnapshotsTest-422127898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:46:51 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-bbbc041e-a31c-469b-85c2-c8016aa58ccb tempest-GroupSnapshotsTest-422127898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:46:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-bbbc041e-a31c-469b-85c2-c8016aa58ccb tempest-GroupSnapshotsTest-422127898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:46:51 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-bbbc041e-a31c-469b-85c2-c8016aa58ccb tempest-GroupSnapshotsTest-422127898 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:46:51 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-bbbc041e-a31c-469b-85c2-c8016aa58ccb tempest-GroupSnapshotsTest-422127898 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:46:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bbbc041e-a31c-469b-85c2-c8016aa58ccb tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:51 devstack sudo[93056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408 1073741824
Nov 06 11:46:51 devstack sudo[93056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:52 devstack sudo[93056]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bbbc041e-a31c-469b-85c2-c8016aa58ccb tempest-GroupSnapshotsTest-422127898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408 1073741824" returned: 0 in 0.562s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bbbc041e-a31c-469b-85c2-c8016aa58ccb tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:52 devstack sudo[93063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408
Nov 06 11:46:52 devstack sudo[93063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:52 devstack sudo[93063]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bbbc041e-a31c-469b-85c2-c8016aa58ccb tempest-GroupSnapshotsTest-422127898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408" returned: 0 in 0.364s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:52 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-bbbc041e-a31c-469b-85c2-c8016aa58ccb tempest-GroupSnapshotsTest-422127898 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:46:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-bbbc041e-a31c-469b-85c2-c8016aa58ccb tempest-GroupSnapshotsTest-422127898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:46:52 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-bbbc041e-a31c-469b-85c2-c8016aa58ccb tempest-GroupSnapshotsTest-422127898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cd11711-de6d-4e9f-ae5b-fd0c7ad673f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:46:52 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-bbbc041e-a31c-469b-85c2-c8016aa58ccb tempest-GroupSnapshotsTest-422127898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3600c930-8a0e-41e3-8940-b4bf0662898d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:46:53 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-bbbc041e-a31c-469b-85c2-c8016aa58ccb tempest-GroupSnapshotsTest-422127898 None] Volume volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408 (0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408): created successfully
Nov 06 11:46:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-bbbc041e-a31c-469b-85c2-c8016aa58ccb tempest-GroupSnapshotsTest-422127898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3600c930-8a0e-41e3-8940-b4bf0662898d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:46:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-bbbc041e-a31c-469b-85c2-c8016aa58ccb tempest-GroupSnapshotsTest-422127898 None] Flow 'volume_create_manager' (3d599d52-8ded-4cea-adc5-9ccf978993ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:46:53 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-bbbc041e-a31c-469b-85c2-c8016aa58ccb tempest-GroupSnapshotsTest-422127898 None] Created volume successfully.
Nov 06 11:46:54 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-bf7e4dfe-4e64-4ef2-a3af-c1ef59116163 tempest-GroupSnapshotsTest-422127898 None] GroupSnapshot d998cbb0-6582-4277-98b1-3bd6c914f400: creating.
Nov 06 11:46:54 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-bf7e4dfe-4e64-4ef2-a3af-c1ef59116163 tempest-GroupSnapshotsTest-422127898 None] Group snapshot d998cbb0-6582-4277-98b1-3bd6c914f400: creating. {{(pid=87165) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 06 11:46:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-bf7e4dfe-4e64-4ef2-a3af-c1ef59116163 tempest-GroupSnapshotsTest-422127898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:46:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-bf7e4dfe-4e64-4ef2-a3af-c1ef59116163 tempest-GroupSnapshotsTest-422127898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:46:54 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-bf7e4dfe-4e64-4ef2-a3af-c1ef59116163 tempest-GroupSnapshotsTest-422127898 None] Creating offline snapshot 89ca168b-a278-4f9e-b847-25c2ab49d199 of volume 0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408 {{(pid=87165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 11:46:54 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5151a26c-f505-40e5-bbaa-a22a34e4c18c]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:46:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bf7e4dfe-4e64-4ef2-a3af-c1ef59116163 tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:54 devstack sudo[93069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408
Nov 06 11:46:54 devstack sudo[93069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:55 devstack sudo[93069]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bf7e4dfe-4e64-4ef2-a3af-c1ef59116163 tempest-GroupSnapshotsTest-422127898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408" returned: 0 in 0.560s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bf7e4dfe-4e64-4ef2-a3af-c1ef59116163 tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408.89ca168b-a278-4f9e-b847-25c2ab49d199 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:55 devstack sudo[93074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408.89ca168b-a278-4f9e-b847-25c2ab49d199 1G
Nov 06 11:46:55 devstack sudo[93074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:55 devstack sudo[93074]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bf7e4dfe-4e64-4ef2-a3af-c1ef59116163 tempest-GroupSnapshotsTest-422127898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408.89ca168b-a278-4f9e-b847-25c2ab49d199 1G" returned: 0 in 0.664s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bf7e4dfe-4e64-4ef2-a3af-c1ef59116163 tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408.89ca168b-a278-4f9e-b847-25c2ab49d199 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:56 devstack sudo[93080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408.89ca168b-a278-4f9e-b847-25c2ab49d199
Nov 06 11:46:56 devstack sudo[93080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:56 devstack sudo[93080]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bf7e4dfe-4e64-4ef2-a3af-c1ef59116163 tempest-GroupSnapshotsTest-422127898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408.89ca168b-a278-4f9e-b847-25c2ab49d199" returned: 0 in 0.473s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:56 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-bf7e4dfe-4e64-4ef2-a3af-c1ef59116163 tempest-GroupSnapshotsTest-422127898 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408.89ca168b-a278-4f9e-b847-25c2ab49d199 is being set with open permissions: ugo+rw: NotImplementedError
Nov 06 11:46:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bf7e4dfe-4e64-4ef2-a3af-c1ef59116163 tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408.89ca168b-a278-4f9e-b847-25c2ab49d199 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:56 devstack sudo[93088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408.89ca168b-a278-4f9e-b847-25c2ab49d199
Nov 06 11:46:56 devstack sudo[93088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:56 devstack sudo[93088]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bf7e4dfe-4e64-4ef2-a3af-c1ef59116163 tempest-GroupSnapshotsTest-422127898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408.89ca168b-a278-4f9e-b847-25c2ab49d199" returned: 0 in 0.395s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bf7e4dfe-4e64-4ef2-a3af-c1ef59116163 tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:56 devstack sudo[93102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408.info
Nov 06 11:46:56 devstack sudo[93102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:57 devstack sudo[93102]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bf7e4dfe-4e64-4ef2-a3af-c1ef59116163 tempest-GroupSnapshotsTest-422127898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408.info" returned: 0 in 0.485s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:57 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-bf7e4dfe-4e64-4ef2-a3af-c1ef59116163 tempest-GroupSnapshotsTest-422127898 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 06 11:46:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bf7e4dfe-4e64-4ef2-a3af-c1ef59116163 tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:57 devstack sudo[93128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408.info
Nov 06 11:46:57 devstack sudo[93128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:46:57 devstack sudo[93128]: pam_unix(sudo:session): session closed for user root
Nov 06 11:46:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bf7e4dfe-4e64-4ef2-a3af-c1ef59116163 tempest-GroupSnapshotsTest-422127898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408.info" returned: 0 in 0.546s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:46:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-bf7e4dfe-4e64-4ef2-a3af-c1ef59116163 tempest-GroupSnapshotsTest-422127898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.244s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:46:58 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-bf7e4dfe-4e64-4ef2-a3af-c1ef59116163 tempest-GroupSnapshotsTest-422127898 None] group_snapshot d998cbb0-6582-4277-98b1-3bd6c914f400: created successfully
Nov 06 11:46:58 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-dd0cf43f-62cb-419e-adf1-fbabc97bcbff req-c2c2b9e3-3bfd-42e0-94bb-fea6036326e0 tempest-ServerActionsTestOtherA-2004102178 None] Terminate volume connection completed successfully.
Nov 06 11:46:58 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-dd0cf43f-62cb-419e-adf1-fbabc97bcbff req-c2c2b9e3-3bfd-42e0-94bb-fea6036326e0 tempest-ServerActionsTestOtherA-2004102178 None] Deleting attachment 7749bef6-e176-43f5-aa26-70dedf4272db. {{(pid=87165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 11:46:59 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-777f8848-67f2-4574-aebf-19d3495b4493 tempest-GroupSnapshotsTest-422127898 None] group_snapshot d998cbb0-6582-4277-98b1-3bd6c914f400: deleting
Nov 06 11:46:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-777f8848-67f2-4574-aebf-19d3495b4493 tempest-GroupSnapshotsTest-422127898 None] group_snapshot d998cbb0-6582-4277-98b1-3bd6c914f400: deleting {{(pid=87165) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 06 11:46:59 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-777f8848-67f2-4574-aebf-19d3495b4493 tempest-GroupSnapshotsTest-422127898 None] Acquiring lock "cinder-quobyte-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:46:59 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-777f8848-67f2-4574-aebf-19d3495b4493 tempest-GroupSnapshotsTest-422127898 None] Lock "cinder-quobyte-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:46:59 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-777f8848-67f2-4574-aebf-19d3495b4493 tempest-GroupSnapshotsTest-422127898 None] Acquiring lock "cinder-quobyte-89ca168b-a278-4f9e-b847-25c2ab49d199" by "_delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:46:59 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-777f8848-67f2-4574-aebf-19d3495b4493 tempest-GroupSnapshotsTest-422127898 None] Lock "cinder-quobyte-89ca168b-a278-4f9e-b847-25c2ab49d199" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:46:59 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-777f8848-67f2-4574-aebf-19d3495b4493 tempest-GroupSnapshotsTest-422127898 None] Deleting offline snapshot 89ca168b-a278-4f9e-b847-25c2ab49d199 of volume 0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 11:46:59 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-777f8848-67f2-4574-aebf-19d3495b4493 tempest-GroupSnapshotsTest-422127898 None] snapshot_file for this snap is: volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408.89ca168b-a278-4f9e-b847-25c2ab49d199 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 11:46:59 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[24596854-05c0-4b41-b40f-3b786e4bb931]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:46:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-777f8848-67f2-4574-aebf-19d3495b4493 tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408.89ca168b-a278-4f9e-b847-25c2ab49d199 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:46:59 devstack sudo[93139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408.89ca168b-a278-4f9e-b847-25c2ab49d199
Nov 06 11:46:59 devstack sudo[93139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:00 devstack sudo[93139]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-777f8848-67f2-4574-aebf-19d3495b4493 tempest-GroupSnapshotsTest-422127898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408.89ca168b-a278-4f9e-b847-25c2ab49d199" returned: 0 in 0.633s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:00 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-777f8848-67f2-4574-aebf-19d3495b4493 tempest-GroupSnapshotsTest-422127898 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:47:00 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[528a7e22-32bb-4f38-aabb-7ad97f4b9da7]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:47:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-777f8848-67f2-4574-aebf-19d3495b4493 tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:00 devstack sudo[93170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408
Nov 06 11:47:00 devstack sudo[93170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:00 devstack sudo[93170]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-777f8848-67f2-4574-aebf-19d3495b4493 tempest-GroupSnapshotsTest-422127898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408" returned: 0 in 0.506s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-777f8848-67f2-4574-aebf-19d3495b4493 tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408.89ca168b-a278-4f9e-b847-25c2ab49d199 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:00 devstack sudo[93178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408.89ca168b-a278-4f9e-b847-25c2ab49d199
Nov 06 11:47:00 devstack sudo[93178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:01 devstack sudo[93178]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-777f8848-67f2-4574-aebf-19d3495b4493 tempest-GroupSnapshotsTest-422127898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408.89ca168b-a278-4f9e-b847-25c2ab49d199" returned: 0 in 0.542s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-777f8848-67f2-4574-aebf-19d3495b4493 tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408.89ca168b-a278-4f9e-b847-25c2ab49d199 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:01 devstack sudo[93185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408.89ca168b-a278-4f9e-b847-25c2ab49d199
Nov 06 11:47:01 devstack sudo[93185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:01 devstack sudo[93185]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-777f8848-67f2-4574-aebf-19d3495b4493 tempest-GroupSnapshotsTest-422127898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408.89ca168b-a278-4f9e-b847-25c2ab49d199" returned: 0 in 0.310s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:01 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-777f8848-67f2-4574-aebf-19d3495b4493 tempest-GroupSnapshotsTest-422127898 None] Lock "cinder-quobyte-89ca168b-a278-4f9e-b847-25c2ab49d199" released by "_delete_snapshot" :: held 2.228s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:47:01 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-777f8848-67f2-4574-aebf-19d3495b4493 tempest-GroupSnapshotsTest-422127898 None] Lock "cinder-quobyte-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408" released by "delete_snapshot" :: held 2.286s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:47:02 devstack cinder-volume[87165]: WARNING cinder.quota [None req-777f8848-67f2-4574-aebf-19d3495b4493 tempest-GroupSnapshotsTest-422127898 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-942979027 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-942979027, it is now deprecated. Please use the default quota class for default quota.
Nov 06 11:47:02 devstack cinder-volume[87165]: WARNING cinder.quota [None req-777f8848-67f2-4574-aebf-19d3495b4493 tempest-GroupSnapshotsTest-422127898 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-942979027 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-942979027, it is now deprecated. Please use the default quota class for default quota.
Nov 06 11:47:02 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-777f8848-67f2-4574-aebf-19d3495b4493 tempest-GroupSnapshotsTest-422127898 None] Created reservations ['45138e32-6fb7-47f3-9209-bc303117a1c5', 'bc0c3866-98ec-442a-a0cc-9946621d306c', '71e9393f-51e7-4b2a-a3d9-91019843ed07', '38f76c6e-7514-46af-b35f-d4b890840fae'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:47:02 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-777f8848-67f2-4574-aebf-19d3495b4493 tempest-GroupSnapshotsTest-422127898 None] group_snapshot d998cbb0-6582-4277-98b1-3bd6c914f400: deleted successfully
Nov 06 11:47:03 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ab7e387f-058f-4325-8296-c99737d7aec8 tempest-GroupSnapshotsTest-422127898 None] Acquiring lock "cinder-quobyte-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:47:03 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ab7e387f-058f-4325-8296-c99737d7aec8 tempest-GroupSnapshotsTest-422127898 None] Lock "cinder-quobyte-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408" acquired by "delete_volume" :: waited 0.017s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:47:03 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf83ff1-c426-4d16-8d41-a0ac21e44656]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:47:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ab7e387f-058f-4325-8296-c99737d7aec8 tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:03 devstack sudo[93205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408
Nov 06 11:47:03 devstack sudo[93205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:03 devstack sudo[93205]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ab7e387f-058f-4325-8296-c99737d7aec8 tempest-GroupSnapshotsTest-422127898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408" returned: 0 in 0.559s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ab7e387f-058f-4325-8296-c99737d7aec8 tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:04 devstack sudo[93211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408
Nov 06 11:47:04 devstack sudo[93211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:04 devstack sudo[93211]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ab7e387f-058f-4325-8296-c99737d7aec8 tempest-GroupSnapshotsTest-422127898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408" returned: 0 in 0.360s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:04 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ab7e387f-058f-4325-8296-c99737d7aec8 tempest-GroupSnapshotsTest-422127898 None] Lock "cinder-quobyte-0eb7bf14-ef80-4f91-a60f-b4dcf1bfe408" released by "delete_volume" :: held 1.052s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:47:04 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-ab7e387f-058f-4325-8296-c99737d7aec8 tempest-GroupSnapshotsTest-422127898 None] Created reservations ['7f1083d6-94ba-4d5b-8261-9c46560f05be'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:47:04 devstack cinder-volume[87165]: WARNING cinder.quota [None req-ab7e387f-058f-4325-8296-c99737d7aec8 tempest-GroupSnapshotsTest-422127898 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-942979027 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-942979027, it is now deprecated. Please use the default quota class for default quota.
Nov 06 11:47:04 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-ab7e387f-058f-4325-8296-c99737d7aec8 tempest-GroupSnapshotsTest-422127898 None] Created reservations ['3d76cbb2-1b16-4764-8070-e2c0184d1b59', '31570401-7737-4907-81fd-66f5899a4561', 'dd0b6983-645f-4daf-9d18-dd307c2563d6', '98f265ce-855c-43eb-9343-d78f40f17fd4'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:47:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ab7e387f-058f-4325-8296-c99737d7aec8 tempest-GroupSnapshotsTest-422127898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:47:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ab7e387f-058f-4325-8296-c99737d7aec8 tempest-GroupSnapshotsTest-422127898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:47:04 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ab7e387f-058f-4325-8296-c99737d7aec8 tempest-GroupSnapshotsTest-422127898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:47:04 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ab7e387f-058f-4325-8296-c99737d7aec8 tempest-GroupSnapshotsTest-422127898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:47:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ab7e387f-058f-4325-8296-c99737d7aec8 tempest-GroupSnapshotsTest-422127898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:47:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ab7e387f-058f-4325-8296-c99737d7aec8 tempest-GroupSnapshotsTest-422127898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:04 devstack sudo[93215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:47:04 devstack sudo[93215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:05 devstack sudo[93215]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ab7e387f-058f-4325-8296-c99737d7aec8 tempest-GroupSnapshotsTest-422127898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.400s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:05 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-ab7e387f-058f-4325-8296-c99737d7aec8 tempest-GroupSnapshotsTest-422127898 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:47:05 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-ab7e387f-058f-4325-8296-c99737d7aec8 tempest-GroupSnapshotsTest-422127898 None] Delete group completed successfully.
Nov 06 11:47:08 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:47:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] Flow 'volume_create_manager' (4f823f58-4627-4951-a85e-d4b2c7856f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:47:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60224b52-85a8-4748-87f0-a5a97c07454c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:47:08 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:UPDATE=119,cinder:SELECT=123,cinder:INSERT=25,cinder:DELETE=6 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 11:47:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60224b52-85a8-4748-87f0-a5a97c07454c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-573983040',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9513919-b7c8-4a94-a4c5-7077cd93ac75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef3e348d1844d75870ff73c0714265e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:47:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:47:09Z,use_quota=True,user_id='afa596603cec4a98815c9ba4368f3ebc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:47:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87163a82-e149-4d10-a483-236ed7fed192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:47:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87163a82-e149-4d10-a483-236ed7fed192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:47:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c174aa19-c731-48d3-b26c-ab165fec5535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:47:08 devstack cinder-volume[87165]: DEBUG cinder.image.glance [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] Creating Keystone auth plugin from conf {{(pid=87165) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 06 11:47:09 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c174aa19-c731-48d3-b26c-ab165fec5535) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a9513919-b7c8-4a94-a4c5-7077cd93ac75', 'volume_name': 'volume-a9513919-b7c8-4a94-a4c5-7077cd93ac75', 'volume_size': 1, 'image_id': 'c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '28942f14a9e2424ca7367c6efa5fb47a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'created_at': datetime.datetime(2026, 11, 6, 10, 37, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 10, 37, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c315441d-48d2-43fb-b56a-c983b5a6f9cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x742c1e9b82f0>}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:47:09 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c155360d-f255-48b2-8551-277905a9f62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:47:09 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c155360d-f255-48b2-8551-277905a9f62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:47:09 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e713ed49-32f0-46fa-bc00-0f6ec47f5d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:47:09 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] Volume a9513919-b7c8-4a94-a4c5-7077cd93ac75: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a9513919-b7c8-4a94-a4c5-7077cd93ac75', 'volume_size': 1, 'image_id': 'c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '28942f14a9e2424ca7367c6efa5fb47a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'created_at': datetime.datetime(2026, 11, 6, 10, 37, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 10, 37, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c315441d-48d2-43fb-b56a-c983b5a6f9cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x742c1e9b82f0>}
Nov 06 11:47:09 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] Trying to clone a9513919-b7c8-4a94-a4c5-7077cd93ac75 from image c315441d-48d2-43fb-b56a-c983b5a6f9cd at location (None, [{'url': 'file:///opt/stack/data/glance/images/c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'metadata': {}}]). {{(pid=87165) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 06 11:47:10 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_0fs16bp8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87165) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 06 11:47:10 devstack cinder-volume[87165]: INFO cinder.image.image_utils [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] Image download 20.69 MB at 20.69 MB/s
Nov 06 11:47:10 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a98bda1-3dd2-4d56-bdb1-026bade0758c]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:47:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_0fs16bp8devstack@QuobyteHD {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:10 devstack sudo[93316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_0fs16bp8devstack@QuobyteHD
Nov 06 11:47:10 devstack sudo[93316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:10 devstack sudo[93316]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_0fs16bp8devstack@QuobyteHD" returned: 0 in 0.516s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:10 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] Temporary image c315441d-48d2-43fb-b56a-c983b5a6f9cd is fetched for user afa596603cec4a98815c9ba4368f3ebc. {{(pid=87165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 06 11:47:11 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[05cc5cec-b295-4904-994a-4974f9d93263]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:47:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_0fs16bp8devstack@QuobyteHD {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:11 devstack sudo[93321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_0fs16bp8devstack@QuobyteHD
Nov 06 11:47:11 devstack sudo[93321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:11 devstack sudo[93321]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_0fs16bp8devstack@QuobyteHD" returned: 0 in 0.505s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:47:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:47:11 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-573983040',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9513919-b7c8-4a94-a4c5-7077cd93ac75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef3e348d1844d75870ff73c0714265e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:47:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:47:09Z,use_quota=True,user_id='afa596603cec4a98815c9ba4368f3ebc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:47:11 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] Creating volume a9513919-b7c8-4a94-a4c5-7077cd93ac75 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:47:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:47:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:47:11 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:47:11 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:47:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:47:11 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:47:11 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:47:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a9513919-b7c8-4a94-a4c5-7077cd93ac75 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:11 devstack sudo[93326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a9513919-b7c8-4a94-a4c5-7077cd93ac75 1073741824
Nov 06 11:47:11 devstack sudo[93326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:12 devstack sudo[93326]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a9513919-b7c8-4a94-a4c5-7077cd93ac75 1073741824" returned: 0 in 0.702s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a9513919-b7c8-4a94-a4c5-7077cd93ac75 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:12 devstack sudo[93332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a9513919-b7c8-4a94-a4c5-7077cd93ac75
Nov 06 11:47:12 devstack sudo[93332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:12 devstack sudo[93332]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a9513919-b7c8-4a94-a4c5-7077cd93ac75" returned: 0 in 0.366s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:12 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:47:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:47:12 devstack cinder-volume[87165]: DEBUG cinder.volume.volume_utils [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] Attempting download of c315441d-48d2-43fb-b56a-c983b5a6f9cd ((None, [{'url': 'file:///opt/stack/data/glance/images/c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'metadata': {}}])) to volume a9513919-b7c8-4a94-a4c5-7077cd93ac75. {{(pid=87165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 06 11:47:12 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ac70ba-7d23-41a3-9810-21c18767079c]: (4, 'raw') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:47:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c315441d-48d2-43fb-b56a-c983b5a6f9cd_cfhb2f2c {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:13 devstack sudo[93335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c315441d-48d2-43fb-b56a-c983b5a6f9cd_cfhb2f2c
Nov 06 11:47:13 devstack sudo[93335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:13 devstack sudo[93335]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c315441d-48d2-43fb-b56a-c983b5a6f9cd_cfhb2f2c" returned: 0 in 0.583s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c315441d-48d2-43fb-b56a-c983b5a6f9cd_cfhb2f2c {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:13 devstack sudo[93340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c315441d-48d2-43fb-b56a-c983b5a6f9cd_cfhb2f2c
Nov 06 11:47:13 devstack sudo[93340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:14 devstack sudo[93340]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c315441d-48d2-43fb-b56a-c983b5a6f9cd_cfhb2f2c" returned: 1 in 0.511s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c315441d-48d2-43fb-b56a-c983b5a6f9cd_cfhb2f2c' failed. Not Retrying. {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 11:47:14 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[667da9a4-c543-424f-9935-adee4eecf4ea]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:47:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_0fs16bp8devstack@QuobyteHD {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:14 devstack sudo[93345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_0fs16bp8devstack@QuobyteHD
Nov 06 11:47:14 devstack sudo[93345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:14 devstack sudo[93345]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_0fs16bp8devstack@QuobyteHD" returned: 0 in 0.675s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:14 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] c315441d-48d2-43fb-b56a-c983b5a6f9cd was qcow2, converting to qcow2 {{(pid=87165) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 06 11:47:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_0fs16bp8devstack@QuobyteHD /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a9513919-b7c8-4a94-a4c5-7077cd93ac75 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:14 devstack sudo[93351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_0fs16bp8devstack@QuobyteHD /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a9513919-b7c8-4a94-a4c5-7077cd93ac75
Nov 06 11:47:14 devstack sudo[93351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:17 devstack cinder-volume[87165]: DEBUG oslo_service.periodic_task [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 11:47:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:47:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:47:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:47:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:47:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:47:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:17 devstack sudo[93359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:47:17 devstack sudo[93359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:17 devstack sudo[93359]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.498s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:17 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:47:17 devstack cinder-volume[87165]: DEBUG oslo_service.periodic_task [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running periodic task VolumeManager._thread_info {{(pid=87165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 11:47:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] thread count: 28 {{(pid=87165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 11:47:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] thread info: [<_MainThread(MainThread, started 127732956901504)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127732842693056)>, <Thread(Thread-3 (stat_writer), started daemon 127732841891136)>, <Thread(Rabbit-heartbeat, started daemon 127732842515648)>, <Thread(Thread-5 (_runner), started daemon 127732840534464)>, <Thread(Thread-7 (_runner), started daemon 127732840636032)>, <Thread(fd_logger, started daemon 127732838664256)>, <Thread(privsep_reader, started daemon 127732838673408)>, <Thread(tpool_thread_0, started daemon 127732829828800)>, <Thread(tpool_thread_1, started daemon 127732821436096)>, <Thread(tpool_thread_2, started daemon 127732813043392)>, <Thread(tpool_thread_3, started daemon 127732804650688)>, <Thread(tpool_thread_4, started daemon 127732796257984)>, <Thread(tpool_thread_5, started daemon 127732787865280)>, <Thread(tpool_thread_6, started daemon 127732779456192)>, <Thread(tpool_thread_7, started daemon 127732771047104)>, <Thread(tpool_thread_8, started daemon 127732762638016)>, <Thread(tpool_thread_9, started daemon 127732754228928)>, <Thread(tpool_thread_10, started daemon 127732745819840)>, <Thread(tpool_thread_11, started daemon 127732737410752)>, <Thread(tpool_thread_12, started daemon 127732729001664)>, <Thread(tpool_thread_13, started daemon 127732720592576)>, <Thread(tpool_thread_14, started daemon 127732712183488)>, <Thread(tpool_thread_15, started daemon 127732703774400)>, <Thread(tpool_thread_16, started daemon 127732695365312)>, <Thread(tpool_thread_17, started daemon 127732686956224)>, <Thread(tpool_thread_18, started daemon 127732678547136)>, <Thread(tpool_thread_19, started daemon 127732670138048)>] {{(pid=87165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 11:47:17 devstack sudo[93351]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_0fs16bp8devstack@QuobyteHD /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a9513919-b7c8-4a94-a4c5-7077cd93ac75" returned: 0 in 2.953s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:17 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_0fs16bp8devstack@QuobyteHD, size 112.00 MB, duration 2.95 sec, destination /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a9513919-b7c8-4a94-a4c5-7077cd93ac75 {{(pid=87165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 11:47:17 devstack cinder-volume[87165]: INFO cinder.image.image_utils [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] Converted 112.00 MB image at 37.91 MB/s
Nov 06 11:47:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a9513919-b7c8-4a94-a4c5-7077cd93ac75 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:17 devstack sudo[93362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a9513919-b7c8-4a94-a4c5-7077cd93ac75 1G
Nov 06 11:47:17 devstack sudo[93362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:18 devstack sudo[93362]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a9513919-b7c8-4a94-a4c5-7077cd93ac75 1G" returned: 0 in 0.425s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:18 devstack cinder-volume[87165]: DEBUG cinder.volume.volume_utils [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] Downloaded image c315441d-48d2-43fb-b56a-c983b5a6f9cd ((None, [{'url': 'file:///opt/stack/data/glance/images/c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'metadata': {}}])) to volume a9513919-b7c8-4a94-a4c5-7077cd93ac75 successfully. {{(pid=87165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 06 11:47:18 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] Temporary image c315441d-48d2-43fb-b56a-c983b5a6f9cd for user afa596603cec4a98815c9ba4368f3ebc is deleted. {{(pid=87165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 06 11:47:18 devstack cinder-volume[87165]: DEBUG cinder.volume.volume_utils [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] Marking volume a9513919-b7c8-4a94-a4c5-7077cd93ac75 as bootable. {{(pid=87165) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 06 11:47:18 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] Copying metadata from image c315441d-48d2-43fb-b56a-c983b5a6f9cd to a9513919-b7c8-4a94-a4c5-7077cd93ac75. {{(pid=87165) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 06 11:47:18 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] Creating volume glance metadata for volume a9513919-b7c8-4a94-a4c5-7077cd93ac75 backed by image c315441d-48d2-43fb-b56a-c983b5a6f9cd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87165) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 06 11:47:18 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e713ed49-32f0-46fa-bc00-0f6ec47f5d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9513919-b7c8-4a94-a4c5-7077cd93ac75', 'volume_size': 1, 'image_id': 'c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '28942f14a9e2424ca7367c6efa5fb47a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'created_at': datetime.datetime(2026, 11, 6, 10, 37, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 10, 37, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c315441d-48d2-43fb-b56a-c983b5a6f9cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x742c1e9b82f0>}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:47:18 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7c1aa3a-4d8c-4f6b-b7df-0dd3ae0d9ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:47:18 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] Volume volume-a9513919-b7c8-4a94-a4c5-7077cd93ac75 (a9513919-b7c8-4a94-a4c5-7077cd93ac75): created successfully
Nov 06 11:47:18 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7c1aa3a-4d8c-4f6b-b7df-0dd3ae0d9ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:47:18 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] Flow 'volume_create_manager' (4f823f58-4627-4951-a85e-d4b2c7856f29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:47:18 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-ca322733-a58c-4536-ba76-05533798456b tempest-ServerActionsTestOtherA-2004102178 None] Created volume successfully.
Nov 06 11:47:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-e2f51162-b66f-40d5-beb1-0374fe9da514 req-7d88e283-905c-4290-bbbc-def17c2ca090 tempest-ServerActionsTestOtherA-2004102178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:47:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-e2f51162-b66f-40d5-beb1-0374fe9da514 req-7d88e283-905c-4290-bbbc-def17c2ca090 tempest-ServerActionsTestOtherA-2004102178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:47:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-e2f51162-b66f-40d5-beb1-0374fe9da514 req-7d88e283-905c-4290-bbbc-def17c2ca090 tempest-ServerActionsTestOtherA-2004102178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:47:22 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-e2f51162-b66f-40d5-beb1-0374fe9da514 req-7d88e283-905c-4290-bbbc-def17c2ca090 tempest-ServerActionsTestOtherA-2004102178 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50', 'name': 'volume-a9513919-b7c8-4a94-a4c5-7077cd93ac75', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1aed1bc7-e50c-4d34-85dd-d4a2bd75fca9', 'enforce_multipath': True} {{(pid=87165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 11:47:22 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-e2f51162-b66f-40d5-beb1-0374fe9da514 req-7d88e283-905c-4290-bbbc-def17c2ca090 tempest-ServerActionsTestOtherA-2004102178 None] attachment_update completed successfully.
Nov 06 11:47:30 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:UPDATE=78,cinder:SELECT=107,cinder:INSERT=26,cinder:DELETE=1 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 11:47:30 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8e7ec8c-12af-4324-8af8-b668ca4c1842 tempest-SnapshotsActionsTest-1390245303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:47:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e8e7ec8c-12af-4324-8af8-b668ca4c1842 tempest-SnapshotsActionsTest-1390245303 None] Flow 'volume_create_manager' (f8f58471-ec66-454e-88a3-e8376ba226c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:47:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e8e7ec8c-12af-4324-8af8-b668ca4c1842 tempest-SnapshotsActionsTest-1390245303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0c0971b-503f-4bca-b3d2-18ce2e8e9111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:47:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e8e7ec8c-12af-4324-8af8-b668ca4c1842 tempest-SnapshotsActionsTest-1390245303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0c0971b-503f-4bca-b3d2-18ce2e8e9111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1804945643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5463bc8-5b06-4d57-a6e0-b87504e71d57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e95d8e23c5a42e8968ae8f36ce71ded',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:47:30Z,use_quota=True,user_id='be557caad12f452382c5dd7360bc956c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:47:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e8e7ec8c-12af-4324-8af8-b668ca4c1842 tempest-SnapshotsActionsTest-1390245303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (613c1f7e-7cb5-4429-bfcd-2c73ac227166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:47:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e8e7ec8c-12af-4324-8af8-b668ca4c1842 tempest-SnapshotsActionsTest-1390245303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (613c1f7e-7cb5-4429-bfcd-2c73ac227166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:47:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e8e7ec8c-12af-4324-8af8-b668ca4c1842 tempest-SnapshotsActionsTest-1390245303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ceebb32-f066-4b4b-9939-994068377083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:47:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e8e7ec8c-12af-4324-8af8-b668ca4c1842 tempest-SnapshotsActionsTest-1390245303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ceebb32-f066-4b4b-9939-994068377083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5463bc8-5b06-4d57-a6e0-b87504e71d57', 'volume_name': 'volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:47:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e8e7ec8c-12af-4324-8af8-b668ca4c1842 tempest-SnapshotsActionsTest-1390245303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (127d9bae-63ae-43ed-b4a3-9bc193bc2a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:47:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e8e7ec8c-12af-4324-8af8-b668ca4c1842 tempest-SnapshotsActionsTest-1390245303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (127d9bae-63ae-43ed-b4a3-9bc193bc2a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:47:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e8e7ec8c-12af-4324-8af8-b668ca4c1842 tempest-SnapshotsActionsTest-1390245303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32e0f2b1-c671-4643-891e-c1b71e0ae287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:47:30 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-e8e7ec8c-12af-4324-8af8-b668ca4c1842 tempest-SnapshotsActionsTest-1390245303 None] Volume c5463bc8-5b06-4d57-a6e0-b87504e71d57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57', 'volume_size': 1}
Nov 06 11:47:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e8e7ec8c-12af-4324-8af8-b668ca4c1842 tempest-SnapshotsActionsTest-1390245303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:47:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e8e7ec8c-12af-4324-8af8-b668ca4c1842 tempest-SnapshotsActionsTest-1390245303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:47:30 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-e8e7ec8c-12af-4324-8af8-b668ca4c1842 tempest-SnapshotsActionsTest-1390245303 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1804945643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5463bc8-5b06-4d57-a6e0-b87504e71d57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e95d8e23c5a42e8968ae8f36ce71ded',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:47:30Z,use_quota=True,user_id='be557caad12f452382c5dd7360bc956c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:47:30 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-e8e7ec8c-12af-4324-8af8-b668ca4c1842 tempest-SnapshotsActionsTest-1390245303 None] Creating volume c5463bc8-5b06-4d57-a6e0-b87504e71d57 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:47:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e8e7ec8c-12af-4324-8af8-b668ca4c1842 tempest-SnapshotsActionsTest-1390245303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:47:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e8e7ec8c-12af-4324-8af8-b668ca4c1842 tempest-SnapshotsActionsTest-1390245303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:47:30 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-e8e7ec8c-12af-4324-8af8-b668ca4c1842 tempest-SnapshotsActionsTest-1390245303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:47:30 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-e8e7ec8c-12af-4324-8af8-b668ca4c1842 tempest-SnapshotsActionsTest-1390245303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:47:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e8e7ec8c-12af-4324-8af8-b668ca4c1842 tempest-SnapshotsActionsTest-1390245303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:47:30 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-e8e7ec8c-12af-4324-8af8-b668ca4c1842 tempest-SnapshotsActionsTest-1390245303 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:47:30 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-e8e7ec8c-12af-4324-8af8-b668ca4c1842 tempest-SnapshotsActionsTest-1390245303 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:47:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e8e7ec8c-12af-4324-8af8-b668ca4c1842 tempest-SnapshotsActionsTest-1390245303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:30 devstack sudo[93876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57 1073741824
Nov 06 11:47:30 devstack sudo[93876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:31 devstack sudo[93876]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e8e7ec8c-12af-4324-8af8-b668ca4c1842 tempest-SnapshotsActionsTest-1390245303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57 1073741824" returned: 0 in 0.813s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e8e7ec8c-12af-4324-8af8-b668ca4c1842 tempest-SnapshotsActionsTest-1390245303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:31 devstack sudo[93882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57
Nov 06 11:47:31 devstack sudo[93882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:31 devstack sudo[93882]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e8e7ec8c-12af-4324-8af8-b668ca4c1842 tempest-SnapshotsActionsTest-1390245303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57" returned: 0 in 0.556s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:31 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-e8e7ec8c-12af-4324-8af8-b668ca4c1842 tempest-SnapshotsActionsTest-1390245303 None] <== create_volume: return (1427ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:47:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e8e7ec8c-12af-4324-8af8-b668ca4c1842 tempest-SnapshotsActionsTest-1390245303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.429s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:47:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e8e7ec8c-12af-4324-8af8-b668ca4c1842 tempest-SnapshotsActionsTest-1390245303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32e0f2b1-c671-4643-891e-c1b71e0ae287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:47:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e8e7ec8c-12af-4324-8af8-b668ca4c1842 tempest-SnapshotsActionsTest-1390245303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18e832ec-78ca-4f65-ad52-b6a395adaa54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:47:31 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-e8e7ec8c-12af-4324-8af8-b668ca4c1842 tempest-SnapshotsActionsTest-1390245303 None] Volume volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57 (c5463bc8-5b06-4d57-a6e0-b87504e71d57): created successfully
Nov 06 11:47:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e8e7ec8c-12af-4324-8af8-b668ca4c1842 tempest-SnapshotsActionsTest-1390245303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18e832ec-78ca-4f65-ad52-b6a395adaa54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:47:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e8e7ec8c-12af-4324-8af8-b668ca4c1842 tempest-SnapshotsActionsTest-1390245303 None] Flow 'volume_create_manager' (f8f58471-ec66-454e-88a3-e8376ba226c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:47:31 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-e8e7ec8c-12af-4324-8af8-b668ca4c1842 tempest-SnapshotsActionsTest-1390245303 None] Created volume successfully.
Nov 06 11:47:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6bf90e9e-bf20-47fc-9748-24f0f53188e9 tempest-SnapshotsActionsTest-1390245303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:47:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6bf90e9e-bf20-47fc-9748-24f0f53188e9 tempest-SnapshotsActionsTest-1390245303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:47:33 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-6bf90e9e-bf20-47fc-9748-24f0f53188e9 tempest-SnapshotsActionsTest-1390245303 None] Creating offline snapshot e377ddc8-d1b7-4508-bbc0-a53d9b305da3 of volume c5463bc8-5b06-4d57-a6e0-b87504e71d57 {{(pid=87165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 11:47:33 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e4efc2-765a-434d-80d4-d0a4b1c36993]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:47:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6bf90e9e-bf20-47fc-9748-24f0f53188e9 tempest-SnapshotsActionsTest-1390245303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:33 devstack sudo[93932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57
Nov 06 11:47:33 devstack sudo[93932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:34 devstack sudo[93932]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6bf90e9e-bf20-47fc-9748-24f0f53188e9 tempest-SnapshotsActionsTest-1390245303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57" returned: 0 in 0.967s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6bf90e9e-bf20-47fc-9748-24f0f53188e9 tempest-SnapshotsActionsTest-1390245303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:34 devstack sudo[93961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3 1G
Nov 06 11:47:34 devstack sudo[93961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:34 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-114f84f9-b15c-4661-91c9-89ebf9c1e092 tempest-AttachVolumeNegativeTest-993089865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:47:35 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-114f84f9-b15c-4661-91c9-89ebf9c1e092 tempest-AttachVolumeNegativeTest-993089865 None] Flow 'volume_create_manager' (355e5455-bc8b-4856-b5ff-8e6cec591af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:47:35 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-114f84f9-b15c-4661-91c9-89ebf9c1e092 tempest-AttachVolumeNegativeTest-993089865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fca8c57-0a9f-4168-87b3-020944d16134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:47:35 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-114f84f9-b15c-4661-91c9-89ebf9c1e092 tempest-AttachVolumeNegativeTest-993089865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fca8c57-0a9f-4168-87b3-020944d16134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:47:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1865359641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6e37e7f-d3eb-4ac1-9175-3576ec837985,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3e5280a8be5403bb6364cec1e71368b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:47:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:47:35Z,use_quota=True,user_id='aac0f37412684b0ebdf18894bf8f8dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:47:35 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-114f84f9-b15c-4661-91c9-89ebf9c1e092 tempest-AttachVolumeNegativeTest-993089865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbd3fb19-d715-41ad-b259-929dcaac39eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:47:35 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-114f84f9-b15c-4661-91c9-89ebf9c1e092 tempest-AttachVolumeNegativeTest-993089865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbd3fb19-d715-41ad-b259-929dcaac39eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:47:35 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-114f84f9-b15c-4661-91c9-89ebf9c1e092 tempest-AttachVolumeNegativeTest-993089865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a31c59d-5e19-4c1a-8e17-4bed3f87e8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:47:35 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-114f84f9-b15c-4661-91c9-89ebf9c1e092 tempest-AttachVolumeNegativeTest-993089865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a31c59d-5e19-4c1a-8e17-4bed3f87e8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6e37e7f-d3eb-4ac1-9175-3576ec837985', 'volume_name': 'volume-e6e37e7f-d3eb-4ac1-9175-3576ec837985', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:47:35 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-114f84f9-b15c-4661-91c9-89ebf9c1e092 tempest-AttachVolumeNegativeTest-993089865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d67b7732-99d0-4ddd-a38e-2c6c6472140e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:47:35 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-114f84f9-b15c-4661-91c9-89ebf9c1e092 tempest-AttachVolumeNegativeTest-993089865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d67b7732-99d0-4ddd-a38e-2c6c6472140e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:47:35 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-114f84f9-b15c-4661-91c9-89ebf9c1e092 tempest-AttachVolumeNegativeTest-993089865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (718284fd-5716-4af9-8b10-199ec95a05dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:47:35 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-114f84f9-b15c-4661-91c9-89ebf9c1e092 tempest-AttachVolumeNegativeTest-993089865 None] Volume e6e37e7f-d3eb-4ac1-9175-3576ec837985: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6e37e7f-d3eb-4ac1-9175-3576ec837985', 'volume_size': 1}
Nov 06 11:47:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-114f84f9-b15c-4661-91c9-89ebf9c1e092 tempest-AttachVolumeNegativeTest-993089865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:47:35 devstack sudo[93961]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6bf90e9e-bf20-47fc-9748-24f0f53188e9 tempest-SnapshotsActionsTest-1390245303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3 1G" returned: 0 in 1.398s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6bf90e9e-bf20-47fc-9748-24f0f53188e9 tempest-SnapshotsActionsTest-1390245303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:35 devstack sudo[93972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3
Nov 06 11:47:35 devstack sudo[93972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:36 devstack sudo[93972]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6bf90e9e-bf20-47fc-9748-24f0f53188e9 tempest-SnapshotsActionsTest-1390245303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3" returned: 0 in 0.989s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:36 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-6bf90e9e-bf20-47fc-9748-24f0f53188e9 tempest-SnapshotsActionsTest-1390245303 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3 is being set with open permissions: ugo+rw
Nov 06 11:47:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6bf90e9e-bf20-47fc-9748-24f0f53188e9 tempest-SnapshotsActionsTest-1390245303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:36 devstack sudo[93980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3
Nov 06 11:47:36 devstack sudo[93980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:37 devstack sudo[93980]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6bf90e9e-bf20-47fc-9748-24f0f53188e9 tempest-SnapshotsActionsTest-1390245303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3" returned: 0 in 0.437s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6bf90e9e-bf20-47fc-9748-24f0f53188e9 tempest-SnapshotsActionsTest-1390245303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:37 devstack sudo[93983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.info
Nov 06 11:47:37 devstack sudo[93983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:37 devstack sudo[93983]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6bf90e9e-bf20-47fc-9748-24f0f53188e9 tempest-SnapshotsActionsTest-1390245303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.info" returned: 0 in 0.545s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:37 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-6bf90e9e-bf20-47fc-9748-24f0f53188e9 tempest-SnapshotsActionsTest-1390245303 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.info is being set with open permissions: ugo+rw
Nov 06 11:47:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6bf90e9e-bf20-47fc-9748-24f0f53188e9 tempest-SnapshotsActionsTest-1390245303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:37 devstack sudo[93986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.info
Nov 06 11:47:37 devstack sudo[93986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:38 devstack sudo[93986]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6bf90e9e-bf20-47fc-9748-24f0f53188e9 tempest-SnapshotsActionsTest-1390245303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.info" returned: 0 in 0.374s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6bf90e9e-bf20-47fc-9748-24f0f53188e9 tempest-SnapshotsActionsTest-1390245303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.909s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:47:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-114f84f9-b15c-4661-91c9-89ebf9c1e092 tempest-AttachVolumeNegativeTest-993089865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.953s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:47:38 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-114f84f9-b15c-4661-91c9-89ebf9c1e092 tempest-AttachVolumeNegativeTest-993089865 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:47:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1865359641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6e37e7f-d3eb-4ac1-9175-3576ec837985,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3e5280a8be5403bb6364cec1e71368b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:47:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:47:35Z,use_quota=True,user_id='aac0f37412684b0ebdf18894bf8f8dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:47:38 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-114f84f9-b15c-4661-91c9-89ebf9c1e092 tempest-AttachVolumeNegativeTest-993089865 None] Creating volume e6e37e7f-d3eb-4ac1-9175-3576ec837985 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:47:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-114f84f9-b15c-4661-91c9-89ebf9c1e092 tempest-AttachVolumeNegativeTest-993089865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:47:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-114f84f9-b15c-4661-91c9-89ebf9c1e092 tempest-AttachVolumeNegativeTest-993089865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:47:38 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-114f84f9-b15c-4661-91c9-89ebf9c1e092 tempest-AttachVolumeNegativeTest-993089865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:47:38 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-114f84f9-b15c-4661-91c9-89ebf9c1e092 tempest-AttachVolumeNegativeTest-993089865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:47:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-114f84f9-b15c-4661-91c9-89ebf9c1e092 tempest-AttachVolumeNegativeTest-993089865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:47:38 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-114f84f9-b15c-4661-91c9-89ebf9c1e092 tempest-AttachVolumeNegativeTest-993089865 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:47:38 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-114f84f9-b15c-4661-91c9-89ebf9c1e092 tempest-AttachVolumeNegativeTest-993089865 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:47:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-114f84f9-b15c-4661-91c9-89ebf9c1e092 tempest-AttachVolumeNegativeTest-993089865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e6e37e7f-d3eb-4ac1-9175-3576ec837985 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:38 devstack sudo[93989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e6e37e7f-d3eb-4ac1-9175-3576ec837985 1073741824
Nov 06 11:47:38 devstack sudo[93989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:38 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-6bf90e9e-bf20-47fc-9748-24f0f53188e9 tempest-SnapshotsActionsTest-1390245303 None] Create snapshot completed successfully
Nov 06 11:47:39 devstack sudo[93989]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-114f84f9-b15c-4661-91c9-89ebf9c1e092 tempest-AttachVolumeNegativeTest-993089865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e6e37e7f-d3eb-4ac1-9175-3576ec837985 1073741824" returned: 0 in 1.088s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-114f84f9-b15c-4661-91c9-89ebf9c1e092 tempest-AttachVolumeNegativeTest-993089865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e6e37e7f-d3eb-4ac1-9175-3576ec837985 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:39 devstack sudo[93998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e6e37e7f-d3eb-4ac1-9175-3576ec837985
Nov 06 11:47:39 devstack sudo[93998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:40 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-046a5e56-6869-471d-ab91-dba55307cbc5 tempest-VolumesActionsTest-1055323903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:47:40 devstack sudo[93998]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-046a5e56-6869-471d-ab91-dba55307cbc5 tempest-VolumesActionsTest-1055323903 None] Flow 'volume_create_manager' (bd20d5c9-efa6-49fd-8e77-7561d25c6875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:47:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-046a5e56-6869-471d-ab91-dba55307cbc5 tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60de189c-2af3-4358-ba1f-753e2120f6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:47:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-114f84f9-b15c-4661-91c9-89ebf9c1e092 tempest-AttachVolumeNegativeTest-993089865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e6e37e7f-d3eb-4ac1-9175-3576ec837985" returned: 0 in 0.883s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:40 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-114f84f9-b15c-4661-91c9-89ebf9c1e092 tempest-AttachVolumeNegativeTest-993089865 None] <== create_volume: return (2091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:47:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-114f84f9-b15c-4661-91c9-89ebf9c1e092 tempest-AttachVolumeNegativeTest-993089865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.096s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:47:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-046a5e56-6869-471d-ab91-dba55307cbc5 tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60de189c-2af3-4358-ba1f-753e2120f6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:47:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-801745128',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73b3c875-1e26-4686-9e97-9394d05c876f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e6f4e7600b74f8b9535d1386f3293dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:47:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:47:40Z,use_quota=True,user_id='ca8eaa9458014727befdf4ac0442c690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:47:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-046a5e56-6869-471d-ab91-dba55307cbc5 tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f63dab48-d939-46dc-a198-c0fd8c88dc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:47:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-046a5e56-6869-471d-ab91-dba55307cbc5 tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f63dab48-d939-46dc-a198-c0fd8c88dc4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:47:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-046a5e56-6869-471d-ab91-dba55307cbc5 tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e6baa3-5485-4ee0-a1cb-c9592b081e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:47:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-046a5e56-6869-471d-ab91-dba55307cbc5 tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e6baa3-5485-4ee0-a1cb-c9592b081e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73b3c875-1e26-4686-9e97-9394d05c876f', 'volume_name': 'volume-73b3c875-1e26-4686-9e97-9394d05c876f', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:47:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-046a5e56-6869-471d-ab91-dba55307cbc5 tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea7c8e9c-1943-4d7b-9ec2-d47c3a5d0e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:47:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-046a5e56-6869-471d-ab91-dba55307cbc5 tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea7c8e9c-1943-4d7b-9ec2-d47c3a5d0e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:47:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-046a5e56-6869-471d-ab91-dba55307cbc5 tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a74705cd-0b7b-4a02-a70a-44e9dd2377a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:47:40 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-046a5e56-6869-471d-ab91-dba55307cbc5 tempest-VolumesActionsTest-1055323903 None] Volume 73b3c875-1e26-4686-9e97-9394d05c876f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73b3c875-1e26-4686-9e97-9394d05c876f', 'volume_size': 1}
Nov 06 11:47:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-046a5e56-6869-471d-ab91-dba55307cbc5 tempest-VolumesActionsTest-1055323903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:47:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-046a5e56-6869-471d-ab91-dba55307cbc5 tempest-VolumesActionsTest-1055323903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:47:40 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-046a5e56-6869-471d-ab91-dba55307cbc5 tempest-VolumesActionsTest-1055323903 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:47:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-801745128',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73b3c875-1e26-4686-9e97-9394d05c876f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e6f4e7600b74f8b9535d1386f3293dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:47:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:47:40Z,use_quota=True,user_id='ca8eaa9458014727befdf4ac0442c690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:47:40 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-046a5e56-6869-471d-ab91-dba55307cbc5 tempest-VolumesActionsTest-1055323903 None] Creating volume 73b3c875-1e26-4686-9e97-9394d05c876f {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:47:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-046a5e56-6869-471d-ab91-dba55307cbc5 tempest-VolumesActionsTest-1055323903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:47:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-046a5e56-6869-471d-ab91-dba55307cbc5 tempest-VolumesActionsTest-1055323903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:47:40 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-046a5e56-6869-471d-ab91-dba55307cbc5 tempest-VolumesActionsTest-1055323903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:47:40 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-046a5e56-6869-471d-ab91-dba55307cbc5 tempest-VolumesActionsTest-1055323903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:47:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-046a5e56-6869-471d-ab91-dba55307cbc5 tempest-VolumesActionsTest-1055323903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:47:40 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-046a5e56-6869-471d-ab91-dba55307cbc5 tempest-VolumesActionsTest-1055323903 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:47:40 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-046a5e56-6869-471d-ab91-dba55307cbc5 tempest-VolumesActionsTest-1055323903 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:47:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-046a5e56-6869-471d-ab91-dba55307cbc5 tempest-VolumesActionsTest-1055323903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-73b3c875-1e26-4686-9e97-9394d05c876f 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-114f84f9-b15c-4661-91c9-89ebf9c1e092 tempest-AttachVolumeNegativeTest-993089865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (718284fd-5716-4af9-8b10-199ec95a05dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6e37e7f-d3eb-4ac1-9175-3576ec837985', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:47:40 devstack sudo[94001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-73b3c875-1e26-4686-9e97-9394d05c876f 1073741824
Nov 06 11:47:40 devstack sudo[94001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-114f84f9-b15c-4661-91c9-89ebf9c1e092 tempest-AttachVolumeNegativeTest-993089865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f403d39f-54b8-4b21-9207-1e84ca7f7f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:47:40 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-114f84f9-b15c-4661-91c9-89ebf9c1e092 tempest-AttachVolumeNegativeTest-993089865 None] Volume volume-e6e37e7f-d3eb-4ac1-9175-3576ec837985 (e6e37e7f-d3eb-4ac1-9175-3576ec837985): created successfully
Nov 06 11:47:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-114f84f9-b15c-4661-91c9-89ebf9c1e092 tempest-AttachVolumeNegativeTest-993089865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f403d39f-54b8-4b21-9207-1e84ca7f7f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:47:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-114f84f9-b15c-4661-91c9-89ebf9c1e092 tempest-AttachVolumeNegativeTest-993089865 None] Flow 'volume_create_manager' (355e5455-bc8b-4856-b5ff-8e6cec591af3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:47:40 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-114f84f9-b15c-4661-91c9-89ebf9c1e092 tempest-AttachVolumeNegativeTest-993089865 None] Created volume successfully.
Nov 06 11:47:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-913bc5fe-45ae-4415-840b-2bf701fdbcfa tempest-SnapshotsActionsTest-1390245303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:47:41 devstack sudo[94001]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-046a5e56-6869-471d-ab91-dba55307cbc5 tempest-VolumesActionsTest-1055323903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-73b3c875-1e26-4686-9e97-9394d05c876f 1073741824" returned: 0 in 1.057s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-046a5e56-6869-471d-ab91-dba55307cbc5 tempest-VolumesActionsTest-1055323903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-73b3c875-1e26-4686-9e97-9394d05c876f {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:41 devstack sudo[94013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-73b3c875-1e26-4686-9e97-9394d05c876f
Nov 06 11:47:41 devstack sudo[94013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:42 devstack sudo[94013]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-046a5e56-6869-471d-ab91-dba55307cbc5 tempest-VolumesActionsTest-1055323903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-73b3c875-1e26-4686-9e97-9394d05c876f" returned: 0 in 0.781s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:42 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-046a5e56-6869-471d-ab91-dba55307cbc5 tempest-VolumesActionsTest-1055323903 None] <== create_volume: return (1955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:47:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-046a5e56-6869-471d-ab91-dba55307cbc5 tempest-VolumesActionsTest-1055323903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.978s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:47:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-913bc5fe-45ae-4415-840b-2bf701fdbcfa tempest-SnapshotsActionsTest-1390245303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.614s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:47:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-046a5e56-6869-471d-ab91-dba55307cbc5 tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a74705cd-0b7b-4a02-a70a-44e9dd2377a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73b3c875-1e26-4686-9e97-9394d05c876f', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:47:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-046a5e56-6869-471d-ab91-dba55307cbc5 tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ee49e52-a2fb-4c79-8131-fc6166add465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:47:42 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-913bc5fe-45ae-4415-840b-2bf701fdbcfa tempest-SnapshotsActionsTest-1390245303 None] Creating offline snapshot 224b5c7e-6c0a-4e92-8af4-67b0ad8fdae8 of volume c5463bc8-5b06-4d57-a6e0-b87504e71d57 {{(pid=87165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 11:47:42 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75b1e56-b83c-4fe4-be36-64e6c6465e5a]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:47:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-913bc5fe-45ae-4415-840b-2bf701fdbcfa tempest-SnapshotsActionsTest-1390245303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:42 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-046a5e56-6869-471d-ab91-dba55307cbc5 tempest-VolumesActionsTest-1055323903 None] Volume volume-73b3c875-1e26-4686-9e97-9394d05c876f (73b3c875-1e26-4686-9e97-9394d05c876f): created successfully
Nov 06 11:47:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-046a5e56-6869-471d-ab91-dba55307cbc5 tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ee49e52-a2fb-4c79-8131-fc6166add465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:47:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-046a5e56-6869-471d-ab91-dba55307cbc5 tempest-VolumesActionsTest-1055323903 None] Flow 'volume_create_manager' (bd20d5c9-efa6-49fd-8e77-7561d25c6875) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:47:42 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-046a5e56-6869-471d-ab91-dba55307cbc5 tempest-VolumesActionsTest-1055323903 None] Created volume successfully.
Nov 06 11:47:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-91aa5e0b-d3c2-4e82-af9e-9ee89c580302 req-9b5616a3-4b61-4459-b896-48473f1f8a11 tempest-AttachVolumeNegativeTest-993089865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:47:42 devstack sudo[94026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3
Nov 06 11:47:42 devstack sudo[94026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:43 devstack sudo[94026]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-913bc5fe-45ae-4415-840b-2bf701fdbcfa tempest-SnapshotsActionsTest-1390245303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3" returned: 0 in 0.642s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:43 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-913bc5fe-45ae-4415-840b-2bf701fdbcfa tempest-SnapshotsActionsTest-1390245303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:47:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-913bc5fe-45ae-4415-840b-2bf701fdbcfa tempest-SnapshotsActionsTest-1390245303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.224b5c7e-6c0a-4e92-8af4-67b0ad8fdae8 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:43 devstack sudo[94032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.224b5c7e-6c0a-4e92-8af4-67b0ad8fdae8 1G
Nov 06 11:47:43 devstack sudo[94032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:43 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c0447b22-b7f4-4122-b578-c38040bb2003 tempest-VolumesActionsTest-1055323903 None] Acquiring lock "cinder-73b3c875-1e26-4686-9e97-9394d05c876f" by "attach_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:47:43 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c0447b22-b7f4-4122-b578-c38040bb2003 tempest-VolumesActionsTest-1055323903 None] Lock "cinder-73b3c875-1e26-4686-9e97-9394d05c876f" acquired by "attach_volume" :: waited 0.031s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:47:43 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-c0447b22-b7f4-4122-b578-c38040bb2003 tempest-VolumesActionsTest-1055323903 None] Attaching volume 73b3c875-1e26-4686-9e97-9394d05c876f to instance 721b019e-2576-4192-b888-14eaad52c5aa at mountpoint /dev/vdb on host None.
Nov 06 11:47:43 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-c0447b22-b7f4-4122-b578-c38040bb2003 tempest-VolumesActionsTest-1055323903 None] Attach volume completed successfully.
Nov 06 11:47:43 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c0447b22-b7f4-4122-b578-c38040bb2003 tempest-VolumesActionsTest-1055323903 None] Lock "cinder-73b3c875-1e26-4686-9e97-9394d05c876f" released by "attach_volume" :: held 0.219s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:47:43 devstack sudo[94032]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-913bc5fe-45ae-4415-840b-2bf701fdbcfa tempest-SnapshotsActionsTest-1390245303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.224b5c7e-6c0a-4e92-8af4-67b0ad8fdae8 1G" returned: 0 in 0.778s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-913bc5fe-45ae-4415-840b-2bf701fdbcfa tempest-SnapshotsActionsTest-1390245303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.224b5c7e-6c0a-4e92-8af4-67b0ad8fdae8 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:43 devstack sudo[94037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.224b5c7e-6c0a-4e92-8af4-67b0ad8fdae8
Nov 06 11:47:43 devstack sudo[94037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:44 devstack sudo[94037]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-913bc5fe-45ae-4415-840b-2bf701fdbcfa tempest-SnapshotsActionsTest-1390245303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.224b5c7e-6c0a-4e92-8af4-67b0ad8fdae8" returned: 0 in 0.715s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:44 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-913bc5fe-45ae-4415-840b-2bf701fdbcfa tempest-SnapshotsActionsTest-1390245303 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.224b5c7e-6c0a-4e92-8af4-67b0ad8fdae8 is being set with open permissions: ugo+rw
Nov 06 11:47:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-913bc5fe-45ae-4415-840b-2bf701fdbcfa tempest-SnapshotsActionsTest-1390245303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.224b5c7e-6c0a-4e92-8af4-67b0ad8fdae8 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:44 devstack sudo[94047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.224b5c7e-6c0a-4e92-8af4-67b0ad8fdae8
Nov 06 11:47:44 devstack sudo[94047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:45 devstack sudo[94047]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-913bc5fe-45ae-4415-840b-2bf701fdbcfa tempest-SnapshotsActionsTest-1390245303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.224b5c7e-6c0a-4e92-8af4-67b0ad8fdae8" returned: 0 in 0.547s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-913bc5fe-45ae-4415-840b-2bf701fdbcfa tempest-SnapshotsActionsTest-1390245303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.011s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:47:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-91aa5e0b-d3c2-4e82-af9e-9ee89c580302 req-9b5616a3-4b61-4459-b896-48473f1f8a11 tempest-AttachVolumeNegativeTest-993089865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.491s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:47:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-91aa5e0b-d3c2-4e82-af9e-9ee89c580302 req-9b5616a3-4b61-4459-b896-48473f1f8a11 tempest-AttachVolumeNegativeTest-993089865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.049s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:47:45 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-913bc5fe-45ae-4415-840b-2bf701fdbcfa tempest-SnapshotsActionsTest-1390245303 None] Create snapshot completed successfully
Nov 06 11:47:45 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-91aa5e0b-d3c2-4e82-af9e-9ee89c580302 req-9b5616a3-4b61-4459-b896-48473f1f8a11 tempest-AttachVolumeNegativeTest-993089865 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50', 'name': 'volume-e6e37e7f-d3eb-4ac1-9175-3576ec837985', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ad2bc739-908a-4b75-960b-3fc06d69532d', 'enforce_multipath': True} {{(pid=87165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 11:47:45 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-91aa5e0b-d3c2-4e82-af9e-9ee89c580302 req-9b5616a3-4b61-4459-b896-48473f1f8a11 tempest-AttachVolumeNegativeTest-993089865 None] attachment_update completed successfully.
Nov 06 11:47:45 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-1008db21-101c-488e-83d4-61003a3e8087 tempest-VolumesActionsTest-91619514 None] Terminate volume connection completed successfully.
Nov 06 11:47:45 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-1008db21-101c-488e-83d4-61003a3e8087 tempest-VolumesActionsTest-91619514 None] Acquiring lock "cinder-73b3c875-1e26-4686-9e97-9394d05c876f-detach_volume" by "detach_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:47:45 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-1008db21-101c-488e-83d4-61003a3e8087 tempest-VolumesActionsTest-91619514 None] Lock "cinder-73b3c875-1e26-4686-9e97-9394d05c876f-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:47:45 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-1008db21-101c-488e-83d4-61003a3e8087 tempest-VolumesActionsTest-91619514 None] Detaching volume 73b3c875-1e26-4686-9e97-9394d05c876f from instance 721b019e-2576-4192-b888-14eaad52c5aa.
Nov 06 11:47:46 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-1008db21-101c-488e-83d4-61003a3e8087 tempest-VolumesActionsTest-91619514 None] Detach volume completed successfully.
Nov 06 11:47:46 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-1008db21-101c-488e-83d4-61003a3e8087 tempest-VolumesActionsTest-91619514 None] Lock "cinder-73b3c875-1e26-4686-9e97-9394d05c876f-detach_volume" released by "detach_volume" :: held 0.171s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:47:46 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-bcde8b14-9e4e-4505-aca6-e391bca56d5f req-e514261d-af55-42bb-9c8b-52ed7067c5bf tempest-ServerActionsTestOtherA-2004102178 None] Terminate volume connection completed successfully.
Nov 06 11:47:46 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-bcde8b14-9e4e-4505-aca6-e391bca56d5f req-e514261d-af55-42bb-9c8b-52ed7067c5bf tempest-ServerActionsTestOtherA-2004102178 None] Deleting attachment 1aed1bc7-e50c-4d34-85dd-d4a2bd75fca9. {{(pid=87165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 11:47:46 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-8aa79aa5-e346-4a98-90e9-8037cc2cdc00 tempest-VolumesActionsTest-1055323903 None] Acquiring lock "cinder-73b3c875-1e26-4686-9e97-9394d05c876f-detach_volume" by "detach_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:47:46 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-8aa79aa5-e346-4a98-90e9-8037cc2cdc00 tempest-VolumesActionsTest-1055323903 None] Lock "cinder-73b3c875-1e26-4686-9e97-9394d05c876f-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:47:46 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-8aa79aa5-e346-4a98-90e9-8037cc2cdc00 tempest-VolumesActionsTest-1055323903 None] Volume detach called, but volume not attached.
Nov 06 11:47:46 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-8aa79aa5-e346-4a98-90e9-8037cc2cdc00 tempest-VolumesActionsTest-1055323903 None] Lock "cinder-73b3c875-1e26-4686-9e97-9394d05c876f-detach_volume" released by "detach_volume" :: held 0.019s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:47:46 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ad1bf410-1164-44de-b81f-e23337f7cbef tempest-SnapshotsActionsTest-2113967757 None] Acquiring lock "cinder-224b5c7e-6c0a-4e92-8af4-67b0ad8fdae8-delete_snapshot" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:47:46 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ad1bf410-1164-44de-b81f-e23337f7cbef tempest-SnapshotsActionsTest-2113967757 None] Lock "cinder-224b5c7e-6c0a-4e92-8af4-67b0ad8fdae8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:47:46 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ad1bf410-1164-44de-b81f-e23337f7cbef tempest-SnapshotsActionsTest-2113967757 None] Acquiring lock "cinder-quobyte-c5463bc8-5b06-4d57-a6e0-b87504e71d57" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:47:46 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ad1bf410-1164-44de-b81f-e23337f7cbef tempest-SnapshotsActionsTest-2113967757 None] Lock "cinder-quobyte-c5463bc8-5b06-4d57-a6e0-b87504e71d57" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:47:46 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ad1bf410-1164-44de-b81f-e23337f7cbef tempest-SnapshotsActionsTest-2113967757 None] Acquiring lock "cinder-quobyte-224b5c7e-6c0a-4e92-8af4-67b0ad8fdae8" by "_delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:47:46 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b563eb96-957d-4e40-9a24-9fa2f81e7fe4 tempest-VolumesActionsTest-1055323903 None] Acquiring lock "cinder-73b3c875-1e26-4686-9e97-9394d05c876f-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:47:46 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b563eb96-957d-4e40-9a24-9fa2f81e7fe4 tempest-VolumesActionsTest-1055323903 None] Lock "cinder-73b3c875-1e26-4686-9e97-9394d05c876f-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:47:46 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ad1bf410-1164-44de-b81f-e23337f7cbef tempest-SnapshotsActionsTest-2113967757 None] Lock "cinder-quobyte-224b5c7e-6c0a-4e92-8af4-67b0ad8fdae8" acquired by "_delete_snapshot" :: waited 0.076s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:47:46 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-ad1bf410-1164-44de-b81f-e23337f7cbef tempest-SnapshotsActionsTest-2113967757 None] Deleting offline snapshot 224b5c7e-6c0a-4e92-8af4-67b0ad8fdae8 of volume c5463bc8-5b06-4d57-a6e0-b87504e71d57 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 11:47:47 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-ad1bf410-1164-44de-b81f-e23337f7cbef tempest-SnapshotsActionsTest-2113967757 None] snapshot_file for this snap is: volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.224b5c7e-6c0a-4e92-8af4-67b0ad8fdae8 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 11:47:47 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce59bde-95e0-404e-ad93-e3f84064ea80]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:47:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ad1bf410-1164-44de-b81f-e23337f7cbef tempest-SnapshotsActionsTest-2113967757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.224b5c7e-6c0a-4e92-8af4-67b0ad8fdae8 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:47 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b563eb96-957d-4e40-9a24-9fa2f81e7fe4 tempest-VolumesActionsTest-1055323903 None] Acquiring lock "cinder-quobyte-73b3c875-1e26-4686-9e97-9394d05c876f" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:47:47 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b563eb96-957d-4e40-9a24-9fa2f81e7fe4 tempest-VolumesActionsTest-1055323903 None] Lock "cinder-quobyte-73b3c875-1e26-4686-9e97-9394d05c876f" acquired by "delete_volume" :: waited 0.042s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:47:47 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54aaae8-1b44-4545-a512-11fa50fefaa8]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:47:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b563eb96-957d-4e40-9a24-9fa2f81e7fe4 tempest-VolumesActionsTest-1055323903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-73b3c875-1e26-4686-9e97-9394d05c876f {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:47 devstack sudo[94512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.224b5c7e-6c0a-4e92-8af4-67b0ad8fdae8
Nov 06 11:47:47 devstack sudo[94513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-73b3c875-1e26-4686-9e97-9394d05c876f
Nov 06 11:47:47 devstack sudo[94513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:47 devstack sudo[94512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:47 devstack sudo[94513]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b563eb96-957d-4e40-9a24-9fa2f81e7fe4 tempest-VolumesActionsTest-1055323903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-73b3c875-1e26-4686-9e97-9394d05c876f" returned: 0 in 0.570s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b563eb96-957d-4e40-9a24-9fa2f81e7fe4 tempest-VolumesActionsTest-1055323903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-73b3c875-1e26-4686-9e97-9394d05c876f {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:47 devstack sudo[94521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-73b3c875-1e26-4686-9e97-9394d05c876f
Nov 06 11:47:47 devstack sudo[94521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:47 devstack sudo[94512]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ad1bf410-1164-44de-b81f-e23337f7cbef tempest-SnapshotsActionsTest-2113967757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.224b5c7e-6c0a-4e92-8af4-67b0ad8fdae8" returned: 0 in 0.928s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:47 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-ad1bf410-1164-44de-b81f-e23337f7cbef tempest-SnapshotsActionsTest-2113967757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:47:48 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4de885-618f-447f-bad4-4a84d1216fbe]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:47:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ad1bf410-1164-44de-b81f-e23337f7cbef tempest-SnapshotsActionsTest-2113967757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:48 devstack sudo[94529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3
Nov 06 11:47:48 devstack sudo[94529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:48 devstack sudo[94521]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b563eb96-957d-4e40-9a24-9fa2f81e7fe4 tempest-VolumesActionsTest-1055323903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-73b3c875-1e26-4686-9e97-9394d05c876f" returned: 0 in 0.631s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:48 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b563eb96-957d-4e40-9a24-9fa2f81e7fe4 tempest-VolumesActionsTest-1055323903 None] Lock "cinder-quobyte-73b3c875-1e26-4686-9e97-9394d05c876f" released by "delete_volume" :: held 1.310s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:47:48 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-b563eb96-957d-4e40-9a24-9fa2f81e7fe4 tempest-VolumesActionsTest-1055323903 None] Created reservations ['89529342-b54a-464f-855f-6dc9bed31440', 'f126bc64-f448-472e-bb77-7109cce3b7e1', 'fda50b83-d88b-4ab1-9f9a-c9749942c4d1', 'd9d6b3ab-e728-4752-ba37-79a35c22bed4'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:47:48 devstack sudo[94529]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ad1bf410-1164-44de-b81f-e23337f7cbef tempest-SnapshotsActionsTest-2113967757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3" returned: 0 in 0.680s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:48 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-ad1bf410-1164-44de-b81f-e23337f7cbef tempest-SnapshotsActionsTest-2113967757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:47:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ad1bf410-1164-44de-b81f-e23337f7cbef tempest-SnapshotsActionsTest-2113967757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.224b5c7e-6c0a-4e92-8af4-67b0ad8fdae8 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b563eb96-957d-4e40-9a24-9fa2f81e7fe4 tempest-VolumesActionsTest-1055323903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:47:48 devstack sudo[94549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.224b5c7e-6c0a-4e92-8af4-67b0ad8fdae8
Nov 06 11:47:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b563eb96-957d-4e40-9a24-9fa2f81e7fe4 tempest-VolumesActionsTest-1055323903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:47:48 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b563eb96-957d-4e40-9a24-9fa2f81e7fe4 tempest-VolumesActionsTest-1055323903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:47:48 devstack sudo[94549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:48 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b563eb96-957d-4e40-9a24-9fa2f81e7fe4 tempest-VolumesActionsTest-1055323903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:47:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b563eb96-957d-4e40-9a24-9fa2f81e7fe4 tempest-VolumesActionsTest-1055323903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:47:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b563eb96-957d-4e40-9a24-9fa2f81e7fe4 tempest-VolumesActionsTest-1055323903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:48 devstack sudo[94554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:47:48 devstack sudo[94554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:49 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-b7c62b4a-ffa1-46df-a935-ae42d942b516 req-8370e3aa-1191-4c7a-9498-0a29ca810847 tempest-AttachVolumeNegativeTest-993089865 None] Terminate volume connection completed successfully.
Nov 06 11:47:49 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-b7c62b4a-ffa1-46df-a935-ae42d942b516 req-8370e3aa-1191-4c7a-9498-0a29ca810847 tempest-AttachVolumeNegativeTest-993089865 None] Deleting attachment ad2bc739-908a-4b75-960b-3fc06d69532d. {{(pid=87165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 11:47:49 devstack sudo[94554]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b563eb96-957d-4e40-9a24-9fa2f81e7fe4 tempest-VolumesActionsTest-1055323903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.628s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:49 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-b563eb96-957d-4e40-9a24-9fa2f81e7fe4 tempest-VolumesActionsTest-1055323903 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:47:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-bcde8b14-9e4e-4505-aca6-e391bca56d5f req-77267fe7-9b34-4a48-9365-97f4ecc66cb5 tempest-ServerActionsTestOtherA-2004102178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:47:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-bcde8b14-9e4e-4505-aca6-e391bca56d5f req-77267fe7-9b34-4a48-9365-97f4ecc66cb5 tempest-ServerActionsTestOtherA-2004102178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:47:49 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-b563eb96-957d-4e40-9a24-9fa2f81e7fe4 tempest-VolumesActionsTest-1055323903 None] Deleted volume successfully.
Nov 06 11:47:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-bcde8b14-9e4e-4505-aca6-e391bca56d5f req-77267fe7-9b34-4a48-9365-97f4ecc66cb5 tempest-ServerActionsTestOtherA-2004102178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:47:49 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b563eb96-957d-4e40-9a24-9fa2f81e7fe4 tempest-VolumesActionsTest-1055323903 None] Lock "cinder-73b3c875-1e26-4686-9e97-9394d05c876f-delete_volume" released by "delete_volume" :: held 2.593s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:47:49 devstack sudo[94549]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ad1bf410-1164-44de-b81f-e23337f7cbef tempest-SnapshotsActionsTest-2113967757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.224b5c7e-6c0a-4e92-8af4-67b0ad8fdae8" returned: 0 in 0.815s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ad1bf410-1164-44de-b81f-e23337f7cbef tempest-SnapshotsActionsTest-2113967757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.224b5c7e-6c0a-4e92-8af4-67b0ad8fdae8 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:49 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-bcde8b14-9e4e-4505-aca6-e391bca56d5f req-77267fe7-9b34-4a48-9365-97f4ecc66cb5 tempest-ServerActionsTestOtherA-2004102178 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50', 'name': 'volume-a9513919-b7c8-4a94-a4c5-7077cd93ac75', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ddfbdec7-6290-416a-98eb-f5092ea791d8', 'enforce_multipath': True} {{(pid=87165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 11:47:49 devstack sudo[94602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.224b5c7e-6c0a-4e92-8af4-67b0ad8fdae8
Nov 06 11:47:49 devstack sudo[94602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:49 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-bcde8b14-9e4e-4505-aca6-e391bca56d5f req-77267fe7-9b34-4a48-9365-97f4ecc66cb5 tempest-ServerActionsTestOtherA-2004102178 None] attachment_update completed successfully.
Nov 06 11:47:50 devstack sudo[94602]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ad1bf410-1164-44de-b81f-e23337f7cbef tempest-SnapshotsActionsTest-2113967757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.224b5c7e-6c0a-4e92-8af4-67b0ad8fdae8" returned: 0 in 0.647s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:50 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ad1bf410-1164-44de-b81f-e23337f7cbef tempest-SnapshotsActionsTest-2113967757 None] Lock "cinder-quobyte-224b5c7e-6c0a-4e92-8af4-67b0ad8fdae8" released by "_delete_snapshot" :: held 3.307s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:47:50 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ad1bf410-1164-44de-b81f-e23337f7cbef tempest-SnapshotsActionsTest-2113967757 None] Lock "cinder-quobyte-c5463bc8-5b06-4d57-a6e0-b87504e71d57" released by "delete_snapshot" :: held 3.405s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:47:50 devstack cinder-volume[87165]: WARNING cinder.quota [None req-ad1bf410-1164-44de-b81f-e23337f7cbef tempest-SnapshotsActionsTest-2113967757 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 06 11:47:50 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-ad1bf410-1164-44de-b81f-e23337f7cbef tempest-SnapshotsActionsTest-2113967757 None] Created reservations ['ae562b92-2666-4b9c-b426-daf1966dd420', '4ca992f9-81f6-45eb-b5c4-252cb23a3d1e', '440d70c3-256d-494a-acc1-4e7ba2822fa6', '23428e09-f616-4a10-84e9-36186cebca68'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:47:50 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-ad1bf410-1164-44de-b81f-e23337f7cbef tempest-SnapshotsActionsTest-2113967757 None] Delete snapshot completed successfully.
Nov 06 11:47:50 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ad1bf410-1164-44de-b81f-e23337f7cbef tempest-SnapshotsActionsTest-2113967757 None] Lock "cinder-224b5c7e-6c0a-4e92-8af4-67b0ad8fdae8-delete_snapshot" released by "delete_snapshot" :: held 3.843s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:47:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d640a1b9-8873-497a-874c-a1af9a997220 tempest-SnapshotsActionsTest-1390245303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:47:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d640a1b9-8873-497a-874c-a1af9a997220 tempest-SnapshotsActionsTest-1390245303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:47:52 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-d640a1b9-8873-497a-874c-a1af9a997220 tempest-SnapshotsActionsTest-1390245303 None] Creating offline snapshot f4b30b75-81b3-431a-8367-98e34b1ba641 of volume c5463bc8-5b06-4d57-a6e0-b87504e71d57 {{(pid=87165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 11:47:52 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a2caa1-0104-4195-97fb-971bb9d3e830]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:47:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d640a1b9-8873-497a-874c-a1af9a997220 tempest-SnapshotsActionsTest-1390245303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:52 devstack sudo[95135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3
Nov 06 11:47:52 devstack sudo[95135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:52 devstack sudo[95135]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d640a1b9-8873-497a-874c-a1af9a997220 tempest-SnapshotsActionsTest-1390245303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3" returned: 0 in 0.678s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:52 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-d640a1b9-8873-497a-874c-a1af9a997220 tempest-SnapshotsActionsTest-1390245303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:47:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d640a1b9-8873-497a-874c-a1af9a997220 tempest-SnapshotsActionsTest-1390245303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.f4b30b75-81b3-431a-8367-98e34b1ba641 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:52 devstack sudo[95143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.f4b30b75-81b3-431a-8367-98e34b1ba641 1G
Nov 06 11:47:52 devstack sudo[95143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:53 devstack sudo[95143]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d640a1b9-8873-497a-874c-a1af9a997220 tempest-SnapshotsActionsTest-1390245303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.f4b30b75-81b3-431a-8367-98e34b1ba641 1G" returned: 0 in 0.763s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d640a1b9-8873-497a-874c-a1af9a997220 tempest-SnapshotsActionsTest-1390245303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.f4b30b75-81b3-431a-8367-98e34b1ba641 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:53 devstack sudo[95153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.f4b30b75-81b3-431a-8367-98e34b1ba641
Nov 06 11:47:53 devstack sudo[95153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:54 devstack sudo[95153]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d640a1b9-8873-497a-874c-a1af9a997220 tempest-SnapshotsActionsTest-1390245303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.f4b30b75-81b3-431a-8367-98e34b1ba641" returned: 0 in 0.776s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:54 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-d640a1b9-8873-497a-874c-a1af9a997220 tempest-SnapshotsActionsTest-1390245303 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.f4b30b75-81b3-431a-8367-98e34b1ba641 is being set with open permissions: ugo+rw
Nov 06 11:47:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d640a1b9-8873-497a-874c-a1af9a997220 tempest-SnapshotsActionsTest-1390245303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.f4b30b75-81b3-431a-8367-98e34b1ba641 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:54 devstack sudo[95165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.f4b30b75-81b3-431a-8367-98e34b1ba641
Nov 06 11:47:54 devstack sudo[95165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:54 devstack sudo[95165]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d640a1b9-8873-497a-874c-a1af9a997220 tempest-SnapshotsActionsTest-1390245303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.f4b30b75-81b3-431a-8367-98e34b1ba641" returned: 0 in 0.387s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d640a1b9-8873-497a-874c-a1af9a997220 tempest-SnapshotsActionsTest-1390245303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.742s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:47:54 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-d640a1b9-8873-497a-874c-a1af9a997220 tempest-SnapshotsActionsTest-1390245303 None] Create snapshot completed successfully
Nov 06 11:47:55 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5ff2bd9a-2ca5-40e4-9e91-993755180fc9 tempest-SnapshotsActionsTest-2113967757 None] Acquiring lock "cinder-f4b30b75-81b3-431a-8367-98e34b1ba641-delete_snapshot" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:47:55 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5ff2bd9a-2ca5-40e4-9e91-993755180fc9 tempest-SnapshotsActionsTest-2113967757 None] Lock "cinder-f4b30b75-81b3-431a-8367-98e34b1ba641-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:47:55 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5ff2bd9a-2ca5-40e4-9e91-993755180fc9 tempest-SnapshotsActionsTest-2113967757 None] Acquiring lock "cinder-quobyte-c5463bc8-5b06-4d57-a6e0-b87504e71d57" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:47:55 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5ff2bd9a-2ca5-40e4-9e91-993755180fc9 tempest-SnapshotsActionsTest-2113967757 None] Lock "cinder-quobyte-c5463bc8-5b06-4d57-a6e0-b87504e71d57" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:47:55 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5ff2bd9a-2ca5-40e4-9e91-993755180fc9 tempest-SnapshotsActionsTest-2113967757 None] Acquiring lock "cinder-quobyte-f4b30b75-81b3-431a-8367-98e34b1ba641" by "_delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:47:55 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5ff2bd9a-2ca5-40e4-9e91-993755180fc9 tempest-SnapshotsActionsTest-2113967757 None] Lock "cinder-quobyte-f4b30b75-81b3-431a-8367-98e34b1ba641" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:47:55 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-5ff2bd9a-2ca5-40e4-9e91-993755180fc9 tempest-SnapshotsActionsTest-2113967757 None] Deleting offline snapshot f4b30b75-81b3-431a-8367-98e34b1ba641 of volume c5463bc8-5b06-4d57-a6e0-b87504e71d57 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 11:47:55 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-5ff2bd9a-2ca5-40e4-9e91-993755180fc9 tempest-SnapshotsActionsTest-2113967757 None] snapshot_file for this snap is: volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.f4b30b75-81b3-431a-8367-98e34b1ba641 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 11:47:55 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62499f5-e898-4440-a95a-417fc90ff956]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:47:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5ff2bd9a-2ca5-40e4-9e91-993755180fc9 tempest-SnapshotsActionsTest-2113967757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.f4b30b75-81b3-431a-8367-98e34b1ba641 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:55 devstack sudo[95168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.f4b30b75-81b3-431a-8367-98e34b1ba641
Nov 06 11:47:55 devstack sudo[95168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:56 devstack sudo[95168]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5ff2bd9a-2ca5-40e4-9e91-993755180fc9 tempest-SnapshotsActionsTest-2113967757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.f4b30b75-81b3-431a-8367-98e34b1ba641" returned: 0 in 0.796s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:56 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-5ff2bd9a-2ca5-40e4-9e91-993755180fc9 tempest-SnapshotsActionsTest-2113967757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:47:56 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[91cc1e1c-6a4f-450b-90af-0537fe0b4517]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:47:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5ff2bd9a-2ca5-40e4-9e91-993755180fc9 tempest-SnapshotsActionsTest-2113967757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:56 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9b7839d-3e0d-409a-ae5f-2cb9fd049439 tempest-VolumesActionsTest-1055323903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:47:56 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a9b7839d-3e0d-409a-ae5f-2cb9fd049439 tempest-VolumesActionsTest-1055323903 None] Flow 'volume_create_manager' (3147a5bb-51d8-4248-9b0d-260c8c389640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:47:56 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a9b7839d-3e0d-409a-ae5f-2cb9fd049439 tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cad17388-1d29-4cfb-a3e4-0d20893afab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:47:56 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a9b7839d-3e0d-409a-ae5f-2cb9fd049439 tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cad17388-1d29-4cfb-a3e4-0d20893afab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:47:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1363565035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b17eb53-e399-40bb-9c68-471f79846681,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e6f4e7600b74f8b9535d1386f3293dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:47:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:47:56Z,use_quota=True,user_id='ca8eaa9458014727befdf4ac0442c690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:47:56 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a9b7839d-3e0d-409a-ae5f-2cb9fd049439 tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b866cdd-a35f-41df-9dfc-82f9a78118b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:47:56 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a9b7839d-3e0d-409a-ae5f-2cb9fd049439 tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b866cdd-a35f-41df-9dfc-82f9a78118b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:47:56 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a9b7839d-3e0d-409a-ae5f-2cb9fd049439 tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3495ccc0-6afd-46b6-9c2e-cdf4d2601a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:47:56 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a9b7839d-3e0d-409a-ae5f-2cb9fd049439 tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3495ccc0-6afd-46b6-9c2e-cdf4d2601a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b17eb53-e399-40bb-9c68-471f79846681', 'volume_name': 'volume-4b17eb53-e399-40bb-9c68-471f79846681', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:47:56 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a9b7839d-3e0d-409a-ae5f-2cb9fd049439 tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06fdafeb-30c5-4511-ba51-cf3314f9c454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:47:56 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a9b7839d-3e0d-409a-ae5f-2cb9fd049439 tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06fdafeb-30c5-4511-ba51-cf3314f9c454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:47:56 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a9b7839d-3e0d-409a-ae5f-2cb9fd049439 tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (855b881c-e7a0-4442-9254-36ef633fc439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:47:56 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-a9b7839d-3e0d-409a-ae5f-2cb9fd049439 tempest-VolumesActionsTest-1055323903 None] Volume 4b17eb53-e399-40bb-9c68-471f79846681: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b17eb53-e399-40bb-9c68-471f79846681', 'volume_size': 1}
Nov 06 11:47:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a9b7839d-3e0d-409a-ae5f-2cb9fd049439 tempest-VolumesActionsTest-1055323903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:47:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a9b7839d-3e0d-409a-ae5f-2cb9fd049439 tempest-VolumesActionsTest-1055323903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:47:56 devstack sudo[95174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3
Nov 06 11:47:56 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a9b7839d-3e0d-409a-ae5f-2cb9fd049439 tempest-VolumesActionsTest-1055323903 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:47:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1363565035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b17eb53-e399-40bb-9c68-471f79846681,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e6f4e7600b74f8b9535d1386f3293dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:47:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:47:56Z,use_quota=True,user_id='ca8eaa9458014727befdf4ac0442c690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:47:56 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-a9b7839d-3e0d-409a-ae5f-2cb9fd049439 tempest-VolumesActionsTest-1055323903 None] Creating volume 4b17eb53-e399-40bb-9c68-471f79846681 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:47:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a9b7839d-3e0d-409a-ae5f-2cb9fd049439 tempest-VolumesActionsTest-1055323903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:47:56 devstack sudo[95174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a9b7839d-3e0d-409a-ae5f-2cb9fd049439 tempest-VolumesActionsTest-1055323903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:47:56 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a9b7839d-3e0d-409a-ae5f-2cb9fd049439 tempest-VolumesActionsTest-1055323903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:47:56 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a9b7839d-3e0d-409a-ae5f-2cb9fd049439 tempest-VolumesActionsTest-1055323903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:47:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a9b7839d-3e0d-409a-ae5f-2cb9fd049439 tempest-VolumesActionsTest-1055323903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:47:56 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a9b7839d-3e0d-409a-ae5f-2cb9fd049439 tempest-VolumesActionsTest-1055323903 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:47:56 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-a9b7839d-3e0d-409a-ae5f-2cb9fd049439 tempest-VolumesActionsTest-1055323903 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:47:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a9b7839d-3e0d-409a-ae5f-2cb9fd049439 tempest-VolumesActionsTest-1055323903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4b17eb53-e399-40bb-9c68-471f79846681 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:56 devstack sudo[95176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4b17eb53-e399-40bb-9c68-471f79846681 1073741824
Nov 06 11:47:56 devstack sudo[95176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:57 devstack sudo[95174]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5ff2bd9a-2ca5-40e4-9e91-993755180fc9 tempest-SnapshotsActionsTest-2113967757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3" returned: 0 in 0.626s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:57 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-5ff2bd9a-2ca5-40e4-9e91-993755180fc9 tempest-SnapshotsActionsTest-2113967757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:47:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5ff2bd9a-2ca5-40e4-9e91-993755180fc9 tempest-SnapshotsActionsTest-2113967757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.f4b30b75-81b3-431a-8367-98e34b1ba641 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:57 devstack sudo[95181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.f4b30b75-81b3-431a-8367-98e34b1ba641
Nov 06 11:47:57 devstack sudo[95181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:57 devstack sudo[95176]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a9b7839d-3e0d-409a-ae5f-2cb9fd049439 tempest-VolumesActionsTest-1055323903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4b17eb53-e399-40bb-9c68-471f79846681 1073741824" returned: 0 in 0.728s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a9b7839d-3e0d-409a-ae5f-2cb9fd049439 tempest-VolumesActionsTest-1055323903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4b17eb53-e399-40bb-9c68-471f79846681 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:57 devstack sudo[95191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4b17eb53-e399-40bb-9c68-471f79846681
Nov 06 11:47:57 devstack sudo[95191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:57 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-656a1794-8169-4612-9296-49fc0042c60a tempest-AttachVolumeNegativeTest-993089865 None] Acquiring lock "cinder-e6e37e7f-d3eb-4ac1-9175-3576ec837985-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:47:57 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-656a1794-8169-4612-9296-49fc0042c60a tempest-AttachVolumeNegativeTest-993089865 None] Lock "cinder-e6e37e7f-d3eb-4ac1-9175-3576ec837985-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:47:57 devstack sudo[95181]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5ff2bd9a-2ca5-40e4-9e91-993755180fc9 tempest-SnapshotsActionsTest-2113967757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.f4b30b75-81b3-431a-8367-98e34b1ba641" returned: 0 in 0.836s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5ff2bd9a-2ca5-40e4-9e91-993755180fc9 tempest-SnapshotsActionsTest-2113967757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.f4b30b75-81b3-431a-8367-98e34b1ba641 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:57 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-656a1794-8169-4612-9296-49fc0042c60a tempest-AttachVolumeNegativeTest-993089865 None] Acquiring lock "cinder-quobyte-e6e37e7f-d3eb-4ac1-9175-3576ec837985" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:47:57 devstack sudo[95208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.f4b30b75-81b3-431a-8367-98e34b1ba641
Nov 06 11:47:57 devstack sudo[95208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:57 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-656a1794-8169-4612-9296-49fc0042c60a tempest-AttachVolumeNegativeTest-993089865 None] Lock "cinder-quobyte-e6e37e7f-d3eb-4ac1-9175-3576ec837985" acquired by "delete_volume" :: waited 0.051s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:47:57 devstack sudo[95191]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a9b7839d-3e0d-409a-ae5f-2cb9fd049439 tempest-VolumesActionsTest-1055323903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4b17eb53-e399-40bb-9c68-471f79846681" returned: 0 in 0.486s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:58 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a9b7839d-3e0d-409a-ae5f-2cb9fd049439 tempest-VolumesActionsTest-1055323903 None] <== create_volume: return (1294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:47:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a9b7839d-3e0d-409a-ae5f-2cb9fd049439 tempest-VolumesActionsTest-1055323903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.302s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:47:58 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a9b7839d-3e0d-409a-ae5f-2cb9fd049439 tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (855b881c-e7a0-4442-9254-36ef633fc439) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b17eb53-e399-40bb-9c68-471f79846681', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:47:58 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a9b7839d-3e0d-409a-ae5f-2cb9fd049439 tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63263a04-afe4-4782-b2f0-b8bab12047f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:47:58 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f031130-32a3-4616-a8fa-42b3a3b3914e]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:47:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-656a1794-8169-4612-9296-49fc0042c60a tempest-AttachVolumeNegativeTest-993089865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e6e37e7f-d3eb-4ac1-9175-3576ec837985 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:58 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-a9b7839d-3e0d-409a-ae5f-2cb9fd049439 tempest-VolumesActionsTest-1055323903 None] Volume volume-4b17eb53-e399-40bb-9c68-471f79846681 (4b17eb53-e399-40bb-9c68-471f79846681): created successfully
Nov 06 11:47:58 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a9b7839d-3e0d-409a-ae5f-2cb9fd049439 tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63263a04-afe4-4782-b2f0-b8bab12047f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:47:58 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a9b7839d-3e0d-409a-ae5f-2cb9fd049439 tempest-VolumesActionsTest-1055323903 None] Flow 'volume_create_manager' (3147a5bb-51d8-4248-9b0d-260c8c389640) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:47:58 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-a9b7839d-3e0d-409a-ae5f-2cb9fd049439 tempest-VolumesActionsTest-1055323903 None] Created volume successfully.
Nov 06 11:47:58 devstack sudo[95230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e6e37e7f-d3eb-4ac1-9175-3576ec837985
Nov 06 11:47:58 devstack sudo[95230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:58 devstack sudo[95208]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5ff2bd9a-2ca5-40e4-9e91-993755180fc9 tempest-SnapshotsActionsTest-2113967757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.f4b30b75-81b3-431a-8367-98e34b1ba641" returned: 0 in 0.765s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:58 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5ff2bd9a-2ca5-40e4-9e91-993755180fc9 tempest-SnapshotsActionsTest-2113967757 None] Lock "cinder-quobyte-f4b30b75-81b3-431a-8367-98e34b1ba641" released by "_delete_snapshot" :: held 3.224s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:47:58 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5ff2bd9a-2ca5-40e4-9e91-993755180fc9 tempest-SnapshotsActionsTest-2113967757 None] Lock "cinder-quobyte-c5463bc8-5b06-4d57-a6e0-b87504e71d57" released by "delete_snapshot" :: held 3.258s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:47:58 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-5ff2bd9a-2ca5-40e4-9e91-993755180fc9 tempest-SnapshotsActionsTest-2113967757 None] Created reservations ['7c7f9faf-5c16-4cf5-b912-04072570a54d', '47496e02-7a7d-4f46-b487-1aabb14cab71', '1ea903cc-57d9-42b0-81c0-12d7c38a953d', '25ca68d5-b1e1-44c2-acfc-b37120be730c'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:47:58 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-5ff2bd9a-2ca5-40e4-9e91-993755180fc9 tempest-SnapshotsActionsTest-2113967757 None] Delete snapshot completed successfully.
Nov 06 11:47:59 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5ff2bd9a-2ca5-40e4-9e91-993755180fc9 tempest-SnapshotsActionsTest-2113967757 None] Lock "cinder-f4b30b75-81b3-431a-8367-98e34b1ba641-delete_snapshot" released by "delete_snapshot" :: held 3.549s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:47:59 devstack sudo[95230]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-656a1794-8169-4612-9296-49fc0042c60a tempest-AttachVolumeNegativeTest-993089865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e6e37e7f-d3eb-4ac1-9175-3576ec837985" returned: 0 in 0.934s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-656a1794-8169-4612-9296-49fc0042c60a tempest-AttachVolumeNegativeTest-993089865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e6e37e7f-d3eb-4ac1-9175-3576ec837985 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:59 devstack sudo[95238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e6e37e7f-d3eb-4ac1-9175-3576ec837985
Nov 06 11:47:59 devstack sudo[95238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:59 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b2e70e25-c695-42c8-9f6f-600507c5f402 tempest-VolumesActionsTest-91619514 None] Acquiring lock "cinder-4b17eb53-e399-40bb-9c68-471f79846681-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:47:59 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b2e70e25-c695-42c8-9f6f-600507c5f402 tempest-VolumesActionsTest-91619514 None] Lock "cinder-4b17eb53-e399-40bb-9c68-471f79846681-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:47:59 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b2e70e25-c695-42c8-9f6f-600507c5f402 tempest-VolumesActionsTest-91619514 None] Acquiring lock "cinder-quobyte-4b17eb53-e399-40bb-9c68-471f79846681" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:47:59 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b2e70e25-c695-42c8-9f6f-600507c5f402 tempest-VolumesActionsTest-91619514 None] Lock "cinder-quobyte-4b17eb53-e399-40bb-9c68-471f79846681" acquired by "delete_volume" :: waited 0.036s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:47:59 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[16955162-0048-48f3-9c78-fdb5537a643c]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:47:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b2e70e25-c695-42c8-9f6f-600507c5f402 tempest-VolumesActionsTest-91619514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4b17eb53-e399-40bb-9c68-471f79846681 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:59 devstack sudo[95238]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-656a1794-8169-4612-9296-49fc0042c60a tempest-AttachVolumeNegativeTest-993089865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e6e37e7f-d3eb-4ac1-9175-3576ec837985" returned: 0 in 0.416s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:59 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-656a1794-8169-4612-9296-49fc0042c60a tempest-AttachVolumeNegativeTest-993089865 None] Lock "cinder-quobyte-e6e37e7f-d3eb-4ac1-9175-3576ec837985" released by "delete_volume" :: held 1.487s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:47:59 devstack sudo[95240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4b17eb53-e399-40bb-9c68-471f79846681
Nov 06 11:47:59 devstack sudo[95240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:59 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-656a1794-8169-4612-9296-49fc0042c60a tempest-AttachVolumeNegativeTest-993089865 None] Created reservations ['a1fa0712-f8e1-46fc-8b0a-bec4b582d67e', '31cd20cc-15fc-493c-aabb-42f508822099', '2b77d767-a1a9-409a-b510-74af1419395b', 'c6e63be3-7554-4f94-a5d2-422e4eeb1e15'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:47:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-656a1794-8169-4612-9296-49fc0042c60a tempest-AttachVolumeNegativeTest-993089865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:47:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-656a1794-8169-4612-9296-49fc0042c60a tempest-AttachVolumeNegativeTest-993089865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:47:59 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-656a1794-8169-4612-9296-49fc0042c60a tempest-AttachVolumeNegativeTest-993089865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:47:59 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-656a1794-8169-4612-9296-49fc0042c60a tempest-AttachVolumeNegativeTest-993089865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:47:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-656a1794-8169-4612-9296-49fc0042c60a tempest-AttachVolumeNegativeTest-993089865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:47:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-656a1794-8169-4612-9296-49fc0042c60a tempest-AttachVolumeNegativeTest-993089865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:59 devstack sudo[95243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:47:59 devstack sudo[95243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:47:59 devstack sudo[95240]: pam_unix(sudo:session): session closed for user root
Nov 06 11:47:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b2e70e25-c695-42c8-9f6f-600507c5f402 tempest-VolumesActionsTest-91619514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4b17eb53-e399-40bb-9c68-471f79846681" returned: 0 in 0.605s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:47:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b2e70e25-c695-42c8-9f6f-600507c5f402 tempest-VolumesActionsTest-91619514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4b17eb53-e399-40bb-9c68-471f79846681 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:47:59 devstack sudo[95248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4b17eb53-e399-40bb-9c68-471f79846681
Nov 06 11:47:59 devstack sudo[95248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:00 devstack sudo[95243]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-656a1794-8169-4612-9296-49fc0042c60a tempest-AttachVolumeNegativeTest-993089865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.510s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:00 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-656a1794-8169-4612-9296-49fc0042c60a tempest-AttachVolumeNegativeTest-993089865 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:48:00 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-656a1794-8169-4612-9296-49fc0042c60a tempest-AttachVolumeNegativeTest-993089865 None] Deleted volume successfully.
Nov 06 11:48:00 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-656a1794-8169-4612-9296-49fc0042c60a tempest-AttachVolumeNegativeTest-993089865 None] Lock "cinder-e6e37e7f-d3eb-4ac1-9175-3576ec837985-delete_volume" released by "delete_volume" :: held 2.494s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:48:00 devstack sudo[95248]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b2e70e25-c695-42c8-9f6f-600507c5f402 tempest-VolumesActionsTest-91619514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4b17eb53-e399-40bb-9c68-471f79846681" returned: 0 in 0.499s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:00 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b2e70e25-c695-42c8-9f6f-600507c5f402 tempest-VolumesActionsTest-91619514 None] Lock "cinder-quobyte-4b17eb53-e399-40bb-9c68-471f79846681" released by "delete_volume" :: held 1.189s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:48:00 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5e75396b-bd0f-453a-a364-85470ce369a2 tempest-AttachVolumeNegativeTest-993089865 None] Acquiring lock "cinder-d4ab6ad3-c16f-4e6f-b019-8379970e5dae-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:48:00 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5e75396b-bd0f-453a-a364-85470ce369a2 tempest-AttachVolumeNegativeTest-993089865 None] Lock "cinder-d4ab6ad3-c16f-4e6f-b019-8379970e5dae-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:48:00 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5e75396b-bd0f-453a-a364-85470ce369a2 tempest-AttachVolumeNegativeTest-993089865 None] Acquiring lock "cinder-quobyte-d4ab6ad3-c16f-4e6f-b019-8379970e5dae" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:48:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-7522f74c-d83f-4387-bd4f-25a698269a60 tempest-SnapshotsActionsTest-1390245303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:48:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-7522f74c-d83f-4387-bd4f-25a698269a60 tempest-SnapshotsActionsTest-1390245303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:48:00 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5e75396b-bd0f-453a-a364-85470ce369a2 tempest-AttachVolumeNegativeTest-993089865 None] Lock "cinder-quobyte-d4ab6ad3-c16f-4e6f-b019-8379970e5dae" acquired by "delete_volume" :: waited 0.035s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:48:00 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-b2e70e25-c695-42c8-9f6f-600507c5f402 tempest-VolumesActionsTest-91619514 None] Created reservations ['eb68ab66-8744-4e0a-aa3c-0466856b865e', '4828b09c-410b-43c2-a92f-49b7155061c4', 'c921b827-4a5b-428f-8cef-bc68bd4fbf8b', 'af5f08e9-127a-4c86-9bf1-6fe0210f1bb2'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:48:00 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-7522f74c-d83f-4387-bd4f-25a698269a60 tempest-SnapshotsActionsTest-1390245303 None] Creating offline snapshot 33750d8a-ec84-44ae-94fc-675fdf500607 of volume c5463bc8-5b06-4d57-a6e0-b87504e71d57 {{(pid=87165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 11:48:00 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9fe5c67-157c-4b46-adbc-93448336e9dd]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:48:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5e75396b-bd0f-453a-a364-85470ce369a2 tempest-AttachVolumeNegativeTest-993089865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d4ab6ad3-c16f-4e6f-b019-8379970e5dae {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:00 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ccd071e-9e40-477b-9fdd-c8408c83abb9]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:48:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7522f74c-d83f-4387-bd4f-25a698269a60 tempest-SnapshotsActionsTest-1390245303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:00 devstack sudo[95253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d4ab6ad3-c16f-4e6f-b019-8379970e5dae
Nov 06 11:48:00 devstack sudo[95253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b2e70e25-c695-42c8-9f6f-600507c5f402 tempest-VolumesActionsTest-91619514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:48:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b2e70e25-c695-42c8-9f6f-600507c5f402 tempest-VolumesActionsTest-91619514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:48:00 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b2e70e25-c695-42c8-9f6f-600507c5f402 tempest-VolumesActionsTest-91619514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:48:00 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b2e70e25-c695-42c8-9f6f-600507c5f402 tempest-VolumesActionsTest-91619514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:48:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b2e70e25-c695-42c8-9f6f-600507c5f402 tempest-VolumesActionsTest-91619514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:48:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b2e70e25-c695-42c8-9f6f-600507c5f402 tempest-VolumesActionsTest-91619514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:01 devstack sudo[95256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:48:01 devstack sudo[95256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:01 devstack sudo[95254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3
Nov 06 11:48:01 devstack sudo[95254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:01 devstack sudo[95256]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b2e70e25-c695-42c8-9f6f-600507c5f402 tempest-VolumesActionsTest-91619514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.335s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:01 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-b2e70e25-c695-42c8-9f6f-600507c5f402 tempest-VolumesActionsTest-91619514 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:48:01 devstack sudo[95253]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5e75396b-bd0f-453a-a364-85470ce369a2 tempest-AttachVolumeNegativeTest-993089865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d4ab6ad3-c16f-4e6f-b019-8379970e5dae" returned: 0 in 0.513s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5e75396b-bd0f-453a-a364-85470ce369a2 tempest-AttachVolumeNegativeTest-993089865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d4ab6ad3-c16f-4e6f-b019-8379970e5dae {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:01 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-b2e70e25-c695-42c8-9f6f-600507c5f402 tempest-VolumesActionsTest-91619514 None] Deleted volume successfully.
Nov 06 11:48:01 devstack sudo[95266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d4ab6ad3-c16f-4e6f-b019-8379970e5dae
Nov 06 11:48:01 devstack sudo[95266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:01 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b2e70e25-c695-42c8-9f6f-600507c5f402 tempest-VolumesActionsTest-91619514 None] Lock "cinder-4b17eb53-e399-40bb-9c68-471f79846681-delete_volume" released by "delete_volume" :: held 2.249s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:48:01 devstack sudo[95254]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7522f74c-d83f-4387-bd4f-25a698269a60 tempest-SnapshotsActionsTest-1390245303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3" returned: 0 in 0.607s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:01 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-7522f74c-d83f-4387-bd4f-25a698269a60 tempest-SnapshotsActionsTest-1390245303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:48:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7522f74c-d83f-4387-bd4f-25a698269a60 tempest-SnapshotsActionsTest-1390245303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.33750d8a-ec84-44ae-94fc-675fdf500607 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:01 devstack sudo[95268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.33750d8a-ec84-44ae-94fc-675fdf500607 1G
Nov 06 11:48:01 devstack sudo[95268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:01 devstack sudo[95266]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5e75396b-bd0f-453a-a364-85470ce369a2 tempest-AttachVolumeNegativeTest-993089865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d4ab6ad3-c16f-4e6f-b019-8379970e5dae" returned: 0 in 0.400s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:01 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5e75396b-bd0f-453a-a364-85470ce369a2 tempest-AttachVolumeNegativeTest-993089865 None] Lock "cinder-quobyte-d4ab6ad3-c16f-4e6f-b019-8379970e5dae" released by "delete_volume" :: held 1.045s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:48:01 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-5e75396b-bd0f-453a-a364-85470ce369a2 tempest-AttachVolumeNegativeTest-993089865 None] Created reservations ['1413e7af-6bec-4b86-98d7-9800ad50c574', 'b821a694-30d3-4aa8-82c5-8943e41b93e4', 'd9ded8dc-9153-46fe-bf12-d2f4cca306c8', '6e31b21a-7d25-4e76-9502-f7035c85b738'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:48:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5e75396b-bd0f-453a-a364-85470ce369a2 tempest-AttachVolumeNegativeTest-993089865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:48:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5e75396b-bd0f-453a-a364-85470ce369a2 tempest-AttachVolumeNegativeTest-993089865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:48:01 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5e75396b-bd0f-453a-a364-85470ce369a2 tempest-AttachVolumeNegativeTest-993089865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:48:01 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5e75396b-bd0f-453a-a364-85470ce369a2 tempest-AttachVolumeNegativeTest-993089865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:48:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5e75396b-bd0f-453a-a364-85470ce369a2 tempest-AttachVolumeNegativeTest-993089865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:48:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5e75396b-bd0f-453a-a364-85470ce369a2 tempest-AttachVolumeNegativeTest-993089865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:01 devstack sudo[95276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:48:01 devstack sudo[95276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:02 devstack sudo[95268]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7522f74c-d83f-4387-bd4f-25a698269a60 tempest-SnapshotsActionsTest-1390245303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.33750d8a-ec84-44ae-94fc-675fdf500607 1G" returned: 0 in 0.685s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7522f74c-d83f-4387-bd4f-25a698269a60 tempest-SnapshotsActionsTest-1390245303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.33750d8a-ec84-44ae-94fc-675fdf500607 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:02 devstack sudo[95278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.33750d8a-ec84-44ae-94fc-675fdf500607
Nov 06 11:48:02 devstack sudo[95278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:02 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e5a64ad-b3f8-4487-b440-1a322a905685 tempest-VolumesActionsTest-1055323903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:48:02 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5e5a64ad-b3f8-4487-b440-1a322a905685 tempest-VolumesActionsTest-1055323903 None] Flow 'volume_create_manager' (5ae459cf-eded-448b-b2a6-6097515799c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:48:02 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5e5a64ad-b3f8-4487-b440-1a322a905685 tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7b6085c-0b49-4a75-aef4-4033a15638bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:48:02 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5e5a64ad-b3f8-4487-b440-1a322a905685 tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7b6085c-0b49-4a75-aef4-4033a15638bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:48:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1401170727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e3e725f-5676-44d7-8d28-9104f224eb55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e6f4e7600b74f8b9535d1386f3293dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:48:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:48:02Z,use_quota=True,user_id='ca8eaa9458014727befdf4ac0442c690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:48:02 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5e5a64ad-b3f8-4487-b440-1a322a905685 tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dab17558-0c3c-49ee-8efd-dfb093fe193b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:48:02 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5e5a64ad-b3f8-4487-b440-1a322a905685 tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dab17558-0c3c-49ee-8efd-dfb093fe193b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:48:02 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5e5a64ad-b3f8-4487-b440-1a322a905685 tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6550fd7f-cd1d-4756-b8cd-1cb1d6a3ce98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:48:02 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5e5a64ad-b3f8-4487-b440-1a322a905685 tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6550fd7f-cd1d-4756-b8cd-1cb1d6a3ce98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e3e725f-5676-44d7-8d28-9104f224eb55', 'volume_name': 'volume-4e3e725f-5676-44d7-8d28-9104f224eb55', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:48:02 devstack sudo[95276]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:02 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5e5a64ad-b3f8-4487-b440-1a322a905685 tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (726c59e7-8f01-4446-8dd5-6c3a5aed0229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:48:02 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5e5a64ad-b3f8-4487-b440-1a322a905685 tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (726c59e7-8f01-4446-8dd5-6c3a5aed0229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:48:02 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5e5a64ad-b3f8-4487-b440-1a322a905685 tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed9a9e31-04a2-4552-b221-8834c8bdb098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:48:02 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-5e5a64ad-b3f8-4487-b440-1a322a905685 tempest-VolumesActionsTest-1055323903 None] Volume 4e3e725f-5676-44d7-8d28-9104f224eb55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e3e725f-5676-44d7-8d28-9104f224eb55', 'volume_size': 1}
Nov 06 11:48:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5e5a64ad-b3f8-4487-b440-1a322a905685 tempest-VolumesActionsTest-1055323903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:48:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5e75396b-bd0f-453a-a364-85470ce369a2 tempest-AttachVolumeNegativeTest-993089865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.417s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:02 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-5e75396b-bd0f-453a-a364-85470ce369a2 tempest-AttachVolumeNegativeTest-993089865 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:48:02 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-5e75396b-bd0f-453a-a364-85470ce369a2 tempest-AttachVolumeNegativeTest-993089865 None] Deleted volume successfully.
Nov 06 11:48:02 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5e75396b-bd0f-453a-a364-85470ce369a2 tempest-AttachVolumeNegativeTest-993089865 None] Lock "cinder-d4ab6ad3-c16f-4e6f-b019-8379970e5dae-delete_volume" released by "delete_volume" :: held 1.827s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:48:02 devstack sudo[95278]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7522f74c-d83f-4387-bd4f-25a698269a60 tempest-SnapshotsActionsTest-1390245303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.33750d8a-ec84-44ae-94fc-675fdf500607" returned: 0 in 0.334s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:02 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-7522f74c-d83f-4387-bd4f-25a698269a60 tempest-SnapshotsActionsTest-1390245303 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.33750d8a-ec84-44ae-94fc-675fdf500607 is being set with open permissions: ugo+rw
Nov 06 11:48:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7522f74c-d83f-4387-bd4f-25a698269a60 tempest-SnapshotsActionsTest-1390245303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.33750d8a-ec84-44ae-94fc-675fdf500607 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:02 devstack sudo[95284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.33750d8a-ec84-44ae-94fc-675fdf500607
Nov 06 11:48:02 devstack sudo[95284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:02 devstack sudo[95284]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7522f74c-d83f-4387-bd4f-25a698269a60 tempest-SnapshotsActionsTest-1390245303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.33750d8a-ec84-44ae-94fc-675fdf500607" returned: 0 in 0.261s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-7522f74c-d83f-4387-bd4f-25a698269a60 tempest-SnapshotsActionsTest-1390245303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.072s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:48:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5e5a64ad-b3f8-4487-b440-1a322a905685 tempest-VolumesActionsTest-1055323903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.430s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:48:02 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5e5a64ad-b3f8-4487-b440-1a322a905685 tempest-VolumesActionsTest-1055323903 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:48:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1401170727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e3e725f-5676-44d7-8d28-9104f224eb55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e6f4e7600b74f8b9535d1386f3293dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:48:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:48:02Z,use_quota=True,user_id='ca8eaa9458014727befdf4ac0442c690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:48:02 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-5e5a64ad-b3f8-4487-b440-1a322a905685 tempest-VolumesActionsTest-1055323903 None] Creating volume 4e3e725f-5676-44d7-8d28-9104f224eb55 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:48:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5e5a64ad-b3f8-4487-b440-1a322a905685 tempest-VolumesActionsTest-1055323903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:48:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5e5a64ad-b3f8-4487-b440-1a322a905685 tempest-VolumesActionsTest-1055323903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:48:02 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5e5a64ad-b3f8-4487-b440-1a322a905685 tempest-VolumesActionsTest-1055323903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:48:02 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5e5a64ad-b3f8-4487-b440-1a322a905685 tempest-VolumesActionsTest-1055323903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:48:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5e5a64ad-b3f8-4487-b440-1a322a905685 tempest-VolumesActionsTest-1055323903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:48:02 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5e5a64ad-b3f8-4487-b440-1a322a905685 tempest-VolumesActionsTest-1055323903 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:48:02 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-5e5a64ad-b3f8-4487-b440-1a322a905685 tempest-VolumesActionsTest-1055323903 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:48:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5e5a64ad-b3f8-4487-b440-1a322a905685 tempest-VolumesActionsTest-1055323903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4e3e725f-5676-44d7-8d28-9104f224eb55 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:02 devstack sudo[95287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4e3e725f-5676-44d7-8d28-9104f224eb55 1073741824
Nov 06 11:48:02 devstack sudo[95287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:02 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-7522f74c-d83f-4387-bd4f-25a698269a60 tempest-SnapshotsActionsTest-1390245303 None] Create snapshot completed successfully
Nov 06 11:48:02 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5b1245d3-9fab-4a4c-9743-b365b1d9595b tempest-AttachVolumeNegativeTest-993089865 None] Acquiring lock "cinder-9d1908df-d8e0-4ece-9338-8d7f6a4cfea4-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:48:03 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5b1245d3-9fab-4a4c-9743-b365b1d9595b tempest-AttachVolumeNegativeTest-993089865 None] Lock "cinder-9d1908df-d8e0-4ece-9338-8d7f6a4cfea4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:48:03 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5b1245d3-9fab-4a4c-9743-b365b1d9595b tempest-AttachVolumeNegativeTest-993089865 None] Acquiring lock "cinder-quobyte-9d1908df-d8e0-4ece-9338-8d7f6a4cfea4" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:48:03 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5b1245d3-9fab-4a4c-9743-b365b1d9595b tempest-AttachVolumeNegativeTest-993089865 None] Lock "cinder-quobyte-9d1908df-d8e0-4ece-9338-8d7f6a4cfea4" acquired by "delete_volume" :: waited 0.023s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:48:03 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11dd2b2-0790-4b9e-b82d-cfdbb4584ac1]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:48:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5b1245d3-9fab-4a4c-9743-b365b1d9595b tempest-AttachVolumeNegativeTest-993089865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9d1908df-d8e0-4ece-9338-8d7f6a4cfea4 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:03 devstack sudo[95292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9d1908df-d8e0-4ece-9338-8d7f6a4cfea4
Nov 06 11:48:03 devstack sudo[95292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:03 devstack sudo[95287]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5e5a64ad-b3f8-4487-b440-1a322a905685 tempest-VolumesActionsTest-1055323903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4e3e725f-5676-44d7-8d28-9104f224eb55 1073741824" returned: 0 in 0.503s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5e5a64ad-b3f8-4487-b440-1a322a905685 tempest-VolumesActionsTest-1055323903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4e3e725f-5676-44d7-8d28-9104f224eb55 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:03 devstack sudo[95294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4e3e725f-5676-44d7-8d28-9104f224eb55
Nov 06 11:48:03 devstack sudo[95294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:03 devstack sudo[95292]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5b1245d3-9fab-4a4c-9743-b365b1d9595b tempest-AttachVolumeNegativeTest-993089865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9d1908df-d8e0-4ece-9338-8d7f6a4cfea4" returned: 0 in 0.397s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5b1245d3-9fab-4a4c-9743-b365b1d9595b tempest-AttachVolumeNegativeTest-993089865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9d1908df-d8e0-4ece-9338-8d7f6a4cfea4 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:03 devstack sudo[95299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9d1908df-d8e0-4ece-9338-8d7f6a4cfea4
Nov 06 11:48:03 devstack sudo[95299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:03 devstack sudo[95294]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5e5a64ad-b3f8-4487-b440-1a322a905685 tempest-VolumesActionsTest-1055323903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4e3e725f-5676-44d7-8d28-9104f224eb55" returned: 0 in 0.258s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:03 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5e5a64ad-b3f8-4487-b440-1a322a905685 tempest-VolumesActionsTest-1055323903 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:48:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5e5a64ad-b3f8-4487-b440-1a322a905685 tempest-VolumesActionsTest-1055323903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:48:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5e5a64ad-b3f8-4487-b440-1a322a905685 tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed9a9e31-04a2-4552-b221-8834c8bdb098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e3e725f-5676-44d7-8d28-9104f224eb55', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:48:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5e5a64ad-b3f8-4487-b440-1a322a905685 tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5e77598-a067-478a-8171-03425e8bfec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:48:03 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-5e5a64ad-b3f8-4487-b440-1a322a905685 tempest-VolumesActionsTest-1055323903 None] Volume volume-4e3e725f-5676-44d7-8d28-9104f224eb55 (4e3e725f-5676-44d7-8d28-9104f224eb55): created successfully
Nov 06 11:48:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5e5a64ad-b3f8-4487-b440-1a322a905685 tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5e77598-a067-478a-8171-03425e8bfec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:48:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5e5a64ad-b3f8-4487-b440-1a322a905685 tempest-VolumesActionsTest-1055323903 None] Flow 'volume_create_manager' (5ae459cf-eded-448b-b2a6-6097515799c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:48:03 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-5e5a64ad-b3f8-4487-b440-1a322a905685 tempest-VolumesActionsTest-1055323903 None] Created volume successfully.
Nov 06 11:48:03 devstack sudo[95299]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5b1245d3-9fab-4a4c-9743-b365b1d9595b tempest-AttachVolumeNegativeTest-993089865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9d1908df-d8e0-4ece-9338-8d7f6a4cfea4" returned: 0 in 0.267s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:03 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5b1245d3-9fab-4a4c-9743-b365b1d9595b tempest-AttachVolumeNegativeTest-993089865 None] Lock "cinder-quobyte-9d1908df-d8e0-4ece-9338-8d7f6a4cfea4" released by "delete_volume" :: held 0.710s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:48:03 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-5b1245d3-9fab-4a4c-9743-b365b1d9595b tempest-AttachVolumeNegativeTest-993089865 None] Created reservations ['5d0fc135-3436-4a18-90d2-859c949fb447', '10856acc-8d72-47d3-8bfc-16352cf3c0ac', '2ad8d259-dae5-41cc-bc52-438663be5888', '84cc20c5-76e4-476d-859d-ee5f3f3d410b'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:48:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5b1245d3-9fab-4a4c-9743-b365b1d9595b tempest-AttachVolumeNegativeTest-993089865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:48:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5b1245d3-9fab-4a4c-9743-b365b1d9595b tempest-AttachVolumeNegativeTest-993089865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:48:03 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5b1245d3-9fab-4a4c-9743-b365b1d9595b tempest-AttachVolumeNegativeTest-993089865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:48:03 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5b1245d3-9fab-4a4c-9743-b365b1d9595b tempest-AttachVolumeNegativeTest-993089865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:48:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5b1245d3-9fab-4a4c-9743-b365b1d9595b tempest-AttachVolumeNegativeTest-993089865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:48:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5b1245d3-9fab-4a4c-9743-b365b1d9595b tempest-AttachVolumeNegativeTest-993089865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:03 devstack sudo[95303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:48:03 devstack sudo[95303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:03 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-9aa21de9-cc1b-40d1-af4b-09606b4af648 tempest-SnapshotsActionsTest-2113967757 None] Acquiring lock "cinder-33750d8a-ec84-44ae-94fc-675fdf500607-delete_snapshot" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:48:04 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-9aa21de9-cc1b-40d1-af4b-09606b4af648 tempest-SnapshotsActionsTest-2113967757 None] Lock "cinder-33750d8a-ec84-44ae-94fc-675fdf500607-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:48:04 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-9aa21de9-cc1b-40d1-af4b-09606b4af648 tempest-SnapshotsActionsTest-2113967757 None] Acquiring lock "cinder-quobyte-c5463bc8-5b06-4d57-a6e0-b87504e71d57" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:48:04 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-9aa21de9-cc1b-40d1-af4b-09606b4af648 tempest-SnapshotsActionsTest-2113967757 None] Lock "cinder-quobyte-c5463bc8-5b06-4d57-a6e0-b87504e71d57" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:48:04 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-9aa21de9-cc1b-40d1-af4b-09606b4af648 tempest-SnapshotsActionsTest-2113967757 None] Acquiring lock "cinder-quobyte-33750d8a-ec84-44ae-94fc-675fdf500607" by "_delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:48:04 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-9aa21de9-cc1b-40d1-af4b-09606b4af648 tempest-SnapshotsActionsTest-2113967757 None] Lock "cinder-quobyte-33750d8a-ec84-44ae-94fc-675fdf500607" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:48:04 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-9aa21de9-cc1b-40d1-af4b-09606b4af648 tempest-SnapshotsActionsTest-2113967757 None] Deleting offline snapshot 33750d8a-ec84-44ae-94fc-675fdf500607 of volume c5463bc8-5b06-4d57-a6e0-b87504e71d57 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 11:48:04 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-9aa21de9-cc1b-40d1-af4b-09606b4af648 tempest-SnapshotsActionsTest-2113967757 None] snapshot_file for this snap is: volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.33750d8a-ec84-44ae-94fc-675fdf500607 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 11:48:04 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[46433b21-13ee-4035-a4ff-b7fcec119a94]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:48:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9aa21de9-cc1b-40d1-af4b-09606b4af648 tempest-SnapshotsActionsTest-2113967757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.33750d8a-ec84-44ae-94fc-675fdf500607 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:04 devstack sudo[95305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.33750d8a-ec84-44ae-94fc-675fdf500607
Nov 06 11:48:04 devstack sudo[95305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:04 devstack sudo[95303]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5b1245d3-9fab-4a4c-9743-b365b1d9595b tempest-AttachVolumeNegativeTest-993089865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.365s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:04 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-5b1245d3-9fab-4a4c-9743-b365b1d9595b tempest-AttachVolumeNegativeTest-993089865 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:48:04 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-5b1245d3-9fab-4a4c-9743-b365b1d9595b tempest-AttachVolumeNegativeTest-993089865 None] Deleted volume successfully.
Nov 06 11:48:04 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5b1245d3-9fab-4a4c-9743-b365b1d9595b tempest-AttachVolumeNegativeTest-993089865 None] Lock "cinder-9d1908df-d8e0-4ece-9338-8d7f6a4cfea4-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:48:04 devstack sudo[95305]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9aa21de9-cc1b-40d1-af4b-09606b4af648 tempest-SnapshotsActionsTest-2113967757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.33750d8a-ec84-44ae-94fc-675fdf500607" returned: 0 in 0.476s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:04 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-9aa21de9-cc1b-40d1-af4b-09606b4af648 tempest-SnapshotsActionsTest-2113967757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:48:04 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-8a1a0707-e4e1-44d6-b92b-b916957836b4 tempest-VolumesActionsTest-91619514 None] Acquiring lock "cinder-4e3e725f-5676-44d7-8d28-9104f224eb55-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:48:04 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b5781b-9128-433b-a2f4-af8764511d2c]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:48:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9aa21de9-cc1b-40d1-af4b-09606b4af648 tempest-SnapshotsActionsTest-2113967757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:04 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-8a1a0707-e4e1-44d6-b92b-b916957836b4 tempest-VolumesActionsTest-91619514 None] Lock "cinder-4e3e725f-5676-44d7-8d28-9104f224eb55-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:48:04 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-8a1a0707-e4e1-44d6-b92b-b916957836b4 tempest-VolumesActionsTest-91619514 None] Acquiring lock "cinder-quobyte-4e3e725f-5676-44d7-8d28-9104f224eb55" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:48:04 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-8a1a0707-e4e1-44d6-b92b-b916957836b4 tempest-VolumesActionsTest-91619514 None] Lock "cinder-quobyte-4e3e725f-5676-44d7-8d28-9104f224eb55" acquired by "delete_volume" :: waited 0.017s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:48:04 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a90bfeb-7bdb-4e43-bfdb-b84f891a658a]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:48:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-8a1a0707-e4e1-44d6-b92b-b916957836b4 tempest-VolumesActionsTest-91619514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4e3e725f-5676-44d7-8d28-9104f224eb55 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:04 devstack sudo[95312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3
Nov 06 11:48:04 devstack sudo[95312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:04 devstack sudo[95313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4e3e725f-5676-44d7-8d28-9104f224eb55
Nov 06 11:48:04 devstack sudo[95313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:05 devstack sudo[95312]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9aa21de9-cc1b-40d1-af4b-09606b4af648 tempest-SnapshotsActionsTest-2113967757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3" returned: 0 in 0.494s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:05 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-9aa21de9-cc1b-40d1-af4b-09606b4af648 tempest-SnapshotsActionsTest-2113967757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:48:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9aa21de9-cc1b-40d1-af4b-09606b4af648 tempest-SnapshotsActionsTest-2113967757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.33750d8a-ec84-44ae-94fc-675fdf500607 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:05 devstack sudo[95321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.33750d8a-ec84-44ae-94fc-675fdf500607
Nov 06 11:48:05 devstack sudo[95321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:05 devstack sudo[95313]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-8a1a0707-e4e1-44d6-b92b-b916957836b4 tempest-VolumesActionsTest-91619514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4e3e725f-5676-44d7-8d28-9104f224eb55" returned: 0 in 0.472s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-8a1a0707-e4e1-44d6-b92b-b916957836b4 tempest-VolumesActionsTest-91619514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4e3e725f-5676-44d7-8d28-9104f224eb55 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:05 devstack sudo[95325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4e3e725f-5676-44d7-8d28-9104f224eb55
Nov 06 11:48:05 devstack sudo[95325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:05 devstack sudo[95325]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-8a1a0707-e4e1-44d6-b92b-b916957836b4 tempest-VolumesActionsTest-91619514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4e3e725f-5676-44d7-8d28-9104f224eb55" returned: 0 in 0.368s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:05 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-8a1a0707-e4e1-44d6-b92b-b916957836b4 tempest-VolumesActionsTest-91619514 None] Lock "cinder-quobyte-4e3e725f-5676-44d7-8d28-9104f224eb55" released by "delete_volume" :: held 0.899s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:48:05 devstack sudo[95321]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9aa21de9-cc1b-40d1-af4b-09606b4af648 tempest-SnapshotsActionsTest-2113967757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.33750d8a-ec84-44ae-94fc-675fdf500607" returned: 0 in 0.526s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9aa21de9-cc1b-40d1-af4b-09606b4af648 tempest-SnapshotsActionsTest-2113967757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.33750d8a-ec84-44ae-94fc-675fdf500607 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:05 devstack sudo[95332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.33750d8a-ec84-44ae-94fc-675fdf500607
Nov 06 11:48:05 devstack sudo[95332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:05 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-8a1a0707-e4e1-44d6-b92b-b916957836b4 tempest-VolumesActionsTest-91619514 None] Created reservations ['62904f41-ff47-47b3-ad78-31bb3dcf656a', 'cf22dff8-fc7c-46c4-828f-1d4911a04286', '1378b6f6-beda-4118-8460-dcee0f24d02a', '63f74b14-63be-410d-ad23-3e3ea72773be'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:48:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-8a1a0707-e4e1-44d6-b92b-b916957836b4 tempest-VolumesActionsTest-91619514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:48:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-8a1a0707-e4e1-44d6-b92b-b916957836b4 tempest-VolumesActionsTest-91619514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:48:05 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-8a1a0707-e4e1-44d6-b92b-b916957836b4 tempest-VolumesActionsTest-91619514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:48:05 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-8a1a0707-e4e1-44d6-b92b-b916957836b4 tempest-VolumesActionsTest-91619514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:48:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-8a1a0707-e4e1-44d6-b92b-b916957836b4 tempest-VolumesActionsTest-91619514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:48:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-8a1a0707-e4e1-44d6-b92b-b916957836b4 tempest-VolumesActionsTest-91619514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:05 devstack sudo[95334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:48:05 devstack sudo[95334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:06 devstack sudo[95332]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9aa21de9-cc1b-40d1-af4b-09606b4af648 tempest-SnapshotsActionsTest-2113967757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.33750d8a-ec84-44ae-94fc-675fdf500607" returned: 0 in 0.435s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:06 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-9aa21de9-cc1b-40d1-af4b-09606b4af648 tempest-SnapshotsActionsTest-2113967757 None] Lock "cinder-quobyte-33750d8a-ec84-44ae-94fc-675fdf500607" released by "_delete_snapshot" :: held 2.081s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:48:06 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-9aa21de9-cc1b-40d1-af4b-09606b4af648 tempest-SnapshotsActionsTest-2113967757 None] Lock "cinder-quobyte-c5463bc8-5b06-4d57-a6e0-b87504e71d57" released by "delete_snapshot" :: held 2.110s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:48:06 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-9aa21de9-cc1b-40d1-af4b-09606b4af648 tempest-SnapshotsActionsTest-2113967757 None] Created reservations ['2356e020-e0c5-4773-bf2a-db5dc6ab6b29', 'e4d87cf5-8f81-4fc1-a57c-71e8f9369e00', '5383683a-9fb2-47c1-8ee2-ecdbdbd73b4d', '172ca00c-c5c9-4117-a335-68e177d26d29'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:48:06 devstack sudo[95334]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-8a1a0707-e4e1-44d6-b92b-b916957836b4 tempest-VolumesActionsTest-91619514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.383s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:06 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-8a1a0707-e4e1-44d6-b92b-b916957836b4 tempest-VolumesActionsTest-91619514 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:48:06 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-8a1a0707-e4e1-44d6-b92b-b916957836b4 tempest-VolumesActionsTest-91619514 None] Deleted volume successfully.
Nov 06 11:48:06 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-8a1a0707-e4e1-44d6-b92b-b916957836b4 tempest-VolumesActionsTest-91619514 None] Lock "cinder-4e3e725f-5676-44d7-8d28-9104f224eb55-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:48:06 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-9aa21de9-cc1b-40d1-af4b-09606b4af648 tempest-SnapshotsActionsTest-2113967757 None] Delete snapshot completed successfully.
Nov 06 11:48:06 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-9aa21de9-cc1b-40d1-af4b-09606b4af648 tempest-SnapshotsActionsTest-2113967757 None] Lock "cinder-33750d8a-ec84-44ae-94fc-675fdf500607-delete_snapshot" released by "delete_snapshot" :: held 2.341s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:48:07 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-5598ceed-abb5-4fa6-8a3a-9458fa85bbad tempest-VolumesActionsTest-1055323903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:48:07 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5598ceed-abb5-4fa6-8a3a-9458fa85bbad tempest-VolumesActionsTest-1055323903 None] Flow 'volume_create_manager' (5255a4a0-1681-4a96-a9a1-7255b353c3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:48:07 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5598ceed-abb5-4fa6-8a3a-9458fa85bbad tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaf57742-d1ce-44df-8cb9-49dc6ca5f73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:48:07 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5598ceed-abb5-4fa6-8a3a-9458fa85bbad tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaf57742-d1ce-44df-8cb9-49dc6ca5f73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-560980399',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41575ff2-8d2a-4faf-9a92-acc98b21d1bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e6f4e7600b74f8b9535d1386f3293dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:48:07Z,use_quota=True,user_id='ca8eaa9458014727befdf4ac0442c690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:48:07 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5598ceed-abb5-4fa6-8a3a-9458fa85bbad tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0bb3789-5859-4458-b120-7ad76b5da9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:48:07 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5598ceed-abb5-4fa6-8a3a-9458fa85bbad tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0bb3789-5859-4458-b120-7ad76b5da9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:48:07 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5598ceed-abb5-4fa6-8a3a-9458fa85bbad tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aee1785b-7ac8-4e8d-a09e-b46c83ce30be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:48:07 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5598ceed-abb5-4fa6-8a3a-9458fa85bbad tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aee1785b-7ac8-4e8d-a09e-b46c83ce30be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41575ff2-8d2a-4faf-9a92-acc98b21d1bd', 'volume_name': 'volume-41575ff2-8d2a-4faf-9a92-acc98b21d1bd', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:48:07 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5598ceed-abb5-4fa6-8a3a-9458fa85bbad tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7eaeebc-3e54-45e2-9146-938062155ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:48:07 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5598ceed-abb5-4fa6-8a3a-9458fa85bbad tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7eaeebc-3e54-45e2-9146-938062155ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:48:07 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5598ceed-abb5-4fa6-8a3a-9458fa85bbad tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d21da4ec-41ac-4032-8741-0fc7daf699cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:48:07 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-5598ceed-abb5-4fa6-8a3a-9458fa85bbad tempest-VolumesActionsTest-1055323903 None] Volume 41575ff2-8d2a-4faf-9a92-acc98b21d1bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41575ff2-8d2a-4faf-9a92-acc98b21d1bd', 'volume_size': 1}
Nov 06 11:48:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5598ceed-abb5-4fa6-8a3a-9458fa85bbad tempest-VolumesActionsTest-1055323903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:48:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5598ceed-abb5-4fa6-8a3a-9458fa85bbad tempest-VolumesActionsTest-1055323903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:48:07 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5598ceed-abb5-4fa6-8a3a-9458fa85bbad tempest-VolumesActionsTest-1055323903 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-560980399',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41575ff2-8d2a-4faf-9a92-acc98b21d1bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e6f4e7600b74f8b9535d1386f3293dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:48:07Z,use_quota=True,user_id='ca8eaa9458014727befdf4ac0442c690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:48:07 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-5598ceed-abb5-4fa6-8a3a-9458fa85bbad tempest-VolumesActionsTest-1055323903 None] Creating volume 41575ff2-8d2a-4faf-9a92-acc98b21d1bd {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:48:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5598ceed-abb5-4fa6-8a3a-9458fa85bbad tempest-VolumesActionsTest-1055323903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:48:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5598ceed-abb5-4fa6-8a3a-9458fa85bbad tempest-VolumesActionsTest-1055323903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:48:07 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5598ceed-abb5-4fa6-8a3a-9458fa85bbad tempest-VolumesActionsTest-1055323903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:48:07 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5598ceed-abb5-4fa6-8a3a-9458fa85bbad tempest-VolumesActionsTest-1055323903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:48:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5598ceed-abb5-4fa6-8a3a-9458fa85bbad tempest-VolumesActionsTest-1055323903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:48:07 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5598ceed-abb5-4fa6-8a3a-9458fa85bbad tempest-VolumesActionsTest-1055323903 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:48:07 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-5598ceed-abb5-4fa6-8a3a-9458fa85bbad tempest-VolumesActionsTest-1055323903 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:48:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5598ceed-abb5-4fa6-8a3a-9458fa85bbad tempest-VolumesActionsTest-1055323903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-41575ff2-8d2a-4faf-9a92-acc98b21d1bd 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:07 devstack sudo[95345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-41575ff2-8d2a-4faf-9a92-acc98b21d1bd 1073741824
Nov 06 11:48:07 devstack sudo[95345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-2f086369-751a-4364-811d-876b732cef1d tempest-SnapshotsActionsTest-1390245303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:48:08 devstack sudo[95345]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5598ceed-abb5-4fa6-8a3a-9458fa85bbad tempest-VolumesActionsTest-1055323903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-41575ff2-8d2a-4faf-9a92-acc98b21d1bd 1073741824" returned: 0 in 0.416s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5598ceed-abb5-4fa6-8a3a-9458fa85bbad tempest-VolumesActionsTest-1055323903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-41575ff2-8d2a-4faf-9a92-acc98b21d1bd {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:08 devstack sudo[95351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-41575ff2-8d2a-4faf-9a92-acc98b21d1bd
Nov 06 11:48:08 devstack sudo[95351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:08 devstack sudo[95351]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5598ceed-abb5-4fa6-8a3a-9458fa85bbad tempest-VolumesActionsTest-1055323903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-41575ff2-8d2a-4faf-9a92-acc98b21d1bd" returned: 0 in 0.250s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:08 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5598ceed-abb5-4fa6-8a3a-9458fa85bbad tempest-VolumesActionsTest-1055323903 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:48:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5598ceed-abb5-4fa6-8a3a-9458fa85bbad tempest-VolumesActionsTest-1055323903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:48:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-2f086369-751a-4364-811d-876b732cef1d tempest-SnapshotsActionsTest-1390245303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.656s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:48:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5598ceed-abb5-4fa6-8a3a-9458fa85bbad tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d21da4ec-41ac-4032-8741-0fc7daf699cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41575ff2-8d2a-4faf-9a92-acc98b21d1bd', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:48:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5598ceed-abb5-4fa6-8a3a-9458fa85bbad tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca8d3297-f363-41bf-af1c-20594b231c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:48:08 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-2f086369-751a-4364-811d-876b732cef1d tempest-SnapshotsActionsTest-1390245303 None] Creating offline snapshot 680c9de7-12c9-43d4-94a6-d9f84567b9ad of volume c5463bc8-5b06-4d57-a6e0-b87504e71d57 {{(pid=87165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 11:48:08 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-5598ceed-abb5-4fa6-8a3a-9458fa85bbad tempest-VolumesActionsTest-1055323903 None] Volume volume-41575ff2-8d2a-4faf-9a92-acc98b21d1bd (41575ff2-8d2a-4faf-9a92-acc98b21d1bd): created successfully
Nov 06 11:48:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5598ceed-abb5-4fa6-8a3a-9458fa85bbad tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca8d3297-f363-41bf-af1c-20594b231c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:48:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5598ceed-abb5-4fa6-8a3a-9458fa85bbad tempest-VolumesActionsTest-1055323903 None] Flow 'volume_create_manager' (5255a4a0-1681-4a96-a9a1-7255b353c3b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:48:08 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bee7bca-8598-4405-8bbc-f9e8700e11f4]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:48:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2f086369-751a-4364-811d-876b732cef1d tempest-SnapshotsActionsTest-1390245303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:08 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-5598ceed-abb5-4fa6-8a3a-9458fa85bbad tempest-VolumesActionsTest-1055323903 None] Created volume successfully.
Nov 06 11:48:08 devstack sudo[95354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3
Nov 06 11:48:08 devstack sudo[95354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:09 devstack sudo[95354]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:09 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2f086369-751a-4364-811d-876b732cef1d tempest-SnapshotsActionsTest-1390245303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3" returned: 0 in 0.489s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:09 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-2f086369-751a-4364-811d-876b732cef1d tempest-SnapshotsActionsTest-1390245303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:48:09 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2f086369-751a-4364-811d-876b732cef1d tempest-SnapshotsActionsTest-1390245303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.680c9de7-12c9-43d4-94a6-d9f84567b9ad 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:09 devstack sudo[95365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.680c9de7-12c9-43d4-94a6-d9f84567b9ad 1G
Nov 06 11:48:09 devstack sudo[95365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:09 devstack sudo[95365]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:09 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2f086369-751a-4364-811d-876b732cef1d tempest-SnapshotsActionsTest-1390245303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.680c9de7-12c9-43d4-94a6-d9f84567b9ad 1G" returned: 0 in 0.644s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:09 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2f086369-751a-4364-811d-876b732cef1d tempest-SnapshotsActionsTest-1390245303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.680c9de7-12c9-43d4-94a6-d9f84567b9ad {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:09 devstack sudo[95375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.680c9de7-12c9-43d4-94a6-d9f84567b9ad
Nov 06 11:48:09 devstack sudo[95375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:09 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ea258544-c744-4b86-9430-ce6a7f0e1e65 tempest-VolumesActionsTest-91619514 None] Acquiring lock "cinder-41575ff2-8d2a-4faf-9a92-acc98b21d1bd-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:48:09 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ea258544-c744-4b86-9430-ce6a7f0e1e65 tempest-VolumesActionsTest-91619514 None] Lock "cinder-41575ff2-8d2a-4faf-9a92-acc98b21d1bd-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:48:09 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:SELECT=113,cinder:UPDATE=97,cinder:INSERT=27,cinder:DELETE=7 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 11:48:09 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ea258544-c744-4b86-9430-ce6a7f0e1e65 tempest-VolumesActionsTest-91619514 None] Acquiring lock "cinder-quobyte-41575ff2-8d2a-4faf-9a92-acc98b21d1bd" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:48:09 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ea258544-c744-4b86-9430-ce6a7f0e1e65 tempest-VolumesActionsTest-91619514 None] Lock "cinder-quobyte-41575ff2-8d2a-4faf-9a92-acc98b21d1bd" acquired by "delete_volume" :: waited 0.034s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:48:09 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3858f1-8fce-4bd4-8506-225669a89db3]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:48:09 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ea258544-c744-4b86-9430-ce6a7f0e1e65 tempest-VolumesActionsTest-91619514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-41575ff2-8d2a-4faf-9a92-acc98b21d1bd {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:10 devstack sudo[95377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-41575ff2-8d2a-4faf-9a92-acc98b21d1bd
Nov 06 11:48:10 devstack sudo[95377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:10 devstack sudo[95375]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2f086369-751a-4364-811d-876b732cef1d tempest-SnapshotsActionsTest-1390245303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.680c9de7-12c9-43d4-94a6-d9f84567b9ad" returned: 0 in 0.542s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:10 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-2f086369-751a-4364-811d-876b732cef1d tempest-SnapshotsActionsTest-1390245303 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.680c9de7-12c9-43d4-94a6-d9f84567b9ad is being set with open permissions: ugo+rw
Nov 06 11:48:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2f086369-751a-4364-811d-876b732cef1d tempest-SnapshotsActionsTest-1390245303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.680c9de7-12c9-43d4-94a6-d9f84567b9ad {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:10 devstack sudo[95384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.680c9de7-12c9-43d4-94a6-d9f84567b9ad
Nov 06 11:48:10 devstack sudo[95384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:10 devstack sudo[95377]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ea258544-c744-4b86-9430-ce6a7f0e1e65 tempest-VolumesActionsTest-91619514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-41575ff2-8d2a-4faf-9a92-acc98b21d1bd" returned: 0 in 0.496s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ea258544-c744-4b86-9430-ce6a7f0e1e65 tempest-VolumesActionsTest-91619514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-41575ff2-8d2a-4faf-9a92-acc98b21d1bd {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:10 devstack sudo[95390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-41575ff2-8d2a-4faf-9a92-acc98b21d1bd
Nov 06 11:48:10 devstack sudo[95390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:10 devstack sudo[95384]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2f086369-751a-4364-811d-876b732cef1d tempest-SnapshotsActionsTest-1390245303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.680c9de7-12c9-43d4-94a6-d9f84567b9ad" returned: 0 in 0.322s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-2f086369-751a-4364-811d-876b732cef1d tempest-SnapshotsActionsTest-1390245303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.176s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:48:10 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-2f086369-751a-4364-811d-876b732cef1d tempest-SnapshotsActionsTest-1390245303 None] Create snapshot completed successfully
Nov 06 11:48:10 devstack sudo[95390]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ea258544-c744-4b86-9430-ce6a7f0e1e65 tempest-VolumesActionsTest-91619514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-41575ff2-8d2a-4faf-9a92-acc98b21d1bd" returned: 0 in 0.320s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:10 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ea258544-c744-4b86-9430-ce6a7f0e1e65 tempest-VolumesActionsTest-91619514 None] Lock "cinder-quobyte-41575ff2-8d2a-4faf-9a92-acc98b21d1bd" released by "delete_volume" :: held 0.911s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:48:10 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-ea258544-c744-4b86-9430-ce6a7f0e1e65 tempest-VolumesActionsTest-91619514 None] Created reservations ['cec74d7f-f7e0-487f-b88b-d06cd26360a2', '2feebb71-2a3b-4706-8667-2dd1eb672785', 'ec9c6df9-b083-410f-9ae7-038c594be929', 'a22ffdd9-d422-49e4-9e2d-f7d800a2668a'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:48:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ea258544-c744-4b86-9430-ce6a7f0e1e65 tempest-VolumesActionsTest-91619514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:48:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ea258544-c744-4b86-9430-ce6a7f0e1e65 tempest-VolumesActionsTest-91619514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:48:10 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ea258544-c744-4b86-9430-ce6a7f0e1e65 tempest-VolumesActionsTest-91619514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:48:11 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ea258544-c744-4b86-9430-ce6a7f0e1e65 tempest-VolumesActionsTest-91619514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:48:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ea258544-c744-4b86-9430-ce6a7f0e1e65 tempest-VolumesActionsTest-91619514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:48:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ea258544-c744-4b86-9430-ce6a7f0e1e65 tempest-VolumesActionsTest-91619514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:11 devstack sudo[95425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:48:11 devstack sudo[95425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:11 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c18d63c4-8e46-4662-a753-b17c1393f349 tempest-SnapshotsActionsTest-2113967757 None] Acquiring lock "cinder-680c9de7-12c9-43d4-94a6-d9f84567b9ad-delete_snapshot" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:48:11 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c18d63c4-8e46-4662-a753-b17c1393f349 tempest-SnapshotsActionsTest-2113967757 None] Lock "cinder-680c9de7-12c9-43d4-94a6-d9f84567b9ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:48:11 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c18d63c4-8e46-4662-a753-b17c1393f349 tempest-SnapshotsActionsTest-2113967757 None] Acquiring lock "cinder-quobyte-c5463bc8-5b06-4d57-a6e0-b87504e71d57" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:48:11 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c18d63c4-8e46-4662-a753-b17c1393f349 tempest-SnapshotsActionsTest-2113967757 None] Lock "cinder-quobyte-c5463bc8-5b06-4d57-a6e0-b87504e71d57" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:48:11 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c18d63c4-8e46-4662-a753-b17c1393f349 tempest-SnapshotsActionsTest-2113967757 None] Acquiring lock "cinder-quobyte-680c9de7-12c9-43d4-94a6-d9f84567b9ad" by "_delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:48:11 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c18d63c4-8e46-4662-a753-b17c1393f349 tempest-SnapshotsActionsTest-2113967757 None] Lock "cinder-quobyte-680c9de7-12c9-43d4-94a6-d9f84567b9ad" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:48:11 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-c18d63c4-8e46-4662-a753-b17c1393f349 tempest-SnapshotsActionsTest-2113967757 None] Deleting offline snapshot 680c9de7-12c9-43d4-94a6-d9f84567b9ad of volume c5463bc8-5b06-4d57-a6e0-b87504e71d57 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 11:48:11 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-c18d63c4-8e46-4662-a753-b17c1393f349 tempest-SnapshotsActionsTest-2113967757 None] snapshot_file for this snap is: volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.680c9de7-12c9-43d4-94a6-d9f84567b9ad {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 11:48:11 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a081b62-99be-4263-af62-02bd2c80d856]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:48:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c18d63c4-8e46-4662-a753-b17c1393f349 tempest-SnapshotsActionsTest-2113967757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.680c9de7-12c9-43d4-94a6-d9f84567b9ad {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:11 devstack sudo[95425]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ea258544-c744-4b86-9430-ce6a7f0e1e65 tempest-VolumesActionsTest-91619514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.381s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:11 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-ea258544-c744-4b86-9430-ce6a7f0e1e65 tempest-VolumesActionsTest-91619514 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:48:11 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-ea258544-c744-4b86-9430-ce6a7f0e1e65 tempest-VolumesActionsTest-91619514 None] Deleted volume successfully.
Nov 06 11:48:11 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ea258544-c744-4b86-9430-ce6a7f0e1e65 tempest-VolumesActionsTest-91619514 None] Lock "cinder-41575ff2-8d2a-4faf-9a92-acc98b21d1bd-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:48:11 devstack sudo[95428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.680c9de7-12c9-43d4-94a6-d9f84567b9ad
Nov 06 11:48:11 devstack sudo[95428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:11 devstack sudo[95428]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c18d63c4-8e46-4662-a753-b17c1393f349 tempest-SnapshotsActionsTest-2113967757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.680c9de7-12c9-43d4-94a6-d9f84567b9ad" returned: 0 in 0.393s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:11 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-c18d63c4-8e46-4662-a753-b17c1393f349 tempest-SnapshotsActionsTest-2113967757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:48:11 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[817f2039-7977-4d2a-be83-0e0f294e2bd2]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:48:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c18d63c4-8e46-4662-a753-b17c1393f349 tempest-SnapshotsActionsTest-2113967757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:11 devstack sudo[95434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3
Nov 06 11:48:11 devstack sudo[95434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:12 devstack sudo[95434]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c18d63c4-8e46-4662-a753-b17c1393f349 tempest-SnapshotsActionsTest-2113967757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3" returned: 0 in 0.417s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:12 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-c18d63c4-8e46-4662-a753-b17c1393f349 tempest-SnapshotsActionsTest-2113967757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:48:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c18d63c4-8e46-4662-a753-b17c1393f349 tempest-SnapshotsActionsTest-2113967757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.680c9de7-12c9-43d4-94a6-d9f84567b9ad {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:12 devstack sudo[95440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.680c9de7-12c9-43d4-94a6-d9f84567b9ad
Nov 06 11:48:12 devstack sudo[95440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:12 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-76c115e5-c19f-4bc7-aa09-c216a1a82eed tempest-VolumesActionsTest-1055323903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:48:12 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-76c115e5-c19f-4bc7-aa09-c216a1a82eed tempest-VolumesActionsTest-1055323903 None] Flow 'volume_create_manager' (d34eaa54-4939-41aa-a46b-25b06d498ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:48:12 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-76c115e5-c19f-4bc7-aa09-c216a1a82eed tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e421b28d-6529-4af5-80b4-3799925ab244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:48:12 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-76c115e5-c19f-4bc7-aa09-c216a1a82eed tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e421b28d-6529-4af5-80b4-3799925ab244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1992737877',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e59f972-137b-4071-99dd-bbfb7544eddd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e6f4e7600b74f8b9535d1386f3293dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:48:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:48:13Z,use_quota=True,user_id='ca8eaa9458014727befdf4ac0442c690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:48:12 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-76c115e5-c19f-4bc7-aa09-c216a1a82eed tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e917f41-6da7-41a7-9db2-15c1e8ca23cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:48:12 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-76c115e5-c19f-4bc7-aa09-c216a1a82eed tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e917f41-6da7-41a7-9db2-15c1e8ca23cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:48:12 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-76c115e5-c19f-4bc7-aa09-c216a1a82eed tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (508da10b-1af1-41a0-85e2-6a06e8b671be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:48:12 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-76c115e5-c19f-4bc7-aa09-c216a1a82eed tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (508da10b-1af1-41a0-85e2-6a06e8b671be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e59f972-137b-4071-99dd-bbfb7544eddd', 'volume_name': 'volume-9e59f972-137b-4071-99dd-bbfb7544eddd', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:48:12 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-76c115e5-c19f-4bc7-aa09-c216a1a82eed tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (519bd2fb-2cad-4a4f-80cc-dca4e6cdf639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:48:12 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-76c115e5-c19f-4bc7-aa09-c216a1a82eed tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (519bd2fb-2cad-4a4f-80cc-dca4e6cdf639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:48:12 devstack sudo[95440]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:12 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-76c115e5-c19f-4bc7-aa09-c216a1a82eed tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad5487ac-0749-4c92-ab25-8dcccca03a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:48:12 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-76c115e5-c19f-4bc7-aa09-c216a1a82eed tempest-VolumesActionsTest-1055323903 None] Volume 9e59f972-137b-4071-99dd-bbfb7544eddd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e59f972-137b-4071-99dd-bbfb7544eddd', 'volume_size': 1}
Nov 06 11:48:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-76c115e5-c19f-4bc7-aa09-c216a1a82eed tempest-VolumesActionsTest-1055323903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:48:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-76c115e5-c19f-4bc7-aa09-c216a1a82eed tempest-VolumesActionsTest-1055323903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:48:12 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-76c115e5-c19f-4bc7-aa09-c216a1a82eed tempest-VolumesActionsTest-1055323903 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1992737877',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e59f972-137b-4071-99dd-bbfb7544eddd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e6f4e7600b74f8b9535d1386f3293dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:48:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:48:13Z,use_quota=True,user_id='ca8eaa9458014727befdf4ac0442c690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:48:12 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-76c115e5-c19f-4bc7-aa09-c216a1a82eed tempest-VolumesActionsTest-1055323903 None] Creating volume 9e59f972-137b-4071-99dd-bbfb7544eddd {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:48:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-76c115e5-c19f-4bc7-aa09-c216a1a82eed tempest-VolumesActionsTest-1055323903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:48:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-76c115e5-c19f-4bc7-aa09-c216a1a82eed tempest-VolumesActionsTest-1055323903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:48:12 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-76c115e5-c19f-4bc7-aa09-c216a1a82eed tempest-VolumesActionsTest-1055323903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:48:12 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-76c115e5-c19f-4bc7-aa09-c216a1a82eed tempest-VolumesActionsTest-1055323903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:48:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-76c115e5-c19f-4bc7-aa09-c216a1a82eed tempest-VolumesActionsTest-1055323903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:48:12 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-76c115e5-c19f-4bc7-aa09-c216a1a82eed tempest-VolumesActionsTest-1055323903 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:48:12 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-76c115e5-c19f-4bc7-aa09-c216a1a82eed tempest-VolumesActionsTest-1055323903 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:48:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-76c115e5-c19f-4bc7-aa09-c216a1a82eed tempest-VolumesActionsTest-1055323903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9e59f972-137b-4071-99dd-bbfb7544eddd 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c18d63c4-8e46-4662-a753-b17c1393f349 tempest-SnapshotsActionsTest-2113967757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.680c9de7-12c9-43d4-94a6-d9f84567b9ad" returned: 0 in 0.492s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c18d63c4-8e46-4662-a753-b17c1393f349 tempest-SnapshotsActionsTest-2113967757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.680c9de7-12c9-43d4-94a6-d9f84567b9ad {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:12 devstack sudo[95446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9e59f972-137b-4071-99dd-bbfb7544eddd 1073741824
Nov 06 11:48:12 devstack sudo[95446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:12 devstack sudo[95447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.680c9de7-12c9-43d4-94a6-d9f84567b9ad
Nov 06 11:48:12 devstack sudo[95447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:12 devstack sudo[95447]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c18d63c4-8e46-4662-a753-b17c1393f349 tempest-SnapshotsActionsTest-2113967757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.680c9de7-12c9-43d4-94a6-d9f84567b9ad" returned: 0 in 0.265s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:13 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c18d63c4-8e46-4662-a753-b17c1393f349 tempest-SnapshotsActionsTest-2113967757 None] Lock "cinder-quobyte-680c9de7-12c9-43d4-94a6-d9f84567b9ad" released by "_delete_snapshot" :: held 1.689s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:48:13 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c18d63c4-8e46-4662-a753-b17c1393f349 tempest-SnapshotsActionsTest-2113967757 None] Lock "cinder-quobyte-c5463bc8-5b06-4d57-a6e0-b87504e71d57" released by "delete_snapshot" :: held 1.720s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:48:13 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-c18d63c4-8e46-4662-a753-b17c1393f349 tempest-SnapshotsActionsTest-2113967757 None] Created reservations ['8638817f-20b0-445b-9ab1-57d0add550f3', '242f01f6-c484-42ab-999f-c57e51d44333', '26d0b893-bdb3-4309-8ae7-0c6541909473', '3e823831-5ce9-44b1-9892-b2cb367317f7'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:48:13 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-c18d63c4-8e46-4662-a753-b17c1393f349 tempest-SnapshotsActionsTest-2113967757 None] Delete snapshot completed successfully.
Nov 06 11:48:13 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c18d63c4-8e46-4662-a753-b17c1393f349 tempest-SnapshotsActionsTest-2113967757 None] Lock "cinder-680c9de7-12c9-43d4-94a6-d9f84567b9ad-delete_snapshot" released by "delete_snapshot" :: held 1.888s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:48:13 devstack sudo[95446]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-76c115e5-c19f-4bc7-aa09-c216a1a82eed tempest-VolumesActionsTest-1055323903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9e59f972-137b-4071-99dd-bbfb7544eddd 1073741824" returned: 0 in 0.489s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-76c115e5-c19f-4bc7-aa09-c216a1a82eed tempest-VolumesActionsTest-1055323903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9e59f972-137b-4071-99dd-bbfb7544eddd {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:13 devstack sudo[95455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9e59f972-137b-4071-99dd-bbfb7544eddd
Nov 06 11:48:13 devstack sudo[95455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:13 devstack sudo[95455]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-76c115e5-c19f-4bc7-aa09-c216a1a82eed tempest-VolumesActionsTest-1055323903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9e59f972-137b-4071-99dd-bbfb7544eddd" returned: 0 in 0.302s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:13 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-76c115e5-c19f-4bc7-aa09-c216a1a82eed tempest-VolumesActionsTest-1055323903 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:48:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-76c115e5-c19f-4bc7-aa09-c216a1a82eed tempest-VolumesActionsTest-1055323903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:48:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-76c115e5-c19f-4bc7-aa09-c216a1a82eed tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad5487ac-0749-4c92-ab25-8dcccca03a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e59f972-137b-4071-99dd-bbfb7544eddd', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:48:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-76c115e5-c19f-4bc7-aa09-c216a1a82eed tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77f1355f-3e08-42e5-b0df-56dd49d85296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:48:13 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-76c115e5-c19f-4bc7-aa09-c216a1a82eed tempest-VolumesActionsTest-1055323903 None] Volume volume-9e59f972-137b-4071-99dd-bbfb7544eddd (9e59f972-137b-4071-99dd-bbfb7544eddd): created successfully
Nov 06 11:48:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-76c115e5-c19f-4bc7-aa09-c216a1a82eed tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77f1355f-3e08-42e5-b0df-56dd49d85296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:48:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-76c115e5-c19f-4bc7-aa09-c216a1a82eed tempest-VolumesActionsTest-1055323903 None] Flow 'volume_create_manager' (d34eaa54-4939-41aa-a46b-25b06d498ee6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:48:13 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-76c115e5-c19f-4bc7-aa09-c216a1a82eed tempest-VolumesActionsTest-1055323903 None] Created volume successfully.
Nov 06 11:48:13 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-32990bc5-d532-4190-8bd5-ffe964d002dc tempest-VolumesTestJSON-913936664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:48:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-32990bc5-d532-4190-8bd5-ffe964d002dc tempest-VolumesTestJSON-913936664 None] Flow 'volume_create_manager' (1b11be67-f327-4d33-812e-937b61bb3035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:48:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-32990bc5-d532-4190-8bd5-ffe964d002dc tempest-VolumesTestJSON-913936664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26b22784-189f-4b11-8208-57d762f08e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:48:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-32990bc5-d532-4190-8bd5-ffe964d002dc tempest-VolumesTestJSON-913936664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26b22784-189f-4b11-8208-57d762f08e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:48:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1486708557',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4304f6d-a78f-4737-ad43-e3390755a116,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='095feffadbf04fbabe0231a4b57a7653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:48:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:48:14Z,use_quota=True,user_id='c85e401b30d84bdda80eb48824eaef9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:48:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-32990bc5-d532-4190-8bd5-ffe964d002dc tempest-VolumesTestJSON-913936664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2629d8d3-da5b-4f99-a357-6713768d5061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:48:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-32990bc5-d532-4190-8bd5-ffe964d002dc tempest-VolumesTestJSON-913936664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2629d8d3-da5b-4f99-a357-6713768d5061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:48:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-32990bc5-d532-4190-8bd5-ffe964d002dc tempest-VolumesTestJSON-913936664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32757710-7a99-4478-9dd2-b78a215c5948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:48:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-32990bc5-d532-4190-8bd5-ffe964d002dc tempest-VolumesTestJSON-913936664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32757710-7a99-4478-9dd2-b78a215c5948) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4304f6d-a78f-4737-ad43-e3390755a116', 'volume_name': 'volume-b4304f6d-a78f-4737-ad43-e3390755a116', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:48:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-32990bc5-d532-4190-8bd5-ffe964d002dc tempest-VolumesTestJSON-913936664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (128a7e8c-03a2-4647-80e7-07db7e14b2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:48:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-32990bc5-d532-4190-8bd5-ffe964d002dc tempest-VolumesTestJSON-913936664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (128a7e8c-03a2-4647-80e7-07db7e14b2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:48:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-32990bc5-d532-4190-8bd5-ffe964d002dc tempest-VolumesTestJSON-913936664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2beb283-b905-4da8-a1f7-760e8cff2b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:48:13 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-32990bc5-d532-4190-8bd5-ffe964d002dc tempest-VolumesTestJSON-913936664 None] Volume b4304f6d-a78f-4737-ad43-e3390755a116: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4304f6d-a78f-4737-ad43-e3390755a116', 'volume_size': 1}
Nov 06 11:48:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-32990bc5-d532-4190-8bd5-ffe964d002dc tempest-VolumesTestJSON-913936664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:48:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-32990bc5-d532-4190-8bd5-ffe964d002dc tempest-VolumesTestJSON-913936664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:48:13 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-32990bc5-d532-4190-8bd5-ffe964d002dc tempest-VolumesTestJSON-913936664 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:48:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1486708557',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4304f6d-a78f-4737-ad43-e3390755a116,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='095feffadbf04fbabe0231a4b57a7653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:48:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:48:14Z,use_quota=True,user_id='c85e401b30d84bdda80eb48824eaef9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:48:13 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-32990bc5-d532-4190-8bd5-ffe964d002dc tempest-VolumesTestJSON-913936664 None] Creating volume b4304f6d-a78f-4737-ad43-e3390755a116 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:48:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-32990bc5-d532-4190-8bd5-ffe964d002dc tempest-VolumesTestJSON-913936664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:48:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-32990bc5-d532-4190-8bd5-ffe964d002dc tempest-VolumesTestJSON-913936664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:48:13 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-32990bc5-d532-4190-8bd5-ffe964d002dc tempest-VolumesTestJSON-913936664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:48:13 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-32990bc5-d532-4190-8bd5-ffe964d002dc tempest-VolumesTestJSON-913936664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:48:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-32990bc5-d532-4190-8bd5-ffe964d002dc tempest-VolumesTestJSON-913936664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:48:13 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-32990bc5-d532-4190-8bd5-ffe964d002dc tempest-VolumesTestJSON-913936664 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:48:13 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-32990bc5-d532-4190-8bd5-ffe964d002dc tempest-VolumesTestJSON-913936664 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:48:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-32990bc5-d532-4190-8bd5-ffe964d002dc tempest-VolumesTestJSON-913936664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b4304f6d-a78f-4737-ad43-e3390755a116 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:13 devstack sudo[95458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b4304f6d-a78f-4737-ad43-e3390755a116 1073741824
Nov 06 11:48:13 devstack sudo[95458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:14 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-86ba2fff-1425-4cb2-b117-2964ccc2dfaa tempest-SnapshotsActionsTest-1390245303 None] Acquiring lock "cinder-e377ddc8-d1b7-4508-bbc0-a53d9b305da3-delete_snapshot" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:48:14 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-86ba2fff-1425-4cb2-b117-2964ccc2dfaa tempest-SnapshotsActionsTest-1390245303 None] Lock "cinder-e377ddc8-d1b7-4508-bbc0-a53d9b305da3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:48:14 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-86ba2fff-1425-4cb2-b117-2964ccc2dfaa tempest-SnapshotsActionsTest-1390245303 None] Acquiring lock "cinder-quobyte-c5463bc8-5b06-4d57-a6e0-b87504e71d57" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:48:14 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-86ba2fff-1425-4cb2-b117-2964ccc2dfaa tempest-SnapshotsActionsTest-1390245303 None] Lock "cinder-quobyte-c5463bc8-5b06-4d57-a6e0-b87504e71d57" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:48:14 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-86ba2fff-1425-4cb2-b117-2964ccc2dfaa tempest-SnapshotsActionsTest-1390245303 None] Acquiring lock "cinder-quobyte-e377ddc8-d1b7-4508-bbc0-a53d9b305da3" by "_delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:48:14 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-86ba2fff-1425-4cb2-b117-2964ccc2dfaa tempest-SnapshotsActionsTest-1390245303 None] Lock "cinder-quobyte-e377ddc8-d1b7-4508-bbc0-a53d9b305da3" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:48:14 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-86ba2fff-1425-4cb2-b117-2964ccc2dfaa tempest-SnapshotsActionsTest-1390245303 None] Deleting offline snapshot e377ddc8-d1b7-4508-bbc0-a53d9b305da3 of volume c5463bc8-5b06-4d57-a6e0-b87504e71d57 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 11:48:14 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-86ba2fff-1425-4cb2-b117-2964ccc2dfaa tempest-SnapshotsActionsTest-1390245303 None] snapshot_file for this snap is: volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 11:48:14 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[831de19d-ac86-4ed6-acc0-a0ca38eaad69]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:48:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-86ba2fff-1425-4cb2-b117-2964ccc2dfaa tempest-SnapshotsActionsTest-1390245303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:14 devstack sudo[95464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3
Nov 06 11:48:14 devstack sudo[95464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:14 devstack sudo[95458]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-32990bc5-d532-4190-8bd5-ffe964d002dc tempest-VolumesTestJSON-913936664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b4304f6d-a78f-4737-ad43-e3390755a116 1073741824" returned: 0 in 0.494s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-32990bc5-d532-4190-8bd5-ffe964d002dc tempest-VolumesTestJSON-913936664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b4304f6d-a78f-4737-ad43-e3390755a116 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:14 devstack sudo[95467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b4304f6d-a78f-4737-ad43-e3390755a116
Nov 06 11:48:14 devstack sudo[95467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:14 devstack sudo[95464]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-86ba2fff-1425-4cb2-b117-2964ccc2dfaa tempest-SnapshotsActionsTest-1390245303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3" returned: 0 in 0.391s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:14 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-86ba2fff-1425-4cb2-b117-2964ccc2dfaa tempest-SnapshotsActionsTest-1390245303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:48:14 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a2bda2-e32f-43a4-8940-926d1f97d26c]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:48:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-86ba2fff-1425-4cb2-b117-2964ccc2dfaa tempest-SnapshotsActionsTest-1390245303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:14 devstack sudo[95467]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-32990bc5-d532-4190-8bd5-ffe964d002dc tempest-VolumesTestJSON-913936664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b4304f6d-a78f-4737-ad43-e3390755a116" returned: 0 in 0.277s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:14 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-32990bc5-d532-4190-8bd5-ffe964d002dc tempest-VolumesTestJSON-913936664 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:48:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-32990bc5-d532-4190-8bd5-ffe964d002dc tempest-VolumesTestJSON-913936664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:48:14 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-32990bc5-d532-4190-8bd5-ffe964d002dc tempest-VolumesTestJSON-913936664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2beb283-b905-4da8-a1f7-760e8cff2b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4304f6d-a78f-4737-ad43-e3390755a116', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:48:14 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-32990bc5-d532-4190-8bd5-ffe964d002dc tempest-VolumesTestJSON-913936664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d11868e-09d3-4701-b5d8-8a08e75dd8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:48:14 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-32990bc5-d532-4190-8bd5-ffe964d002dc tempest-VolumesTestJSON-913936664 None] Volume volume-b4304f6d-a78f-4737-ad43-e3390755a116 (b4304f6d-a78f-4737-ad43-e3390755a116): created successfully
Nov 06 11:48:14 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-32990bc5-d532-4190-8bd5-ffe964d002dc tempest-VolumesTestJSON-913936664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d11868e-09d3-4701-b5d8-8a08e75dd8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:48:14 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-32990bc5-d532-4190-8bd5-ffe964d002dc tempest-VolumesTestJSON-913936664 None] Flow 'volume_create_manager' (1b11be67-f327-4d33-812e-937b61bb3035) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:48:14 devstack sudo[95473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57
Nov 06 11:48:14 devstack sudo[95473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:14 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-32990bc5-d532-4190-8bd5-ffe964d002dc tempest-VolumesTestJSON-913936664 None] Created volume successfully.
Nov 06 11:48:14 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d49e5aeb-8b12-446e-8fab-af3d37348866 tempest-VolumesActionsTest-91619514 None] Acquiring lock "cinder-9e59f972-137b-4071-99dd-bbfb7544eddd-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:48:14 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d49e5aeb-8b12-446e-8fab-af3d37348866 tempest-VolumesActionsTest-91619514 None] Lock "cinder-9e59f972-137b-4071-99dd-bbfb7544eddd-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:48:14 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d49e5aeb-8b12-446e-8fab-af3d37348866 tempest-VolumesActionsTest-91619514 None] Acquiring lock "cinder-quobyte-9e59f972-137b-4071-99dd-bbfb7544eddd" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:48:14 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d49e5aeb-8b12-446e-8fab-af3d37348866 tempest-VolumesActionsTest-91619514 None] Lock "cinder-quobyte-9e59f972-137b-4071-99dd-bbfb7544eddd" acquired by "delete_volume" :: waited 0.026s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:48:14 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c8e4f3-6353-4a90-8f25-7412188f2e8b]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:48:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d49e5aeb-8b12-446e-8fab-af3d37348866 tempest-VolumesActionsTest-91619514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9e59f972-137b-4071-99dd-bbfb7544eddd {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:15 devstack sudo[95473]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-86ba2fff-1425-4cb2-b117-2964ccc2dfaa tempest-SnapshotsActionsTest-1390245303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57" returned: 0 in 0.395s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-86ba2fff-1425-4cb2-b117-2964ccc2dfaa tempest-SnapshotsActionsTest-1390245303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:15 devstack sudo[95479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3
Nov 06 11:48:15 devstack sudo[95479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:15 devstack sudo[95478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9e59f972-137b-4071-99dd-bbfb7544eddd
Nov 06 11:48:15 devstack sudo[95478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:15 devstack sudo[95478]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d49e5aeb-8b12-446e-8fab-af3d37348866 tempest-VolumesActionsTest-91619514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9e59f972-137b-4071-99dd-bbfb7544eddd" returned: 0 in 0.381s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d49e5aeb-8b12-446e-8fab-af3d37348866 tempest-VolumesActionsTest-91619514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9e59f972-137b-4071-99dd-bbfb7544eddd {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:15 devstack sudo[95479]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-86ba2fff-1425-4cb2-b117-2964ccc2dfaa tempest-SnapshotsActionsTest-1390245303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3" returned: 0 in 0.357s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-86ba2fff-1425-4cb2-b117-2964ccc2dfaa tempest-SnapshotsActionsTest-1390245303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:15 devstack sudo[95488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9e59f972-137b-4071-99dd-bbfb7544eddd
Nov 06 11:48:15 devstack sudo[95488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:15 devstack sudo[95489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3
Nov 06 11:48:15 devstack sudo[95489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:15 devstack sudo[95488]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d49e5aeb-8b12-446e-8fab-af3d37348866 tempest-VolumesActionsTest-91619514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9e59f972-137b-4071-99dd-bbfb7544eddd" returned: 0 in 0.260s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:15 devstack sudo[95489]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:15 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d49e5aeb-8b12-446e-8fab-af3d37348866 tempest-VolumesActionsTest-91619514 None] Lock "cinder-quobyte-9e59f972-137b-4071-99dd-bbfb7544eddd" released by "delete_volume" :: held 0.684s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:48:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-86ba2fff-1425-4cb2-b117-2964ccc2dfaa tempest-SnapshotsActionsTest-1390245303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57.e377ddc8-d1b7-4508-bbc0-a53d9b305da3" returned: 0 in 0.259s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:15 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-86ba2fff-1425-4cb2-b117-2964ccc2dfaa tempest-SnapshotsActionsTest-1390245303 None] Lock "cinder-quobyte-e377ddc8-d1b7-4508-bbc0-a53d9b305da3" released by "_delete_snapshot" :: held 1.525s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:48:15 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-86ba2fff-1425-4cb2-b117-2964ccc2dfaa tempest-SnapshotsActionsTest-1390245303 None] Lock "cinder-quobyte-c5463bc8-5b06-4d57-a6e0-b87504e71d57" released by "delete_snapshot" :: held 1.549s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:48:15 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-d49e5aeb-8b12-446e-8fab-af3d37348866 tempest-VolumesActionsTest-91619514 None] Created reservations ['b4342f7a-8b00-4e84-a1a1-086f698f1443', '0a24920b-b4d9-4da8-abe6-43c056dbdb09', '6f1d26b8-8843-46d0-903a-361b9b37be65', '77ac661d-fc01-44e9-907f-a6970ba72ade'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:48:15 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-86ba2fff-1425-4cb2-b117-2964ccc2dfaa tempest-SnapshotsActionsTest-1390245303 None] Created reservations ['7ecf8ae2-8ef1-48a2-adc8-d658609b617d', 'c70d8cb2-1aae-420e-90a9-7d6e140be744', '35b16a4f-fd46-4a61-8ae2-508a41838886', 'f4c89ca4-587b-4102-bc86-e89b8cfc6251'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:48:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d49e5aeb-8b12-446e-8fab-af3d37348866 tempest-VolumesActionsTest-91619514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:48:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d49e5aeb-8b12-446e-8fab-af3d37348866 tempest-VolumesActionsTest-91619514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:48:15 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-d49e5aeb-8b12-446e-8fab-af3d37348866 tempest-VolumesActionsTest-91619514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:48:15 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-d49e5aeb-8b12-446e-8fab-af3d37348866 tempest-VolumesActionsTest-91619514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:48:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d49e5aeb-8b12-446e-8fab-af3d37348866 tempest-VolumesActionsTest-91619514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:48:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d49e5aeb-8b12-446e-8fab-af3d37348866 tempest-VolumesActionsTest-91619514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:15 devstack sudo[95494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:48:15 devstack sudo[95494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:15 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-86ba2fff-1425-4cb2-b117-2964ccc2dfaa tempest-SnapshotsActionsTest-1390245303 None] Delete snapshot completed successfully.
Nov 06 11:48:15 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-86ba2fff-1425-4cb2-b117-2964ccc2dfaa tempest-SnapshotsActionsTest-1390245303 None] Lock "cinder-e377ddc8-d1b7-4508-bbc0-a53d9b305da3-delete_snapshot" released by "delete_snapshot" :: held 1.738s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:48:16 devstack sudo[95494]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d49e5aeb-8b12-446e-8fab-af3d37348866 tempest-VolumesActionsTest-91619514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.274s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:16 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-d49e5aeb-8b12-446e-8fab-af3d37348866 tempest-VolumesActionsTest-91619514 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:48:16 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-d49e5aeb-8b12-446e-8fab-af3d37348866 tempest-VolumesActionsTest-91619514 None] Deleted volume successfully.
Nov 06 11:48:16 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d49e5aeb-8b12-446e-8fab-af3d37348866 tempest-VolumesActionsTest-91619514 None] Lock "cinder-9e59f972-137b-4071-99dd-bbfb7544eddd-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:48:16 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-50c48539-311b-4a96-aba1-0065c068a4e5 tempest-SnapshotsActionsTest-1390245303 None] Acquiring lock "cinder-c5463bc8-5b06-4d57-a6e0-b87504e71d57-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:48:16 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-50c48539-311b-4a96-aba1-0065c068a4e5 tempest-SnapshotsActionsTest-1390245303 None] Lock "cinder-c5463bc8-5b06-4d57-a6e0-b87504e71d57-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:48:16 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-50c48539-311b-4a96-aba1-0065c068a4e5 tempest-SnapshotsActionsTest-1390245303 None] Acquiring lock "cinder-quobyte-c5463bc8-5b06-4d57-a6e0-b87504e71d57" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:48:16 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-50c48539-311b-4a96-aba1-0065c068a4e5 tempest-SnapshotsActionsTest-1390245303 None] Lock "cinder-quobyte-c5463bc8-5b06-4d57-a6e0-b87504e71d57" acquired by "delete_volume" :: waited 0.016s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:48:16 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1728b64-5b3c-41f9-a2a8-6536682db997]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:48:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-50c48539-311b-4a96-aba1-0065c068a4e5 tempest-SnapshotsActionsTest-1390245303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:16 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3cddcbb-be1e-4638-bc03-0d76800152e0 tempest-VolumesTestJSON-913936664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:48:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d3cddcbb-be1e-4638-bc03-0d76800152e0 tempest-VolumesTestJSON-913936664 None] Flow 'volume_create_manager' (9c63008a-2a38-4acb-aca9-d960639ecb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:48:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d3cddcbb-be1e-4638-bc03-0d76800152e0 tempest-VolumesTestJSON-913936664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (404733e9-e211-44f7-ba25-9ca5331fa9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:48:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d3cddcbb-be1e-4638-bc03-0d76800152e0 tempest-VolumesTestJSON-913936664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (404733e9-e211-44f7-ba25-9ca5331fa9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1642217192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fb285f4-5c50-4194-a92f-34ebff53bd64,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='095feffadbf04fbabe0231a4b57a7653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:48:16Z,use_quota=True,user_id='c85e401b30d84bdda80eb48824eaef9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:48:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d3cddcbb-be1e-4638-bc03-0d76800152e0 tempest-VolumesTestJSON-913936664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19b18537-fd9a-41eb-8a80-f42f3993d3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:48:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d3cddcbb-be1e-4638-bc03-0d76800152e0 tempest-VolumesTestJSON-913936664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19b18537-fd9a-41eb-8a80-f42f3993d3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:48:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d3cddcbb-be1e-4638-bc03-0d76800152e0 tempest-VolumesTestJSON-913936664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ebdb213-6941-4006-b665-b1d65aad2ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:48:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d3cddcbb-be1e-4638-bc03-0d76800152e0 tempest-VolumesTestJSON-913936664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ebdb213-6941-4006-b665-b1d65aad2ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fb285f4-5c50-4194-a92f-34ebff53bd64', 'volume_name': 'volume-7fb285f4-5c50-4194-a92f-34ebff53bd64', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:48:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d3cddcbb-be1e-4638-bc03-0d76800152e0 tempest-VolumesTestJSON-913936664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cfe9672-f788-43c4-9e08-8f9e1d685f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:48:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d3cddcbb-be1e-4638-bc03-0d76800152e0 tempest-VolumesTestJSON-913936664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cfe9672-f788-43c4-9e08-8f9e1d685f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:48:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d3cddcbb-be1e-4638-bc03-0d76800152e0 tempest-VolumesTestJSON-913936664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b2d3965-8e93-4d26-8a74-9601239f3f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:48:16 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-d3cddcbb-be1e-4638-bc03-0d76800152e0 tempest-VolumesTestJSON-913936664 None] Volume 7fb285f4-5c50-4194-a92f-34ebff53bd64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fb285f4-5c50-4194-a92f-34ebff53bd64', 'volume_size': 1}
Nov 06 11:48:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d3cddcbb-be1e-4638-bc03-0d76800152e0 tempest-VolumesTestJSON-913936664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:48:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d3cddcbb-be1e-4638-bc03-0d76800152e0 tempest-VolumesTestJSON-913936664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:48:16 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-d3cddcbb-be1e-4638-bc03-0d76800152e0 tempest-VolumesTestJSON-913936664 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1642217192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fb285f4-5c50-4194-a92f-34ebff53bd64,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='095feffadbf04fbabe0231a4b57a7653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:48:16Z,use_quota=True,user_id='c85e401b30d84bdda80eb48824eaef9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:48:16 devstack sudo[95498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57
Nov 06 11:48:16 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-d3cddcbb-be1e-4638-bc03-0d76800152e0 tempest-VolumesTestJSON-913936664 None] Creating volume 7fb285f4-5c50-4194-a92f-34ebff53bd64 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:48:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d3cddcbb-be1e-4638-bc03-0d76800152e0 tempest-VolumesTestJSON-913936664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:48:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d3cddcbb-be1e-4638-bc03-0d76800152e0 tempest-VolumesTestJSON-913936664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:48:16 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-d3cddcbb-be1e-4638-bc03-0d76800152e0 tempest-VolumesTestJSON-913936664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:48:16 devstack sudo[95498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:16 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-d3cddcbb-be1e-4638-bc03-0d76800152e0 tempest-VolumesTestJSON-913936664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:48:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d3cddcbb-be1e-4638-bc03-0d76800152e0 tempest-VolumesTestJSON-913936664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:48:16 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-d3cddcbb-be1e-4638-bc03-0d76800152e0 tempest-VolumesTestJSON-913936664 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:48:16 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-d3cddcbb-be1e-4638-bc03-0d76800152e0 tempest-VolumesTestJSON-913936664 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:48:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d3cddcbb-be1e-4638-bc03-0d76800152e0 tempest-VolumesTestJSON-913936664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fb285f4-5c50-4194-a92f-34ebff53bd64 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:16 devstack sudo[95500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fb285f4-5c50-4194-a92f-34ebff53bd64 1073741824
Nov 06 11:48:16 devstack sudo[95500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:16 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-72ab0830-c57b-442c-8d67-379a3bbd4475 tempest-VolumesActionsTest-1055323903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:48:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-72ab0830-c57b-442c-8d67-379a3bbd4475 tempest-VolumesActionsTest-1055323903 None] Flow 'volume_create_manager' (15dfc409-dafe-4801-9b6f-4034d0eb4efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:48:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-72ab0830-c57b-442c-8d67-379a3bbd4475 tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccf30567-ff04-4c54-b172-6c4269cd5b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:48:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-72ab0830-c57b-442c-8d67-379a3bbd4475 tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccf30567-ff04-4c54-b172-6c4269cd5b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1777278715',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09b29c3e-029a-4932-be73-854dcf7d6019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e6f4e7600b74f8b9535d1386f3293dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:48:17Z,use_quota=True,user_id='ca8eaa9458014727befdf4ac0442c690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:48:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-72ab0830-c57b-442c-8d67-379a3bbd4475 tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (364143bc-2486-4629-9793-3f75647a24d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:48:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-72ab0830-c57b-442c-8d67-379a3bbd4475 tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (364143bc-2486-4629-9793-3f75647a24d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:48:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-72ab0830-c57b-442c-8d67-379a3bbd4475 tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c561abd-b7cb-4987-8f1a-35e0cec201c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:48:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-72ab0830-c57b-442c-8d67-379a3bbd4475 tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c561abd-b7cb-4987-8f1a-35e0cec201c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09b29c3e-029a-4932-be73-854dcf7d6019', 'volume_name': 'volume-09b29c3e-029a-4932-be73-854dcf7d6019', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:48:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-72ab0830-c57b-442c-8d67-379a3bbd4475 tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aa02dd4-35a6-4085-9d14-dfb0f5f5c2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:48:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-72ab0830-c57b-442c-8d67-379a3bbd4475 tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aa02dd4-35a6-4085-9d14-dfb0f5f5c2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:48:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-72ab0830-c57b-442c-8d67-379a3bbd4475 tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67ed94fb-a099-4e9e-875e-a7b517088a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:48:16 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-72ab0830-c57b-442c-8d67-379a3bbd4475 tempest-VolumesActionsTest-1055323903 None] Volume 09b29c3e-029a-4932-be73-854dcf7d6019: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09b29c3e-029a-4932-be73-854dcf7d6019', 'volume_size': 1}
Nov 06 11:48:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-72ab0830-c57b-442c-8d67-379a3bbd4475 tempest-VolumesActionsTest-1055323903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:48:16 devstack sudo[95498]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-50c48539-311b-4a96-aba1-0065c068a4e5 tempest-SnapshotsActionsTest-1390245303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57" returned: 0 in 0.375s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-50c48539-311b-4a96-aba1-0065c068a4e5 tempest-SnapshotsActionsTest-1390245303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:16 devstack sudo[95508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57
Nov 06 11:48:16 devstack sudo[95508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:17 devstack sudo[95500]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d3cddcbb-be1e-4638-bc03-0d76800152e0 tempest-VolumesTestJSON-913936664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fb285f4-5c50-4194-a92f-34ebff53bd64 1073741824" returned: 0 in 0.456s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:17 devstack cinder-volume[87165]: DEBUG oslo_service.periodic_task [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 11:48:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:48:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:48:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:48:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:48:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:48:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:17 devstack sudo[95512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:48:17 devstack sudo[95508]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:17 devstack sudo[95512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-50c48539-311b-4a96-aba1-0065c068a4e5 tempest-SnapshotsActionsTest-1390245303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c5463bc8-5b06-4d57-a6e0-b87504e71d57" returned: 0 in 0.258s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:17 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-50c48539-311b-4a96-aba1-0065c068a4e5 tempest-SnapshotsActionsTest-1390245303 None] Lock "cinder-quobyte-c5463bc8-5b06-4d57-a6e0-b87504e71d57" released by "delete_volume" :: held 0.709s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:48:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d3cddcbb-be1e-4638-bc03-0d76800152e0 tempest-VolumesTestJSON-913936664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fb285f4-5c50-4194-a92f-34ebff53bd64 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:17 devstack sudo[95514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fb285f4-5c50-4194-a92f-34ebff53bd64
Nov 06 11:48:17 devstack sudo[95514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:17 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-50c48539-311b-4a96-aba1-0065c068a4e5 tempest-SnapshotsActionsTest-1390245303 None] Created reservations ['aded8b23-fd48-4de9-860e-a8f01f92f380', '17bc041f-90d1-495e-874a-546d6dde93cb', 'a7fa818c-6733-43e1-b4f7-90511461938f', '35d4b912-9a42-4448-af2e-5f490f76504e'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:48:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-50c48539-311b-4a96-aba1-0065c068a4e5 tempest-SnapshotsActionsTest-1390245303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:48:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-50c48539-311b-4a96-aba1-0065c068a4e5 tempest-SnapshotsActionsTest-1390245303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:48:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-50c48539-311b-4a96-aba1-0065c068a4e5 tempest-SnapshotsActionsTest-1390245303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:48:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-50c48539-311b-4a96-aba1-0065c068a4e5 tempest-SnapshotsActionsTest-1390245303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:48:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-50c48539-311b-4a96-aba1-0065c068a4e5 tempest-SnapshotsActionsTest-1390245303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:48:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-50c48539-311b-4a96-aba1-0065c068a4e5 tempest-SnapshotsActionsTest-1390245303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:17 devstack sudo[95517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:48:17 devstack sudo[95517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:17 devstack sudo[95512]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.274s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:17 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:48:17 devstack cinder-volume[87165]: DEBUG oslo_service.periodic_task [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running periodic task VolumeManager._thread_info {{(pid=87165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 11:48:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] thread count: 28 {{(pid=87165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 11:48:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] thread info: [<_MainThread(MainThread, started 127732956901504)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127732842693056)>, <Thread(Thread-3 (stat_writer), started daemon 127732841891136)>, <Thread(Rabbit-heartbeat, started daemon 127732842515648)>, <Thread(Thread-5 (_runner), started daemon 127732840534464)>, <Thread(Thread-7 (_runner), started daemon 127732840636032)>, <Thread(fd_logger, started daemon 127732838664256)>, <Thread(privsep_reader, started daemon 127732838673408)>, <Thread(tpool_thread_0, started daemon 127732829828800)>, <Thread(tpool_thread_1, started daemon 127732821436096)>, <Thread(tpool_thread_2, started daemon 127732813043392)>, <Thread(tpool_thread_3, started daemon 127732804650688)>, <Thread(tpool_thread_4, started daemon 127732796257984)>, <Thread(tpool_thread_5, started daemon 127732787865280)>, <Thread(tpool_thread_6, started daemon 127732779456192)>, <Thread(tpool_thread_7, started daemon 127732771047104)>, <Thread(tpool_thread_8, started daemon 127732762638016)>, <Thread(tpool_thread_9, started daemon 127732754228928)>, <Thread(tpool_thread_10, started daemon 127732745819840)>, <Thread(tpool_thread_11, started daemon 127732737410752)>, <Thread(tpool_thread_12, started daemon 127732729001664)>, <Thread(tpool_thread_13, started daemon 127732720592576)>, <Thread(tpool_thread_14, started daemon 127732712183488)>, <Thread(tpool_thread_15, started daemon 127732703774400)>, <Thread(tpool_thread_16, started daemon 127732695365312)>, <Thread(tpool_thread_17, started daemon 127732686956224)>, <Thread(tpool_thread_18, started daemon 127732678547136)>, <Thread(tpool_thread_19, started daemon 127732670138048)>] {{(pid=87165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 11:48:17 devstack sudo[95514]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d3cddcbb-be1e-4638-bc03-0d76800152e0 tempest-VolumesTestJSON-913936664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fb285f4-5c50-4194-a92f-34ebff53bd64" returned: 0 in 0.327s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-d3cddcbb-be1e-4638-bc03-0d76800152e0 tempest-VolumesTestJSON-913936664 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:48:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d3cddcbb-be1e-4638-bc03-0d76800152e0 tempest-VolumesTestJSON-913936664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:48:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-72ab0830-c57b-442c-8d67-379a3bbd4475 tempest-VolumesActionsTest-1055323903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.743s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:48:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-72ab0830-c57b-442c-8d67-379a3bbd4475 tempest-VolumesActionsTest-1055323903 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1777278715',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09b29c3e-029a-4932-be73-854dcf7d6019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e6f4e7600b74f8b9535d1386f3293dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:48:17Z,use_quota=True,user_id='ca8eaa9458014727befdf4ac0442c690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:48:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-72ab0830-c57b-442c-8d67-379a3bbd4475 tempest-VolumesActionsTest-1055323903 None] Creating volume 09b29c3e-029a-4932-be73-854dcf7d6019 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:48:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-72ab0830-c57b-442c-8d67-379a3bbd4475 tempest-VolumesActionsTest-1055323903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:48:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-72ab0830-c57b-442c-8d67-379a3bbd4475 tempest-VolumesActionsTest-1055323903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:48:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-72ab0830-c57b-442c-8d67-379a3bbd4475 tempest-VolumesActionsTest-1055323903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:48:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-72ab0830-c57b-442c-8d67-379a3bbd4475 tempest-VolumesActionsTest-1055323903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:48:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-72ab0830-c57b-442c-8d67-379a3bbd4475 tempest-VolumesActionsTest-1055323903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:48:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-72ab0830-c57b-442c-8d67-379a3bbd4475 tempest-VolumesActionsTest-1055323903 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:48:17 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-72ab0830-c57b-442c-8d67-379a3bbd4475 tempest-VolumesActionsTest-1055323903 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:48:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-72ab0830-c57b-442c-8d67-379a3bbd4475 tempest-VolumesActionsTest-1055323903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-09b29c3e-029a-4932-be73-854dcf7d6019 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:17 devstack sudo[95520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-09b29c3e-029a-4932-be73-854dcf7d6019 1073741824
Nov 06 11:48:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d3cddcbb-be1e-4638-bc03-0d76800152e0 tempest-VolumesTestJSON-913936664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b2d3965-8e93-4d26-8a74-9601239f3f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fb285f4-5c50-4194-a92f-34ebff53bd64', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:48:17 devstack sudo[95520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d3cddcbb-be1e-4638-bc03-0d76800152e0 tempest-VolumesTestJSON-913936664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d12f3f7-1303-4d15-8dcb-89a6714dcb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:48:17 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-d3cddcbb-be1e-4638-bc03-0d76800152e0 tempest-VolumesTestJSON-913936664 None] Volume volume-7fb285f4-5c50-4194-a92f-34ebff53bd64 (7fb285f4-5c50-4194-a92f-34ebff53bd64): created successfully
Nov 06 11:48:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d3cddcbb-be1e-4638-bc03-0d76800152e0 tempest-VolumesTestJSON-913936664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d12f3f7-1303-4d15-8dcb-89a6714dcb02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:48:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d3cddcbb-be1e-4638-bc03-0d76800152e0 tempest-VolumesTestJSON-913936664 None] Flow 'volume_create_manager' (9c63008a-2a38-4acb-aca9-d960639ecb42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:48:17 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-d3cddcbb-be1e-4638-bc03-0d76800152e0 tempest-VolumesTestJSON-913936664 None] Created volume successfully.
Nov 06 11:48:17 devstack sudo[95517]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-50c48539-311b-4a96-aba1-0065c068a4e5 tempest-SnapshotsActionsTest-1390245303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.320s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:17 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-50c48539-311b-4a96-aba1-0065c068a4e5 tempest-SnapshotsActionsTest-1390245303 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:48:17 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-50c48539-311b-4a96-aba1-0065c068a4e5 tempest-SnapshotsActionsTest-1390245303 None] Deleted volume successfully.
Nov 06 11:48:17 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-50c48539-311b-4a96-aba1-0065c068a4e5 tempest-SnapshotsActionsTest-1390245303 None] Lock "cinder-c5463bc8-5b06-4d57-a6e0-b87504e71d57-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:48:18 devstack sudo[95520]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-72ab0830-c57b-442c-8d67-379a3bbd4475 tempest-VolumesActionsTest-1055323903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-09b29c3e-029a-4932-be73-854dcf7d6019 1073741824" returned: 0 in 0.518s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-72ab0830-c57b-442c-8d67-379a3bbd4475 tempest-VolumesActionsTest-1055323903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-09b29c3e-029a-4932-be73-854dcf7d6019 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:18 devstack sudo[95527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-09b29c3e-029a-4932-be73-854dcf7d6019
Nov 06 11:48:18 devstack sudo[95527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:18 devstack sudo[95527]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-72ab0830-c57b-442c-8d67-379a3bbd4475 tempest-VolumesActionsTest-1055323903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-09b29c3e-029a-4932-be73-854dcf7d6019" returned: 0 in 0.288s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:18 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-72ab0830-c57b-442c-8d67-379a3bbd4475 tempest-VolumesActionsTest-1055323903 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:48:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-72ab0830-c57b-442c-8d67-379a3bbd4475 tempest-VolumesActionsTest-1055323903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:48:18 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-72ab0830-c57b-442c-8d67-379a3bbd4475 tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67ed94fb-a099-4e9e-875e-a7b517088a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09b29c3e-029a-4932-be73-854dcf7d6019', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:48:18 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-72ab0830-c57b-442c-8d67-379a3bbd4475 tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21c02c6f-3adb-4f94-8a10-6490c8018b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:48:18 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-72ab0830-c57b-442c-8d67-379a3bbd4475 tempest-VolumesActionsTest-1055323903 None] Volume volume-09b29c3e-029a-4932-be73-854dcf7d6019 (09b29c3e-029a-4932-be73-854dcf7d6019): created successfully
Nov 06 11:48:18 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-72ab0830-c57b-442c-8d67-379a3bbd4475 tempest-VolumesActionsTest-1055323903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21c02c6f-3adb-4f94-8a10-6490c8018b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:48:18 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-72ab0830-c57b-442c-8d67-379a3bbd4475 tempest-VolumesActionsTest-1055323903 None] Flow 'volume_create_manager' (15dfc409-dafe-4801-9b6f-4034d0eb4efe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:48:18 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-72ab0830-c57b-442c-8d67-379a3bbd4475 tempest-VolumesActionsTest-1055323903 None] Created volume successfully.
Nov 06 11:48:19 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-a17a60bb-46eb-4c08-bade-b410d61d5bad tempest-VolumesTestJSON-913936664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:48:19 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a17a60bb-46eb-4c08-bade-b410d61d5bad tempest-VolumesTestJSON-913936664 None] Flow 'volume_create_manager' (947d5f62-9db5-4cb8-9aa9-f92ee15f9ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:48:19 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a17a60bb-46eb-4c08-bade-b410d61d5bad tempest-VolumesTestJSON-913936664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30422011-99e2-49cf-94b1-a2524f993d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:48:19 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a17a60bb-46eb-4c08-bade-b410d61d5bad tempest-VolumesTestJSON-913936664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30422011-99e2-49cf-94b1-a2524f993d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:48:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1415332760',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0c27f26-9f07-40c8-af72-78e8a604a907,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='095feffadbf04fbabe0231a4b57a7653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:48:19Z,use_quota=True,user_id='c85e401b30d84bdda80eb48824eaef9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:48:19 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a17a60bb-46eb-4c08-bade-b410d61d5bad tempest-VolumesTestJSON-913936664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fffa7c07-25c1-4aef-8c11-2c2c3b7d96a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:48:19 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a17a60bb-46eb-4c08-bade-b410d61d5bad tempest-VolumesTestJSON-913936664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fffa7c07-25c1-4aef-8c11-2c2c3b7d96a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:48:19 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a17a60bb-46eb-4c08-bade-b410d61d5bad tempest-VolumesTestJSON-913936664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (737311ad-0a18-4eee-8ffb-26ab73547e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:48:19 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a17a60bb-46eb-4c08-bade-b410d61d5bad tempest-VolumesTestJSON-913936664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (737311ad-0a18-4eee-8ffb-26ab73547e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0c27f26-9f07-40c8-af72-78e8a604a907', 'volume_name': 'volume-e0c27f26-9f07-40c8-af72-78e8a604a907', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:48:19 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a17a60bb-46eb-4c08-bade-b410d61d5bad tempest-VolumesTestJSON-913936664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e18668e-99a8-45b1-898b-434e36d54abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:48:19 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a17a60bb-46eb-4c08-bade-b410d61d5bad tempest-VolumesTestJSON-913936664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e18668e-99a8-45b1-898b-434e36d54abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:48:19 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a17a60bb-46eb-4c08-bade-b410d61d5bad tempest-VolumesTestJSON-913936664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89939442-aa5e-45f5-b865-8b788e1f750b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:48:19 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-a17a60bb-46eb-4c08-bade-b410d61d5bad tempest-VolumesTestJSON-913936664 None] Volume e0c27f26-9f07-40c8-af72-78e8a604a907: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0c27f26-9f07-40c8-af72-78e8a604a907', 'volume_size': 1}
Nov 06 11:48:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a17a60bb-46eb-4c08-bade-b410d61d5bad tempest-VolumesTestJSON-913936664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:48:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a17a60bb-46eb-4c08-bade-b410d61d5bad tempest-VolumesTestJSON-913936664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:48:19 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a17a60bb-46eb-4c08-bade-b410d61d5bad tempest-VolumesTestJSON-913936664 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:48:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1415332760',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0c27f26-9f07-40c8-af72-78e8a604a907,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='095feffadbf04fbabe0231a4b57a7653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:48:19Z,use_quota=True,user_id='c85e401b30d84bdda80eb48824eaef9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:48:19 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-a17a60bb-46eb-4c08-bade-b410d61d5bad tempest-VolumesTestJSON-913936664 None] Creating volume e0c27f26-9f07-40c8-af72-78e8a604a907 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:48:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a17a60bb-46eb-4c08-bade-b410d61d5bad tempest-VolumesTestJSON-913936664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:48:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a17a60bb-46eb-4c08-bade-b410d61d5bad tempest-VolumesTestJSON-913936664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:48:19 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a17a60bb-46eb-4c08-bade-b410d61d5bad tempest-VolumesTestJSON-913936664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:48:19 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a17a60bb-46eb-4c08-bade-b410d61d5bad tempest-VolumesTestJSON-913936664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:48:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a17a60bb-46eb-4c08-bade-b410d61d5bad tempest-VolumesTestJSON-913936664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:48:19 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a17a60bb-46eb-4c08-bade-b410d61d5bad tempest-VolumesTestJSON-913936664 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:48:19 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-a17a60bb-46eb-4c08-bade-b410d61d5bad tempest-VolumesTestJSON-913936664 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:48:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a17a60bb-46eb-4c08-bade-b410d61d5bad tempest-VolumesTestJSON-913936664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e0c27f26-9f07-40c8-af72-78e8a604a907 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:19 devstack sudo[95530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e0c27f26-9f07-40c8-af72-78e8a604a907 1073741824
Nov 06 11:48:19 devstack sudo[95530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:19 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-bba7496b-aa17-42ea-b73e-5ca7f8ca174c tempest-VolumesActionsTest-1055323903 None] Acquiring lock "cinder-09b29c3e-029a-4932-be73-854dcf7d6019-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:48:19 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-bba7496b-aa17-42ea-b73e-5ca7f8ca174c tempest-VolumesActionsTest-1055323903 None] Lock "cinder-09b29c3e-029a-4932-be73-854dcf7d6019-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:48:19 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-bba7496b-aa17-42ea-b73e-5ca7f8ca174c tempest-VolumesActionsTest-1055323903 None] Acquiring lock "cinder-quobyte-09b29c3e-029a-4932-be73-854dcf7d6019" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:48:19 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-bba7496b-aa17-42ea-b73e-5ca7f8ca174c tempest-VolumesActionsTest-1055323903 None] Lock "cinder-quobyte-09b29c3e-029a-4932-be73-854dcf7d6019" acquired by "delete_volume" :: waited 0.023s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:48:19 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[919714a5-cdcb-4b27-a132-17a5baa0452a]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:48:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bba7496b-aa17-42ea-b73e-5ca7f8ca174c tempest-VolumesActionsTest-1055323903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-09b29c3e-029a-4932-be73-854dcf7d6019 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:19 devstack sudo[95535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-09b29c3e-029a-4932-be73-854dcf7d6019
Nov 06 11:48:19 devstack sudo[95535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:20 devstack sudo[95530]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a17a60bb-46eb-4c08-bade-b410d61d5bad tempest-VolumesTestJSON-913936664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e0c27f26-9f07-40c8-af72-78e8a604a907 1073741824" returned: 0 in 0.630s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a17a60bb-46eb-4c08-bade-b410d61d5bad tempest-VolumesTestJSON-913936664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e0c27f26-9f07-40c8-af72-78e8a604a907 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:20 devstack sudo[95546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e0c27f26-9f07-40c8-af72-78e8a604a907
Nov 06 11:48:20 devstack sudo[95546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:20 devstack sudo[95535]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bba7496b-aa17-42ea-b73e-5ca7f8ca174c tempest-VolumesActionsTest-1055323903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-09b29c3e-029a-4932-be73-854dcf7d6019" returned: 0 in 0.492s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bba7496b-aa17-42ea-b73e-5ca7f8ca174c tempest-VolumesActionsTest-1055323903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-09b29c3e-029a-4932-be73-854dcf7d6019 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:20 devstack sudo[95551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-09b29c3e-029a-4932-be73-854dcf7d6019
Nov 06 11:48:20 devstack sudo[95551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:20 devstack sudo[95546]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a17a60bb-46eb-4c08-bade-b410d61d5bad tempest-VolumesTestJSON-913936664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e0c27f26-9f07-40c8-af72-78e8a604a907" returned: 0 in 0.353s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:20 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a17a60bb-46eb-4c08-bade-b410d61d5bad tempest-VolumesTestJSON-913936664 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:48:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a17a60bb-46eb-4c08-bade-b410d61d5bad tempest-VolumesTestJSON-913936664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:48:20 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a17a60bb-46eb-4c08-bade-b410d61d5bad tempest-VolumesTestJSON-913936664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89939442-aa5e-45f5-b865-8b788e1f750b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0c27f26-9f07-40c8-af72-78e8a604a907', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:48:20 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a17a60bb-46eb-4c08-bade-b410d61d5bad tempest-VolumesTestJSON-913936664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad875105-f201-463d-84fb-f9eee9f52e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:48:20 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-a17a60bb-46eb-4c08-bade-b410d61d5bad tempest-VolumesTestJSON-913936664 None] Volume volume-e0c27f26-9f07-40c8-af72-78e8a604a907 (e0c27f26-9f07-40c8-af72-78e8a604a907): created successfully
Nov 06 11:48:20 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a17a60bb-46eb-4c08-bade-b410d61d5bad tempest-VolumesTestJSON-913936664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad875105-f201-463d-84fb-f9eee9f52e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:48:20 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a17a60bb-46eb-4c08-bade-b410d61d5bad tempest-VolumesTestJSON-913936664 None] Flow 'volume_create_manager' (947d5f62-9db5-4cb8-9aa9-f92ee15f9ebd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:48:20 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-a17a60bb-46eb-4c08-bade-b410d61d5bad tempest-VolumesTestJSON-913936664 None] Created volume successfully.
Nov 06 11:48:20 devstack sudo[95551]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bba7496b-aa17-42ea-b73e-5ca7f8ca174c tempest-VolumesActionsTest-1055323903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-09b29c3e-029a-4932-be73-854dcf7d6019" returned: 0 in 0.311s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:20 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-bba7496b-aa17-42ea-b73e-5ca7f8ca174c tempest-VolumesActionsTest-1055323903 None] Lock "cinder-quobyte-09b29c3e-029a-4932-be73-854dcf7d6019" released by "delete_volume" :: held 0.860s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:48:20 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-bba7496b-aa17-42ea-b73e-5ca7f8ca174c tempest-VolumesActionsTest-1055323903 None] Created reservations ['36dd3564-9305-49a5-8a85-1d5b259ca1b5', 'ee46ea7d-328a-457a-885d-3e5e2bf07562', '3e1bc47d-12c6-4f27-90ce-93503b24c9cc', '59f53c6d-84d4-4962-a59b-34ede764e20c'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:48:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-bba7496b-aa17-42ea-b73e-5ca7f8ca174c tempest-VolumesActionsTest-1055323903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:48:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-bba7496b-aa17-42ea-b73e-5ca7f8ca174c tempest-VolumesActionsTest-1055323903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:48:20 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-bba7496b-aa17-42ea-b73e-5ca7f8ca174c tempest-VolumesActionsTest-1055323903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:48:20 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-bba7496b-aa17-42ea-b73e-5ca7f8ca174c tempest-VolumesActionsTest-1055323903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:48:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-bba7496b-aa17-42ea-b73e-5ca7f8ca174c tempest-VolumesActionsTest-1055323903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:48:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bba7496b-aa17-42ea-b73e-5ca7f8ca174c tempest-VolumesActionsTest-1055323903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:20 devstack sudo[95555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:48:20 devstack sudo[95555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:21 devstack sudo[95555]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bba7496b-aa17-42ea-b73e-5ca7f8ca174c tempest-VolumesActionsTest-1055323903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.338s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:21 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-bba7496b-aa17-42ea-b73e-5ca7f8ca174c tempest-VolumesActionsTest-1055323903 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:48:21 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-bba7496b-aa17-42ea-b73e-5ca7f8ca174c tempest-VolumesActionsTest-1055323903 None] Deleted volume successfully.
Nov 06 11:48:21 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-bba7496b-aa17-42ea-b73e-5ca7f8ca174c tempest-VolumesActionsTest-1055323903 None] Lock "cinder-09b29c3e-029a-4932-be73-854dcf7d6019-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:48:22 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a0361c6d-c6aa-4b6a-a733-9321f3ca44e7 tempest-VolumesTestJSON-913936664 None] Acquiring lock "cinder-e0c27f26-9f07-40c8-af72-78e8a604a907-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:48:22 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a0361c6d-c6aa-4b6a-a733-9321f3ca44e7 tempest-VolumesTestJSON-913936664 None] Lock "cinder-e0c27f26-9f07-40c8-af72-78e8a604a907-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:48:22 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a0361c6d-c6aa-4b6a-a733-9321f3ca44e7 tempest-VolumesTestJSON-913936664 None] Acquiring lock "cinder-quobyte-e0c27f26-9f07-40c8-af72-78e8a604a907" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:48:23 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a0361c6d-c6aa-4b6a-a733-9321f3ca44e7 tempest-VolumesTestJSON-913936664 None] Lock "cinder-quobyte-e0c27f26-9f07-40c8-af72-78e8a604a907" acquired by "delete_volume" :: waited 0.023s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:48:23 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b5571b-2187-403a-b3f3-f9c6560b9d6b]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:48:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a0361c6d-c6aa-4b6a-a733-9321f3ca44e7 tempest-VolumesTestJSON-913936664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e0c27f26-9f07-40c8-af72-78e8a604a907 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:23 devstack sudo[95586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e0c27f26-9f07-40c8-af72-78e8a604a907
Nov 06 11:48:23 devstack sudo[95586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:23 devstack sudo[95586]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a0361c6d-c6aa-4b6a-a733-9321f3ca44e7 tempest-VolumesTestJSON-913936664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e0c27f26-9f07-40c8-af72-78e8a604a907" returned: 0 in 0.458s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a0361c6d-c6aa-4b6a-a733-9321f3ca44e7 tempest-VolumesTestJSON-913936664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e0c27f26-9f07-40c8-af72-78e8a604a907 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:23 devstack sudo[95591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e0c27f26-9f07-40c8-af72-78e8a604a907
Nov 06 11:48:23 devstack sudo[95591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:23 devstack sudo[95591]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a0361c6d-c6aa-4b6a-a733-9321f3ca44e7 tempest-VolumesTestJSON-913936664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e0c27f26-9f07-40c8-af72-78e8a604a907" returned: 0 in 0.434s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:23 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a0361c6d-c6aa-4b6a-a733-9321f3ca44e7 tempest-VolumesTestJSON-913936664 None] Lock "cinder-quobyte-e0c27f26-9f07-40c8-af72-78e8a604a907" released by "delete_volume" :: held 0.960s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:48:24 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-a0361c6d-c6aa-4b6a-a733-9321f3ca44e7 tempest-VolumesTestJSON-913936664 None] Created reservations ['6d9dafbb-b039-43bd-b5ad-08915ac659d9', 'd46c3711-256b-4218-9456-554cebfad854', '92db0ccc-d0e0-4839-9d11-524973589aeb', 'c86becdd-80bc-4b7d-9f48-d3030966053d'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:48:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a0361c6d-c6aa-4b6a-a733-9321f3ca44e7 tempest-VolumesTestJSON-913936664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:48:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a0361c6d-c6aa-4b6a-a733-9321f3ca44e7 tempest-VolumesTestJSON-913936664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:48:24 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a0361c6d-c6aa-4b6a-a733-9321f3ca44e7 tempest-VolumesTestJSON-913936664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:48:24 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a0361c6d-c6aa-4b6a-a733-9321f3ca44e7 tempest-VolumesTestJSON-913936664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:48:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a0361c6d-c6aa-4b6a-a733-9321f3ca44e7 tempest-VolumesTestJSON-913936664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:48:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a0361c6d-c6aa-4b6a-a733-9321f3ca44e7 tempest-VolumesTestJSON-913936664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:24 devstack sudo[95597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:48:24 devstack sudo[95597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:24 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-a1357792-aaff-4317-81c2-663d3f05a7f2 req-9e869982-342b-4428-9fc9-9d906c3bb24d tempest-ServerActionsTestOtherA-2004102178 None] Terminate volume connection completed successfully.
Nov 06 11:48:24 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-a1357792-aaff-4317-81c2-663d3f05a7f2 req-9e869982-342b-4428-9fc9-9d906c3bb24d tempest-ServerActionsTestOtherA-2004102178 None] Deleting attachment ddfbdec7-6290-416a-98eb-f5092ea791d8. {{(pid=87165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 11:48:24 devstack sudo[95597]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a0361c6d-c6aa-4b6a-a733-9321f3ca44e7 tempest-VolumesTestJSON-913936664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.382s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:24 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-a0361c6d-c6aa-4b6a-a733-9321f3ca44e7 tempest-VolumesTestJSON-913936664 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:48:24 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-a0361c6d-c6aa-4b6a-a733-9321f3ca44e7 tempest-VolumesTestJSON-913936664 None] Deleted volume successfully.
Nov 06 11:48:24 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a0361c6d-c6aa-4b6a-a733-9321f3ca44e7 tempest-VolumesTestJSON-913936664 None] Lock "cinder-e0c27f26-9f07-40c8-af72-78e8a604a907-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:48:24 devstack cinder-volume[87165]: DEBUG cinder.coordination [req-a1357792-aaff-4317-81c2-663d3f05a7f2 req-69aaa378-e9b9-4856-829e-c09637f6cf1e tempest-ServerActionsTestOtherA-2004102178 None] Acquiring lock "cinder-a9513919-b7c8-4a94-a4c5-7077cd93ac75-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:48:24 devstack cinder-volume[87165]: DEBUG cinder.coordination [req-a1357792-aaff-4317-81c2-663d3f05a7f2 req-69aaa378-e9b9-4856-829e-c09637f6cf1e tempest-ServerActionsTestOtherA-2004102178 None] Lock "cinder-a9513919-b7c8-4a94-a4c5-7077cd93ac75-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:48:24 devstack cinder-volume[87165]: DEBUG cinder.coordination [req-a1357792-aaff-4317-81c2-663d3f05a7f2 req-69aaa378-e9b9-4856-829e-c09637f6cf1e tempest-ServerActionsTestOtherA-2004102178 None] Acquiring lock "cinder-quobyte-a9513919-b7c8-4a94-a4c5-7077cd93ac75" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:48:24 devstack cinder-volume[87165]: DEBUG cinder.coordination [req-a1357792-aaff-4317-81c2-663d3f05a7f2 req-69aaa378-e9b9-4856-829e-c09637f6cf1e tempest-ServerActionsTestOtherA-2004102178 None] Lock "cinder-quobyte-a9513919-b7c8-4a94-a4c5-7077cd93ac75" acquired by "delete_volume" :: waited 0.023s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:48:24 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf12e693-432f-4c63-87b4-c9b0b66ff774]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:48:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-a1357792-aaff-4317-81c2-663d3f05a7f2 req-69aaa378-e9b9-4856-829e-c09637f6cf1e tempest-ServerActionsTestOtherA-2004102178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a9513919-b7c8-4a94-a4c5-7077cd93ac75 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:25 devstack sudo[95602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a9513919-b7c8-4a94-a4c5-7077cd93ac75
Nov 06 11:48:25 devstack sudo[95602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:25 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ecdfb810-3df9-415d-855e-4c082cc88650 tempest-VolumesTestJSON-913936664 None] Acquiring lock "cinder-7fb285f4-5c50-4194-a92f-34ebff53bd64-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:48:25 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ecdfb810-3df9-415d-855e-4c082cc88650 tempest-VolumesTestJSON-913936664 None] Lock "cinder-7fb285f4-5c50-4194-a92f-34ebff53bd64-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:48:25 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ecdfb810-3df9-415d-855e-4c082cc88650 tempest-VolumesTestJSON-913936664 None] Acquiring lock "cinder-quobyte-7fb285f4-5c50-4194-a92f-34ebff53bd64" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:48:25 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ecdfb810-3df9-415d-855e-4c082cc88650 tempest-VolumesTestJSON-913936664 None] Lock "cinder-quobyte-7fb285f4-5c50-4194-a92f-34ebff53bd64" acquired by "delete_volume" :: waited 0.029s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:48:25 devstack sudo[95602]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-a1357792-aaff-4317-81c2-663d3f05a7f2 req-69aaa378-e9b9-4856-829e-c09637f6cf1e tempest-ServerActionsTestOtherA-2004102178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a9513919-b7c8-4a94-a4c5-7077cd93ac75" returned: 0 in 0.529s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-a1357792-aaff-4317-81c2-663d3f05a7f2 req-69aaa378-e9b9-4856-829e-c09637f6cf1e tempest-ServerActionsTestOtherA-2004102178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a9513919-b7c8-4a94-a4c5-7077cd93ac75 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:25 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ad0b92-8dfd-4e0c-9af7-96ec8e419110]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:48:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ecdfb810-3df9-415d-855e-4c082cc88650 tempest-VolumesTestJSON-913936664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fb285f4-5c50-4194-a92f-34ebff53bd64 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:25 devstack sudo[95607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a9513919-b7c8-4a94-a4c5-7077cd93ac75
Nov 06 11:48:25 devstack sudo[95607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:25 devstack sudo[95608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fb285f4-5c50-4194-a92f-34ebff53bd64
Nov 06 11:48:25 devstack sudo[95608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:25 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-3587f05d-9809-4309-8f56-e9082d65b621 tempest-ServerActionsTestOtherA-2004102178 None] Acquiring lock "cinder-09ad69a1-794b-4284-9835-05c87ec3c45d-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:48:25 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-3587f05d-9809-4309-8f56-e9082d65b621 tempest-ServerActionsTestOtherA-2004102178 None] Lock "cinder-09ad69a1-794b-4284-9835-05c87ec3c45d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:48:25 devstack sudo[95607]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-a1357792-aaff-4317-81c2-663d3f05a7f2 req-69aaa378-e9b9-4856-829e-c09637f6cf1e tempest-ServerActionsTestOtherA-2004102178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a9513919-b7c8-4a94-a4c5-7077cd93ac75" returned: 0 in 0.459s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:25 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-3587f05d-9809-4309-8f56-e9082d65b621 tempest-ServerActionsTestOtherA-2004102178 None] Acquiring lock "cinder-quobyte-09ad69a1-794b-4284-9835-05c87ec3c45d" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:48:25 devstack cinder-volume[87165]: DEBUG cinder.coordination [req-a1357792-aaff-4317-81c2-663d3f05a7f2 req-69aaa378-e9b9-4856-829e-c09637f6cf1e tempest-ServerActionsTestOtherA-2004102178 None] Lock "cinder-quobyte-a9513919-b7c8-4a94-a4c5-7077cd93ac75" released by "delete_volume" :: held 1.075s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:48:25 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-3587f05d-9809-4309-8f56-e9082d65b621 tempest-ServerActionsTestOtherA-2004102178 None] Lock "cinder-quobyte-09ad69a1-794b-4284-9835-05c87ec3c45d" acquired by "delete_volume" :: waited 0.023s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:48:25 devstack sudo[95608]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:25 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7bfda77-56f8-4a1f-a747-8fbaf95bfe35]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:48:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3587f05d-9809-4309-8f56-e9082d65b621 tempest-ServerActionsTestOtherA-2004102178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-09ad69a1-794b-4284-9835-05c87ec3c45d {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ecdfb810-3df9-415d-855e-4c082cc88650 tempest-VolumesTestJSON-913936664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fb285f4-5c50-4194-a92f-34ebff53bd64" returned: 0 in 0.550s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ecdfb810-3df9-415d-855e-4c082cc88650 tempest-VolumesTestJSON-913936664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fb285f4-5c50-4194-a92f-34ebff53bd64 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:26 devstack cinder-volume[87165]: DEBUG cinder.quota [req-a1357792-aaff-4317-81c2-663d3f05a7f2 req-69aaa378-e9b9-4856-829e-c09637f6cf1e tempest-ServerActionsTestOtherA-2004102178 None] Created reservations ['3a50de39-f092-4f23-8e60-7bb322c2fc39', '732051db-99ee-40b2-96c6-ea346f3624d4', 'c890b097-6d5e-4854-a583-40dbb0b4ad5b', 'e8217e44-888d-4afb-9298-8cc237c7f341'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:48:26 devstack sudo[95616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fb285f4-5c50-4194-a92f-34ebff53bd64
Nov 06 11:48:26 devstack sudo[95616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:26 devstack sudo[95615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-09ad69a1-794b-4284-9835-05c87ec3c45d
Nov 06 11:48:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-a1357792-aaff-4317-81c2-663d3f05a7f2 req-69aaa378-e9b9-4856-829e-c09637f6cf1e tempest-ServerActionsTestOtherA-2004102178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:48:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-a1357792-aaff-4317-81c2-663d3f05a7f2 req-69aaa378-e9b9-4856-829e-c09637f6cf1e tempest-ServerActionsTestOtherA-2004102178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:48:26 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [req-a1357792-aaff-4317-81c2-663d3f05a7f2 req-69aaa378-e9b9-4856-829e-c09637f6cf1e tempest-ServerActionsTestOtherA-2004102178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:48:26 devstack sudo[95615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:26 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [req-a1357792-aaff-4317-81c2-663d3f05a7f2 req-69aaa378-e9b9-4856-829e-c09637f6cf1e tempest-ServerActionsTestOtherA-2004102178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:48:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-a1357792-aaff-4317-81c2-663d3f05a7f2 req-69aaa378-e9b9-4856-829e-c09637f6cf1e tempest-ServerActionsTestOtherA-2004102178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:48:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-a1357792-aaff-4317-81c2-663d3f05a7f2 req-69aaa378-e9b9-4856-829e-c09637f6cf1e tempest-ServerActionsTestOtherA-2004102178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:26 devstack sudo[95619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:48:26 devstack sudo[95619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:26 devstack sudo[95616]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ecdfb810-3df9-415d-855e-4c082cc88650 tempest-VolumesTestJSON-913936664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fb285f4-5c50-4194-a92f-34ebff53bd64" returned: 0 in 0.427s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:26 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ecdfb810-3df9-415d-855e-4c082cc88650 tempest-VolumesTestJSON-913936664 None] Lock "cinder-quobyte-7fb285f4-5c50-4194-a92f-34ebff53bd64" released by "delete_volume" :: held 1.042s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:48:26 devstack sudo[95619]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-a1357792-aaff-4317-81c2-663d3f05a7f2 req-69aaa378-e9b9-4856-829e-c09637f6cf1e tempest-ServerActionsTestOtherA-2004102178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.413s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:26 devstack cinder-volume[87165]: DEBUG cinder.manager [req-a1357792-aaff-4317-81c2-663d3f05a7f2 req-69aaa378-e9b9-4856-829e-c09637f6cf1e tempest-ServerActionsTestOtherA-2004102178 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:48:26 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-ecdfb810-3df9-415d-855e-4c082cc88650 tempest-VolumesTestJSON-913936664 None] Created reservations ['050baf17-54cf-4d9e-b7a7-5f1e85a35896', 'ce81b1db-40b7-4833-a0ea-ee5cd9a1e027', 'ac779531-da9f-49c6-8a98-af0a3e00190d', '9e4bbeed-b8bc-4bd8-bf2b-261ae2d0a1ae'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:48:26 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-a1357792-aaff-4317-81c2-663d3f05a7f2 req-69aaa378-e9b9-4856-829e-c09637f6cf1e tempest-ServerActionsTestOtherA-2004102178 None] Deleted volume successfully.
Nov 06 11:48:26 devstack sudo[95615]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3587f05d-9809-4309-8f56-e9082d65b621 tempest-ServerActionsTestOtherA-2004102178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-09ad69a1-794b-4284-9835-05c87ec3c45d" returned: 0 in 0.557s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3587f05d-9809-4309-8f56-e9082d65b621 tempest-ServerActionsTestOtherA-2004102178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-09ad69a1-794b-4284-9835-05c87ec3c45d {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:26 devstack sudo[95626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-09ad69a1-794b-4284-9835-05c87ec3c45d
Nov 06 11:48:26 devstack sudo[95626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:26 devstack cinder-volume[87165]: DEBUG cinder.coordination [req-a1357792-aaff-4317-81c2-663d3f05a7f2 req-69aaa378-e9b9-4856-829e-c09637f6cf1e tempest-ServerActionsTestOtherA-2004102178 None] Lock "cinder-a9513919-b7c8-4a94-a4c5-7077cd93ac75-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:48:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ecdfb810-3df9-415d-855e-4c082cc88650 tempest-VolumesTestJSON-913936664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:48:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ecdfb810-3df9-415d-855e-4c082cc88650 tempest-VolumesTestJSON-913936664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:48:26 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ecdfb810-3df9-415d-855e-4c082cc88650 tempest-VolumesTestJSON-913936664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:48:26 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ecdfb810-3df9-415d-855e-4c082cc88650 tempest-VolumesTestJSON-913936664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:48:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ecdfb810-3df9-415d-855e-4c082cc88650 tempest-VolumesTestJSON-913936664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:48:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ecdfb810-3df9-415d-855e-4c082cc88650 tempest-VolumesTestJSON-913936664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:26 devstack sudo[95628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:48:26 devstack sudo[95628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:26 devstack sudo[95626]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3587f05d-9809-4309-8f56-e9082d65b621 tempest-ServerActionsTestOtherA-2004102178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-09ad69a1-794b-4284-9835-05c87ec3c45d" returned: 0 in 0.286s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:26 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-3587f05d-9809-4309-8f56-e9082d65b621 tempest-ServerActionsTestOtherA-2004102178 None] Lock "cinder-quobyte-09ad69a1-794b-4284-9835-05c87ec3c45d" released by "delete_volume" :: held 0.911s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:48:26 devstack sudo[95628]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ecdfb810-3df9-415d-855e-4c082cc88650 tempest-VolumesTestJSON-913936664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.272s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:26 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-ecdfb810-3df9-415d-855e-4c082cc88650 tempest-VolumesTestJSON-913936664 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:48:26 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-ecdfb810-3df9-415d-855e-4c082cc88650 tempest-VolumesTestJSON-913936664 None] Deleted volume successfully.
Nov 06 11:48:26 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-3587f05d-9809-4309-8f56-e9082d65b621 tempest-ServerActionsTestOtherA-2004102178 None] Created reservations ['825da385-7d24-4dc1-8fff-b121e8b08456', '26fa4881-7a44-4d6a-9bb0-54400e35f6a3', 'fc611bea-23ca-42e8-8c2f-0b05c0c6a9ea', '36074618-a26e-4307-8788-2dc5927b10f3'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:48:26 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ecdfb810-3df9-415d-855e-4c082cc88650 tempest-VolumesTestJSON-913936664 None] Lock "cinder-7fb285f4-5c50-4194-a92f-34ebff53bd64-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:48:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3587f05d-9809-4309-8f56-e9082d65b621 tempest-ServerActionsTestOtherA-2004102178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:48:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3587f05d-9809-4309-8f56-e9082d65b621 tempest-ServerActionsTestOtherA-2004102178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:48:26 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-3587f05d-9809-4309-8f56-e9082d65b621 tempest-ServerActionsTestOtherA-2004102178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:48:27 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-3587f05d-9809-4309-8f56-e9082d65b621 tempest-ServerActionsTestOtherA-2004102178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:48:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3587f05d-9809-4309-8f56-e9082d65b621 tempest-ServerActionsTestOtherA-2004102178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:48:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3587f05d-9809-4309-8f56-e9082d65b621 tempest-ServerActionsTestOtherA-2004102178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:27 devstack sudo[95632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:48:27 devstack sudo[95632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:27 devstack sudo[95632]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3587f05d-9809-4309-8f56-e9082d65b621 tempest-ServerActionsTestOtherA-2004102178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.277s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:27 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-3587f05d-9809-4309-8f56-e9082d65b621 tempest-ServerActionsTestOtherA-2004102178 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:48:27 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-3587f05d-9809-4309-8f56-e9082d65b621 tempest-ServerActionsTestOtherA-2004102178 None] Deleted volume successfully.
Nov 06 11:48:27 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-3587f05d-9809-4309-8f56-e9082d65b621 tempest-ServerActionsTestOtherA-2004102178 None] Lock "cinder-09ad69a1-794b-4284-9835-05c87ec3c45d-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:48:27 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-27e3b474-f2f8-4225-944e-96b313a4bedb tempest-VolumesTestJSON-913936664 None] Acquiring lock "cinder-b4304f6d-a78f-4737-ad43-e3390755a116-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:48:27 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-27e3b474-f2f8-4225-944e-96b313a4bedb tempest-VolumesTestJSON-913936664 None] Lock "cinder-b4304f6d-a78f-4737-ad43-e3390755a116-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:48:27 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-27e3b474-f2f8-4225-944e-96b313a4bedb tempest-VolumesTestJSON-913936664 None] Acquiring lock "cinder-quobyte-b4304f6d-a78f-4737-ad43-e3390755a116" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:48:27 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-27e3b474-f2f8-4225-944e-96b313a4bedb tempest-VolumesTestJSON-913936664 None] Lock "cinder-quobyte-b4304f6d-a78f-4737-ad43-e3390755a116" acquired by "delete_volume" :: waited 0.019s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:48:27 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd8eb80-e7c0-4043-b541-6baad916bc56]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:48:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-27e3b474-f2f8-4225-944e-96b313a4bedb tempest-VolumesTestJSON-913936664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b4304f6d-a78f-4737-ad43-e3390755a116 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:27 devstack sudo[95636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b4304f6d-a78f-4737-ad43-e3390755a116
Nov 06 11:48:27 devstack sudo[95636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:28 devstack sudo[95636]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-27e3b474-f2f8-4225-944e-96b313a4bedb tempest-VolumesTestJSON-913936664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b4304f6d-a78f-4737-ad43-e3390755a116" returned: 0 in 0.466s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-27e3b474-f2f8-4225-944e-96b313a4bedb tempest-VolumesTestJSON-913936664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b4304f6d-a78f-4737-ad43-e3390755a116 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:28 devstack sudo[95641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b4304f6d-a78f-4737-ad43-e3390755a116
Nov 06 11:48:28 devstack sudo[95641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:28 devstack sudo[95641]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-27e3b474-f2f8-4225-944e-96b313a4bedb tempest-VolumesTestJSON-913936664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b4304f6d-a78f-4737-ad43-e3390755a116" returned: 0 in 0.350s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:28 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-27e3b474-f2f8-4225-944e-96b313a4bedb tempest-VolumesTestJSON-913936664 None] Lock "cinder-quobyte-b4304f6d-a78f-4737-ad43-e3390755a116" released by "delete_volume" :: held 0.878s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:48:28 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-27e3b474-f2f8-4225-944e-96b313a4bedb tempest-VolumesTestJSON-913936664 None] Created reservations ['e3a30457-3591-4ec1-98c0-2d898c95d1fc', 'b71b87d1-d180-4d0f-9dc1-d3ae2b1b840f', '88fa0ddd-244b-466f-a59c-d4de027b76b4', '2fc9ca69-6bbd-4614-970f-13f735c5870f'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:48:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-27e3b474-f2f8-4225-944e-96b313a4bedb tempest-VolumesTestJSON-913936664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:48:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-27e3b474-f2f8-4225-944e-96b313a4bedb tempest-VolumesTestJSON-913936664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:48:28 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-27e3b474-f2f8-4225-944e-96b313a4bedb tempest-VolumesTestJSON-913936664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:48:28 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-27e3b474-f2f8-4225-944e-96b313a4bedb tempest-VolumesTestJSON-913936664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:48:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-27e3b474-f2f8-4225-944e-96b313a4bedb tempest-VolumesTestJSON-913936664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:48:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-27e3b474-f2f8-4225-944e-96b313a4bedb tempest-VolumesTestJSON-913936664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:28 devstack sudo[95667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:48:28 devstack sudo[95667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:29 devstack sudo[95667]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-27e3b474-f2f8-4225-944e-96b313a4bedb tempest-VolumesTestJSON-913936664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.281s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:29 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-27e3b474-f2f8-4225-944e-96b313a4bedb tempest-VolumesTestJSON-913936664 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:48:29 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-27e3b474-f2f8-4225-944e-96b313a4bedb tempest-VolumesTestJSON-913936664 None] Deleted volume successfully.
Nov 06 11:48:29 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-27e3b474-f2f8-4225-944e-96b313a4bedb tempest-VolumesTestJSON-913936664 None] Lock "cinder-b4304f6d-a78f-4737-ad43-e3390755a116-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:48:38 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:UPDATE=197,cinder:SELECT=151,cinder:INSERT=52,cinder:DELETE=17 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 11:48:39 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:SELECT=65,cinder:UPDATE=99,cinder:INSERT=23,cinder:DELETE=7 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 11:48:46 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-544f74c1-8912-481c-9046-67f818010650 tempest-GroupsV320Test-740549064 None] Group tempest-GroupsV320Test-Group-1310205634: creating
Nov 06 11:48:46 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-544f74c1-8912-481c-9046-67f818010650 tempest-GroupsV320Test-740549064 None] Group tempest-GroupsV320Test-Group-1310205634: created successfully
Nov 06 11:48:46 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-544f74c1-8912-481c-9046-67f818010650 tempest-GroupsV320Test-740549064 None] Create group completed successfully.
Nov 06 11:48:48 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-aadb1121-44b7-4e7b-967e-2d93b8d0db01 tempest-GroupsV320Test-740549064 None] Created reservations ['514dbbb6-4bff-4dc4-a675-a33cea31f0f7'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:48:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-aadb1121-44b7-4e7b-967e-2d93b8d0db01 tempest-GroupsV320Test-740549064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:48:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-aadb1121-44b7-4e7b-967e-2d93b8d0db01 tempest-GroupsV320Test-740549064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:48:48 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-aadb1121-44b7-4e7b-967e-2d93b8d0db01 tempest-GroupsV320Test-740549064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:48:48 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-aadb1121-44b7-4e7b-967e-2d93b8d0db01 tempest-GroupsV320Test-740549064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:48:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-aadb1121-44b7-4e7b-967e-2d93b8d0db01 tempest-GroupsV320Test-740549064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:48:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-aadb1121-44b7-4e7b-967e-2d93b8d0db01 tempest-GroupsV320Test-740549064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:48 devstack sudo[95684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:48:48 devstack sudo[95684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:48 devstack sudo[95684]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-aadb1121-44b7-4e7b-967e-2d93b8d0db01 tempest-GroupsV320Test-740549064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.302s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:48 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-aadb1121-44b7-4e7b-967e-2d93b8d0db01 tempest-GroupsV320Test-740549064 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:48:48 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-aadb1121-44b7-4e7b-967e-2d93b8d0db01 tempest-GroupsV320Test-740549064 None] Delete group completed successfully.
Nov 06 11:48:52 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:48:52 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] Flow 'volume_create_manager' (6c39db7b-02dc-4c16-bd74-60553120f18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:48:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (220198c4-73ab-4103-a672-35729529a26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:48:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (220198c4-73ab-4103-a672-35729529a26d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:48:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-512818035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d9dc1fd-81e3-40cd-b71a-8902747148db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7534efd42e944bab7c8d9929cbc9b57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:48:53Z,use_quota=True,user_id='0c4a89fe8c16464d83f06463d74efdc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:48:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f031ff62-d572-4450-80bc-88f32e1d1a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:48:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f031ff62-d572-4450-80bc-88f32e1d1a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:48:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4e1bf46-5c28-4bde-b2ad-e70e42cb1053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:48:53 devstack cinder-volume[87165]: DEBUG cinder.image.glance [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] Creating Keystone auth plugin from conf {{(pid=87165) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 06 11:48:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4e1bf46-5c28-4bde-b2ad-e70e42cb1053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7d9dc1fd-81e3-40cd-b71a-8902747148db', 'volume_name': 'volume-7d9dc1fd-81e3-40cd-b71a-8902747148db', 'volume_size': 1, 'image_id': 'c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '28942f14a9e2424ca7367c6efa5fb47a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'created_at': datetime.datetime(2026, 11, 6, 10, 37, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 10, 37, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c315441d-48d2-43fb-b56a-c983b5a6f9cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x742c1e2032f0>}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:48:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be572b70-c905-4514-828d-6b844721eedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:48:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be572b70-c905-4514-828d-6b844721eedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:48:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e76815e-5d2f-4143-8722-5dccb0d73047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:48:53 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] Volume 7d9dc1fd-81e3-40cd-b71a-8902747148db: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7d9dc1fd-81e3-40cd-b71a-8902747148db', 'volume_size': 1, 'image_id': 'c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '28942f14a9e2424ca7367c6efa5fb47a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'created_at': datetime.datetime(2026, 11, 6, 10, 37, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 10, 37, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c315441d-48d2-43fb-b56a-c983b5a6f9cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x742c1e2032f0>}
Nov 06 11:48:53 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] Trying to clone 7d9dc1fd-81e3-40cd-b71a-8902747148db from image c315441d-48d2-43fb-b56a-c983b5a6f9cd at location (None, [{'url': 'file:///opt/stack/data/glance/images/c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'metadata': {}}]). {{(pid=87165) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 06 11:48:53 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_whf55u3tdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87165) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 06 11:48:53 devstack cinder-volume[87165]: INFO cinder.image.image_utils [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] Image download 20.69 MB at 20.69 MB/s
Nov 06 11:48:54 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5bac21-bbb1-4cd4-8a72-b40f8f596337]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:48:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_whf55u3tdevstack@QuobyteHD {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:54 devstack sudo[95688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_whf55u3tdevstack@QuobyteHD
Nov 06 11:48:54 devstack sudo[95688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:54 devstack sudo[95688]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_whf55u3tdevstack@QuobyteHD" returned: 0 in 0.346s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:54 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] Temporary image c315441d-48d2-43fb-b56a-c983b5a6f9cd is fetched for user 0c4a89fe8c16464d83f06463d74efdc0. {{(pid=87165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 06 11:48:54 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1eb4b2-3a62-4f21-82ad-bcd24ff6a3cb]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:48:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_whf55u3tdevstack@QuobyteHD {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:54 devstack sudo[95694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_whf55u3tdevstack@QuobyteHD
Nov 06 11:48:54 devstack sudo[95694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:54 devstack sudo[95694]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_whf55u3tdevstack@QuobyteHD" returned: 0 in 0.432s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:48:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:48:54 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:48:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-512818035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d9dc1fd-81e3-40cd-b71a-8902747148db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7534efd42e944bab7c8d9929cbc9b57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:48:53Z,use_quota=True,user_id='0c4a89fe8c16464d83f06463d74efdc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:48:54 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] Creating volume 7d9dc1fd-81e3-40cd-b71a-8902747148db {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:48:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:48:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:48:54 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:48:54 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:48:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:48:54 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:48:54 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:48:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7d9dc1fd-81e3-40cd-b71a-8902747148db 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:54 devstack sudo[95699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7d9dc1fd-81e3-40cd-b71a-8902747148db 1073741824
Nov 06 11:48:54 devstack sudo[95699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:55 devstack sudo[95699]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7d9dc1fd-81e3-40cd-b71a-8902747148db 1073741824" returned: 0 in 0.659s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7d9dc1fd-81e3-40cd-b71a-8902747148db {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:55 devstack sudo[95705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7d9dc1fd-81e3-40cd-b71a-8902747148db
Nov 06 11:48:55 devstack sudo[95705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:55 devstack sudo[95705]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7d9dc1fd-81e3-40cd-b71a-8902747148db" returned: 0 in 0.339s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:55 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:48:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:48:56 devstack cinder-volume[87165]: DEBUG cinder.volume.volume_utils [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] Attempting download of c315441d-48d2-43fb-b56a-c983b5a6f9cd ((None, [{'url': 'file:///opt/stack/data/glance/images/c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'metadata': {}}])) to volume 7d9dc1fd-81e3-40cd-b71a-8902747148db. {{(pid=87165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 06 11:48:56 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c04db8-17ae-4f64-bd27-909effb78e8b]: (4, 'raw') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:48:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c315441d-48d2-43fb-b56a-c983b5a6f9cd_sbglq6y4 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:56 devstack sudo[95708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c315441d-48d2-43fb-b56a-c983b5a6f9cd_sbglq6y4
Nov 06 11:48:56 devstack sudo[95708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:56 devstack sudo[95708]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c315441d-48d2-43fb-b56a-c983b5a6f9cd_sbglq6y4" returned: 0 in 0.379s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c315441d-48d2-43fb-b56a-c983b5a6f9cd_sbglq6y4 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:56 devstack sudo[95712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c315441d-48d2-43fb-b56a-c983b5a6f9cd_sbglq6y4
Nov 06 11:48:56 devstack sudo[95712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:56 devstack sudo[95712]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c315441d-48d2-43fb-b56a-c983b5a6f9cd_sbglq6y4" returned: 1 in 0.409s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c315441d-48d2-43fb-b56a-c983b5a6f9cd_sbglq6y4' failed. Not Retrying. {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 11:48:56 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f700c67a-3089-4dc8-a726-e871d9afd8a5]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:48:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_whf55u3tdevstack@QuobyteHD {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:57 devstack sudo[95716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_whf55u3tdevstack@QuobyteHD
Nov 06 11:48:57 devstack sudo[95716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:48:57 devstack sudo[95716]: pam_unix(sudo:session): session closed for user root
Nov 06 11:48:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_whf55u3tdevstack@QuobyteHD" returned: 0 in 0.384s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:48:57 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] c315441d-48d2-43fb-b56a-c983b5a6f9cd was qcow2, converting to qcow2 {{(pid=87165) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 06 11:48:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_whf55u3tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7d9dc1fd-81e3-40cd-b71a-8902747148db {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:48:57 devstack sudo[95721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_whf55u3tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7d9dc1fd-81e3-40cd-b71a-8902747148db
Nov 06 11:48:57 devstack sudo[95721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:00 devstack sudo[95721]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_whf55u3tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7d9dc1fd-81e3-40cd-b71a-8902747148db" returned: 0 in 2.832s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:00 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_whf55u3tdevstack@QuobyteHD, size 112.00 MB, duration 2.83 sec, destination /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7d9dc1fd-81e3-40cd-b71a-8902747148db {{(pid=87165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 11:49:00 devstack cinder-volume[87165]: INFO cinder.image.image_utils [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] Converted 112.00 MB image at 39.53 MB/s
Nov 06 11:49:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7d9dc1fd-81e3-40cd-b71a-8902747148db 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:00 devstack sudo[95772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7d9dc1fd-81e3-40cd-b71a-8902747148db 1G
Nov 06 11:49:00 devstack sudo[95772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:00 devstack sudo[95772]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7d9dc1fd-81e3-40cd-b71a-8902747148db 1G" returned: 0 in 0.631s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:00 devstack cinder-volume[87165]: DEBUG cinder.volume.volume_utils [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] Downloaded image c315441d-48d2-43fb-b56a-c983b5a6f9cd ((None, [{'url': 'file:///opt/stack/data/glance/images/c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'metadata': {}}])) to volume 7d9dc1fd-81e3-40cd-b71a-8902747148db successfully. {{(pid=87165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 06 11:49:00 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] Temporary image c315441d-48d2-43fb-b56a-c983b5a6f9cd for user 0c4a89fe8c16464d83f06463d74efdc0 is deleted. {{(pid=87165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 06 11:49:00 devstack cinder-volume[87165]: DEBUG cinder.volume.volume_utils [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] Marking volume 7d9dc1fd-81e3-40cd-b71a-8902747148db as bootable. {{(pid=87165) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 06 11:49:00 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] Copying metadata from image c315441d-48d2-43fb-b56a-c983b5a6f9cd to 7d9dc1fd-81e3-40cd-b71a-8902747148db. {{(pid=87165) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 06 11:49:00 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] Creating volume glance metadata for volume 7d9dc1fd-81e3-40cd-b71a-8902747148db backed by image c315441d-48d2-43fb-b56a-c983b5a6f9cd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87165) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 06 11:49:00 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e76815e-5d2f-4143-8722-5dccb0d73047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d9dc1fd-81e3-40cd-b71a-8902747148db', 'volume_size': 1, 'image_id': 'c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '28942f14a9e2424ca7367c6efa5fb47a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'created_at': datetime.datetime(2026, 11, 6, 10, 37, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 10, 37, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c315441d-48d2-43fb-b56a-c983b5a6f9cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x742c1e2032f0>}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:00 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29e91d07-2b84-45c1-be53-30f43d76e1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:00 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] Volume volume-7d9dc1fd-81e3-40cd-b71a-8902747148db (7d9dc1fd-81e3-40cd-b71a-8902747148db): created successfully
Nov 06 11:49:01 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29e91d07-2b84-45c1-be53-30f43d76e1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:01 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] Flow 'volume_create_manager' (6c39db7b-02dc-4c16-bd74-60553120f18c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:49:01 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-3d08a76e-2c4d-4ac9-b53d-0cc979e0f810 tempest-VolumesImageMetadata-52600634 None] Created volume successfully.
Nov 06 11:49:01 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-f453bbaa-001f-49e4-9338-4ec263a6a152 tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:49:01 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f453bbaa-001f-49e4-9338-4ec263a6a152 tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Flow 'volume_create_manager' (4aba3d39-720a-4d69-90ba-9640ae1d8e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:49:01 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f453bbaa-001f-49e4-9338-4ec263a6a152 tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceb2b147-ff82-4b35-8a46-6292d24b7aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:01 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f453bbaa-001f-49e4-9338-4ec263a6a152 tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceb2b147-ff82-4b35-8a46-6292d24b7aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:49:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2133041022',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c9fdd4c-721c-43e8-a4d2-2759f7ddf59e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d770d296937941ffbd15fa838e3c393f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:49:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:49:01Z,use_quota=True,user_id='956649f982144f8bac9a413af130207a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9ca8b1f-eb70-41c1-a975-887042dbd545),volume_type_id=b9ca8b1f-eb70-41c1-a975-887042dbd545)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:01 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f453bbaa-001f-49e4-9338-4ec263a6a152 tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (842e85b9-b955-4809-9aa2-6ff244505310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:01 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f453bbaa-001f-49e4-9338-4ec263a6a152 tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (842e85b9-b955-4809-9aa2-6ff244505310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:01 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f453bbaa-001f-49e4-9338-4ec263a6a152 tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfb42bf3-a650-4e8c-bc83-ee20625d01c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:01 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f453bbaa-001f-49e4-9338-4ec263a6a152 tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfb42bf3-a650-4e8c-bc83-ee20625d01c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c9fdd4c-721c-43e8-a4d2-2759f7ddf59e', 'volume_name': 'volume-9c9fdd4c-721c-43e8-a4d2-2759f7ddf59e', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:01 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f453bbaa-001f-49e4-9338-4ec263a6a152 tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a144f88d-0dcb-4ed6-acb8-c65c823edc59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:01 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f453bbaa-001f-49e4-9338-4ec263a6a152 tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a144f88d-0dcb-4ed6-acb8-c65c823edc59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:01 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f453bbaa-001f-49e4-9338-4ec263a6a152 tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e64a57e4-0d31-424d-8e8f-ce240f0671ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:01 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-f453bbaa-001f-49e4-9338-4ec263a6a152 tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Volume 9c9fdd4c-721c-43e8-a4d2-2759f7ddf59e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c9fdd4c-721c-43e8-a4d2-2759f7ddf59e', 'volume_size': 1}
Nov 06 11:49:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f453bbaa-001f-49e4-9338-4ec263a6a152 tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:49:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f453bbaa-001f-49e4-9338-4ec263a6a152 tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:49:01 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-f453bbaa-001f-49e4-9338-4ec263a6a152 tempest-VolumeRetypeWithoutMigrationTest-602626219 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:49:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2133041022',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c9fdd4c-721c-43e8-a4d2-2759f7ddf59e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d770d296937941ffbd15fa838e3c393f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:49:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:49:01Z,use_quota=True,user_id='956649f982144f8bac9a413af130207a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9ca8b1f-eb70-41c1-a975-887042dbd545),volume_type_id=b9ca8b1f-eb70-41c1-a975-887042dbd545)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:49:01 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-f453bbaa-001f-49e4-9338-4ec263a6a152 tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Creating volume 9c9fdd4c-721c-43e8-a4d2-2759f7ddf59e {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:49:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f453bbaa-001f-49e4-9338-4ec263a6a152 tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:49:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f453bbaa-001f-49e4-9338-4ec263a6a152 tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:49:01 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-f453bbaa-001f-49e4-9338-4ec263a6a152 tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:49:01 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-f453bbaa-001f-49e4-9338-4ec263a6a152 tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:49:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f453bbaa-001f-49e4-9338-4ec263a6a152 tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:49:01 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-f453bbaa-001f-49e4-9338-4ec263a6a152 tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:49:01 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-f453bbaa-001f-49e4-9338-4ec263a6a152 tempest-VolumeRetypeWithoutMigrationTest-602626219 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:49:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f453bbaa-001f-49e4-9338-4ec263a6a152 tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9c9fdd4c-721c-43e8-a4d2-2759f7ddf59e 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:01 devstack sudo[95795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9c9fdd4c-721c-43e8-a4d2-2759f7ddf59e 1073741824
Nov 06 11:49:01 devstack sudo[95795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:02 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f97e465-435d-4d59-b16f-a572a9ee0a52 tempest-VolumesTransfersTest-225064145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:49:02 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9f97e465-435d-4d59-b16f-a572a9ee0a52 tempest-VolumesTransfersTest-225064145 None] Flow 'volume_create_manager' (eccd242f-8008-475e-9820-816dd8f0ebf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:49:02 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9f97e465-435d-4d59-b16f-a572a9ee0a52 tempest-VolumesTransfersTest-225064145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c10ec03-2977-40d1-8d4e-d42beb1e1793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:02 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9f97e465-435d-4d59-b16f-a572a9ee0a52 tempest-VolumesTransfersTest-225064145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c10ec03-2977-40d1-8d4e-d42beb1e1793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:49:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1767046885',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d320cd1-6c1b-468e-932c-8af1e1a11569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1eee33968dd4e129da050822f4e2ac1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:49:02Z,use_quota=True,user_id='bf300a745d954d0d8deb9de7b6de7c47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:02 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9f97e465-435d-4d59-b16f-a572a9ee0a52 tempest-VolumesTransfersTest-225064145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a15f871-74d1-4b7f-8094-92d8d921574c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:02 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9f97e465-435d-4d59-b16f-a572a9ee0a52 tempest-VolumesTransfersTest-225064145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a15f871-74d1-4b7f-8094-92d8d921574c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:02 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9f97e465-435d-4d59-b16f-a572a9ee0a52 tempest-VolumesTransfersTest-225064145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cd31d2c-d06b-48f5-9bc9-2120ae25948c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:02 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9f97e465-435d-4d59-b16f-a572a9ee0a52 tempest-VolumesTransfersTest-225064145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cd31d2c-d06b-48f5-9bc9-2120ae25948c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d320cd1-6c1b-468e-932c-8af1e1a11569', 'volume_name': 'volume-1d320cd1-6c1b-468e-932c-8af1e1a11569', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:02 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9f97e465-435d-4d59-b16f-a572a9ee0a52 tempest-VolumesTransfersTest-225064145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5733df4c-b8ad-4b91-8001-6a28ea82550e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:02 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9f97e465-435d-4d59-b16f-a572a9ee0a52 tempest-VolumesTransfersTest-225064145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5733df4c-b8ad-4b91-8001-6a28ea82550e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:02 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9f97e465-435d-4d59-b16f-a572a9ee0a52 tempest-VolumesTransfersTest-225064145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a99ac5a5-8807-46ca-8324-6a694b693300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:02 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-9f97e465-435d-4d59-b16f-a572a9ee0a52 tempest-VolumesTransfersTest-225064145 None] Volume 1d320cd1-6c1b-468e-932c-8af1e1a11569: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d320cd1-6c1b-468e-932c-8af1e1a11569', 'volume_size': 1}
Nov 06 11:49:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9f97e465-435d-4d59-b16f-a572a9ee0a52 tempest-VolumesTransfersTest-225064145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:49:02 devstack sudo[95795]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f453bbaa-001f-49e4-9338-4ec263a6a152 tempest-VolumeRetypeWithoutMigrationTest-602626219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9c9fdd4c-721c-43e8-a4d2-2759f7ddf59e 1073741824" returned: 0 in 0.910s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f453bbaa-001f-49e4-9338-4ec263a6a152 tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9c9fdd4c-721c-43e8-a4d2-2759f7ddf59e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:02 devstack sudo[95805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9c9fdd4c-721c-43e8-a4d2-2759f7ddf59e
Nov 06 11:49:02 devstack sudo[95805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:02 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-4bb75861-9011-4dc6-be68-2c9c467aaa0e tempest-VolumesImageMetadata-52600634 None] Acquiring lock "cinder-7d9dc1fd-81e3-40cd-b71a-8902747148db-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:49:02 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-4bb75861-9011-4dc6-be68-2c9c467aaa0e tempest-VolumesImageMetadata-52600634 None] Lock "cinder-7d9dc1fd-81e3-40cd-b71a-8902747148db-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:49:02 devstack sudo[95805]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f453bbaa-001f-49e4-9338-4ec263a6a152 tempest-VolumeRetypeWithoutMigrationTest-602626219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9c9fdd4c-721c-43e8-a4d2-2759f7ddf59e" returned: 0 in 0.409s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:02 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-f453bbaa-001f-49e4-9338-4ec263a6a152 tempest-VolumeRetypeWithoutMigrationTest-602626219 None] <== create_volume: return (1387ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:49:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f453bbaa-001f-49e4-9338-4ec263a6a152 tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.390s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:49:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9f97e465-435d-4d59-b16f-a572a9ee0a52 tempest-VolumesTransfersTest-225064145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.522s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:49:02 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-9f97e465-435d-4d59-b16f-a572a9ee0a52 tempest-VolumesTransfersTest-225064145 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:49:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1767046885',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d320cd1-6c1b-468e-932c-8af1e1a11569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1eee33968dd4e129da050822f4e2ac1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:49:02Z,use_quota=True,user_id='bf300a745d954d0d8deb9de7b6de7c47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:49:02 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-9f97e465-435d-4d59-b16f-a572a9ee0a52 tempest-VolumesTransfersTest-225064145 None] Creating volume 1d320cd1-6c1b-468e-932c-8af1e1a11569 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:49:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9f97e465-435d-4d59-b16f-a572a9ee0a52 tempest-VolumesTransfersTest-225064145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:49:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9f97e465-435d-4d59-b16f-a572a9ee0a52 tempest-VolumesTransfersTest-225064145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:49:02 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-9f97e465-435d-4d59-b16f-a572a9ee0a52 tempest-VolumesTransfersTest-225064145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:49:02 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-9f97e465-435d-4d59-b16f-a572a9ee0a52 tempest-VolumesTransfersTest-225064145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:49:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9f97e465-435d-4d59-b16f-a572a9ee0a52 tempest-VolumesTransfersTest-225064145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:49:02 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-9f97e465-435d-4d59-b16f-a572a9ee0a52 tempest-VolumesTransfersTest-225064145 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:49:02 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-9f97e465-435d-4d59-b16f-a572a9ee0a52 tempest-VolumesTransfersTest-225064145 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:49:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9f97e465-435d-4d59-b16f-a572a9ee0a52 tempest-VolumesTransfersTest-225064145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1d320cd1-6c1b-468e-932c-8af1e1a11569 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:02 devstack sudo[95818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1d320cd1-6c1b-468e-932c-8af1e1a11569 1073741824
Nov 06 11:49:02 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f453bbaa-001f-49e4-9338-4ec263a6a152 tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e64a57e4-0d31-424d-8e8f-ce240f0671ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c9fdd4c-721c-43e8-a4d2-2759f7ddf59e', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:02 devstack sudo[95818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:02 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f453bbaa-001f-49e4-9338-4ec263a6a152 tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e37eddd-dcaa-4c9e-8b14-acfda5cbf765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:02 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-f453bbaa-001f-49e4-9338-4ec263a6a152 tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Volume volume-9c9fdd4c-721c-43e8-a4d2-2759f7ddf59e (9c9fdd4c-721c-43e8-a4d2-2759f7ddf59e): created successfully
Nov 06 11:49:02 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f453bbaa-001f-49e4-9338-4ec263a6a152 tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e37eddd-dcaa-4c9e-8b14-acfda5cbf765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:02 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f453bbaa-001f-49e4-9338-4ec263a6a152 tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Flow 'volume_create_manager' (4aba3d39-720a-4d69-90ba-9640ae1d8e88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:49:02 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-4bb75861-9011-4dc6-be68-2c9c467aaa0e tempest-VolumesImageMetadata-52600634 None] Acquiring lock "cinder-quobyte-7d9dc1fd-81e3-40cd-b71a-8902747148db" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:49:03 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-f453bbaa-001f-49e4-9338-4ec263a6a152 tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Created volume successfully.
Nov 06 11:49:03 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-4bb75861-9011-4dc6-be68-2c9c467aaa0e tempest-VolumesImageMetadata-52600634 None] Lock "cinder-quobyte-7d9dc1fd-81e3-40cd-b71a-8902747148db" acquired by "delete_volume" :: waited 0.024s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:49:03 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[456c91f6-2b82-4164-aae0-4469a26b51b9]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:49:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4bb75861-9011-4dc6-be68-2c9c467aaa0e tempest-VolumesImageMetadata-52600634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7d9dc1fd-81e3-40cd-b71a-8902747148db {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:03 devstack sudo[95820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7d9dc1fd-81e3-40cd-b71a-8902747148db
Nov 06 11:49:03 devstack sudo[95820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:03 devstack sudo[95818]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9f97e465-435d-4d59-b16f-a572a9ee0a52 tempest-VolumesTransfersTest-225064145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1d320cd1-6c1b-468e-932c-8af1e1a11569 1073741824" returned: 0 in 0.731s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:03 devstack sudo[95820]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4bb75861-9011-4dc6-be68-2c9c467aaa0e tempest-VolumesImageMetadata-52600634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7d9dc1fd-81e3-40cd-b71a-8902747148db" returned: 0 in 0.580s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4bb75861-9011-4dc6-be68-2c9c467aaa0e tempest-VolumesImageMetadata-52600634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7d9dc1fd-81e3-40cd-b71a-8902747148db {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:03 devstack sudo[95832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7d9dc1fd-81e3-40cd-b71a-8902747148db
Nov 06 11:49:03 devstack sudo[95832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9f97e465-435d-4d59-b16f-a572a9ee0a52 tempest-VolumesTransfersTest-225064145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1d320cd1-6c1b-468e-932c-8af1e1a11569 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:03 devstack sudo[95834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1d320cd1-6c1b-468e-932c-8af1e1a11569
Nov 06 11:49:03 devstack sudo[95834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:04 devstack sudo[95832]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4bb75861-9011-4dc6-be68-2c9c467aaa0e tempest-VolumesImageMetadata-52600634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7d9dc1fd-81e3-40cd-b71a-8902747148db" returned: 0 in 0.360s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:04 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-4bb75861-9011-4dc6-be68-2c9c467aaa0e tempest-VolumesImageMetadata-52600634 None] Lock "cinder-quobyte-7d9dc1fd-81e3-40cd-b71a-8902747148db" released by "delete_volume" :: held 1.009s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:49:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-67a52318-8269-417a-bee3-f0baf1a48ed2 tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:49:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-67a52318-8269-417a-bee3-f0baf1a48ed2 tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:49:04 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-67a52318-8269-417a-bee3-f0baf1a48ed2 tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:49:04 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-67a52318-8269-417a-bee3-f0baf1a48ed2 tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:49:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-67a52318-8269-417a-bee3-f0baf1a48ed2 tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:49:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-67a52318-8269-417a-bee3-f0baf1a48ed2 tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:04 devstack sudo[95838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:49:04 devstack sudo[95838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:04 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-4bb75861-9011-4dc6-be68-2c9c467aaa0e tempest-VolumesImageMetadata-52600634 None] Created reservations ['ed552e77-464a-4e3d-b878-6540b2819189', '40665775-8cab-4ad0-9f28-d5ea7b4a624e', '1f363d1d-fe7e-42d0-aeb7-8a5d6d6fbd9c', 'f4bd8bf3-61a6-42be-a5bf-60340659b6d8'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:49:04 devstack sudo[95834]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9f97e465-435d-4d59-b16f-a572a9ee0a52 tempest-VolumesTransfersTest-225064145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1d320cd1-6c1b-468e-932c-8af1e1a11569" returned: 0 in 0.468s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:04 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-9f97e465-435d-4d59-b16f-a572a9ee0a52 tempest-VolumesTransfersTest-225064145 None] <== create_volume: return (1330ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:49:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9f97e465-435d-4d59-b16f-a572a9ee0a52 tempest-VolumesTransfersTest-225064145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.334s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:49:04 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9f97e465-435d-4d59-b16f-a572a9ee0a52 tempest-VolumesTransfersTest-225064145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a99ac5a5-8807-46ca-8324-6a694b693300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d320cd1-6c1b-468e-932c-8af1e1a11569', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:04 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9f97e465-435d-4d59-b16f-a572a9ee0a52 tempest-VolumesTransfersTest-225064145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9df76748-88fc-4109-bfb4-22878e7c743d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:04 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-9f97e465-435d-4d59-b16f-a572a9ee0a52 tempest-VolumesTransfersTest-225064145 None] Volume volume-1d320cd1-6c1b-468e-932c-8af1e1a11569 (1d320cd1-6c1b-468e-932c-8af1e1a11569): created successfully
Nov 06 11:49:04 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9f97e465-435d-4d59-b16f-a572a9ee0a52 tempest-VolumesTransfersTest-225064145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9df76748-88fc-4109-bfb4-22878e7c743d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:04 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9f97e465-435d-4d59-b16f-a572a9ee0a52 tempest-VolumesTransfersTest-225064145 None] Flow 'volume_create_manager' (eccd242f-8008-475e-9820-816dd8f0ebf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:49:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4bb75861-9011-4dc6-be68-2c9c467aaa0e tempest-VolumesImageMetadata-52600634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:49:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4bb75861-9011-4dc6-be68-2c9c467aaa0e tempest-VolumesImageMetadata-52600634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:49:04 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-4bb75861-9011-4dc6-be68-2c9c467aaa0e tempest-VolumesImageMetadata-52600634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:49:04 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-4bb75861-9011-4dc6-be68-2c9c467aaa0e tempest-VolumesImageMetadata-52600634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:49:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4bb75861-9011-4dc6-be68-2c9c467aaa0e tempest-VolumesImageMetadata-52600634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:49:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4bb75861-9011-4dc6-be68-2c9c467aaa0e tempest-VolumesImageMetadata-52600634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:04 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-9f97e465-435d-4d59-b16f-a572a9ee0a52 tempest-VolumesTransfersTest-225064145 None] Created volume successfully.
Nov 06 11:49:04 devstack sudo[95841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:49:04 devstack sudo[95841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:04 devstack sudo[95838]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-67a52318-8269-417a-bee3-f0baf1a48ed2 tempest-VolumeRetypeWithoutMigrationTest-602626219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.362s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:04 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-67a52318-8269-417a-bee3-f0baf1a48ed2 tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:49:04 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-67a52318-8269-417a-bee3-f0baf1a48ed2 tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Retype volume completed successfully.
Nov 06 11:49:04 devstack sudo[95841]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4bb75861-9011-4dc6-be68-2c9c467aaa0e tempest-VolumesImageMetadata-52600634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.574s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:04 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-4bb75861-9011-4dc6-be68-2c9c467aaa0e tempest-VolumesImageMetadata-52600634 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:49:04 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-4bb75861-9011-4dc6-be68-2c9c467aaa0e tempest-VolumesImageMetadata-52600634 None] Deleted volume successfully.
Nov 06 11:49:04 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-4bb75861-9011-4dc6-be68-2c9c467aaa0e tempest-VolumesImageMetadata-52600634 None] Lock "cinder-7d9dc1fd-81e3-40cd-b71a-8902747148db-delete_volume" released by "delete_volume" :: held 2.079s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:49:05 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-aff7b91d-7b77-43df-98bf-970179127e9c tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Acquiring lock "cinder-9c9fdd4c-721c-43e8-a4d2-2759f7ddf59e-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:49:05 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-aff7b91d-7b77-43df-98bf-970179127e9c tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Lock "cinder-9c9fdd4c-721c-43e8-a4d2-2759f7ddf59e-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:49:06 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-aff7b91d-7b77-43df-98bf-970179127e9c tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Acquiring lock "cinder-quobyte-9c9fdd4c-721c-43e8-a4d2-2759f7ddf59e" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:49:06 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-aff7b91d-7b77-43df-98bf-970179127e9c tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Lock "cinder-quobyte-9c9fdd4c-721c-43e8-a4d2-2759f7ddf59e" acquired by "delete_volume" :: waited 0.021s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:49:06 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae511830-7d62-4171-a993-c12decb950e3]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:49:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-aff7b91d-7b77-43df-98bf-970179127e9c tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9c9fdd4c-721c-43e8-a4d2-2759f7ddf59e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:06 devstack sudo[95910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9c9fdd4c-721c-43e8-a4d2-2759f7ddf59e
Nov 06 11:49:06 devstack sudo[95910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:07 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-0b05e46e-c41b-44c7-b028-1cce618a241b tempest-VolumesTransfersTest-1650933651 None] Transfer volume completed successfully.
Nov 06 11:49:07 devstack sudo[95910]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-aff7b91d-7b77-43df-98bf-970179127e9c tempest-VolumeRetypeWithoutMigrationTest-602626219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9c9fdd4c-721c-43e8-a4d2-2759f7ddf59e" returned: 0 in 1.104s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-aff7b91d-7b77-43df-98bf-970179127e9c tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9c9fdd4c-721c-43e8-a4d2-2759f7ddf59e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:07 devstack sudo[95926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9c9fdd4c-721c-43e8-a4d2-2759f7ddf59e
Nov 06 11:49:07 devstack sudo[95926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:07 devstack sudo[95926]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-aff7b91d-7b77-43df-98bf-970179127e9c tempest-VolumeRetypeWithoutMigrationTest-602626219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9c9fdd4c-721c-43e8-a4d2-2759f7ddf59e" returned: 0 in 0.377s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:07 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-aff7b91d-7b77-43df-98bf-970179127e9c tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Lock "cinder-quobyte-9c9fdd4c-721c-43e8-a4d2-2759f7ddf59e" released by "delete_volume" :: held 1.574s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:49:07 devstack cinder-volume[87165]: WARNING cinder.quota [None req-aff7b91d-7b77-43df-98bf-970179127e9c tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Nov 06 11:49:07 devstack cinder-volume[87165]: WARNING cinder.quota [None req-aff7b91d-7b77-43df-98bf-970179127e9c tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Nov 06 11:49:07 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-aff7b91d-7b77-43df-98bf-970179127e9c tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Created reservations ['97660756-76c2-47c1-a4ca-bf9fb22f7cc7', 'f900ccdc-2436-4062-a0fd-0cd29aead26d', '78149ebf-9180-4acf-bf61-ad62ba9e02c9', 'd7b8443b-50cf-43f3-9d50-01731fd7af05'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:49:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-aff7b91d-7b77-43df-98bf-970179127e9c tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:49:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-aff7b91d-7b77-43df-98bf-970179127e9c tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:49:08 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-aff7b91d-7b77-43df-98bf-970179127e9c tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:49:08 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-aff7b91d-7b77-43df-98bf-970179127e9c tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:49:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-aff7b91d-7b77-43df-98bf-970179127e9c tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:49:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-aff7b91d-7b77-43df-98bf-970179127e9c tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:08 devstack sudo[95943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:49:08 devstack sudo[95943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:08 devstack sudo[95943]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-aff7b91d-7b77-43df-98bf-970179127e9c tempest-VolumeRetypeWithoutMigrationTest-602626219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.585s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:08 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-aff7b91d-7b77-43df-98bf-970179127e9c tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:49:08 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-aff7b91d-7b77-43df-98bf-970179127e9c tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Deleted volume successfully.
Nov 06 11:49:08 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-aff7b91d-7b77-43df-98bf-970179127e9c tempest-VolumeRetypeWithoutMigrationTest-602626219 None] Lock "cinder-9c9fdd4c-721c-43e8-a4d2-2759f7ddf59e-delete_volume" released by "delete_volume" :: held 2.842s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:49:09 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e44d3519-b4bc-4c28-9b92-a82d7b7bb31b tempest-VolumesTransfersTest-1370844302 None] Acquiring lock "cinder-1d320cd1-6c1b-468e-932c-8af1e1a11569-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:49:09 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e44d3519-b4bc-4c28-9b92-a82d7b7bb31b tempest-VolumesTransfersTest-1370844302 None] Lock "cinder-1d320cd1-6c1b-468e-932c-8af1e1a11569-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:49:09 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e44d3519-b4bc-4c28-9b92-a82d7b7bb31b tempest-VolumesTransfersTest-1370844302 None] Acquiring lock "cinder-quobyte-1d320cd1-6c1b-468e-932c-8af1e1a11569" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:49:09 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e44d3519-b4bc-4c28-9b92-a82d7b7bb31b tempest-VolumesTransfersTest-1370844302 None] Lock "cinder-quobyte-1d320cd1-6c1b-468e-932c-8af1e1a11569" acquired by "delete_volume" :: waited 0.030s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:49:09 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[70062e23-b1c1-4d07-8807-52d0e2562c3d]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:49:09 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e44d3519-b4bc-4c28-9b92-a82d7b7bb31b tempest-VolumesTransfersTest-1370844302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1d320cd1-6c1b-468e-932c-8af1e1a11569 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:09 devstack sudo[95972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1d320cd1-6c1b-468e-932c-8af1e1a11569
Nov 06 11:49:09 devstack sudo[95972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:09 devstack sudo[95972]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:09 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e44d3519-b4bc-4c28-9b92-a82d7b7bb31b tempest-VolumesTransfersTest-1370844302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1d320cd1-6c1b-468e-932c-8af1e1a11569" returned: 0 in 0.591s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:09 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e44d3519-b4bc-4c28-9b92-a82d7b7bb31b tempest-VolumesTransfersTest-1370844302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1d320cd1-6c1b-468e-932c-8af1e1a11569 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:09 devstack sudo[95977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1d320cd1-6c1b-468e-932c-8af1e1a11569
Nov 06 11:49:09 devstack sudo[95977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:10 devstack sudo[95977]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e44d3519-b4bc-4c28-9b92-a82d7b7bb31b tempest-VolumesTransfersTest-1370844302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1d320cd1-6c1b-468e-932c-8af1e1a11569" returned: 0 in 0.884s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:10 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e44d3519-b4bc-4c28-9b92-a82d7b7bb31b tempest-VolumesTransfersTest-1370844302 None] Lock "cinder-quobyte-1d320cd1-6c1b-468e-932c-8af1e1a11569" released by "delete_volume" :: held 1.591s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:49:10 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-e44d3519-b4bc-4c28-9b92-a82d7b7bb31b tempest-VolumesTransfersTest-1370844302 None] Created reservations ['0a53cf2d-84c2-4b69-a8c0-6215c39d0a84', '6a099925-c919-4904-9b91-55915b87763b', 'f14d28cb-ae72-4093-befc-71a601bc1985', '2dfadd40-15ff-4c01-8857-134d825597fa'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:49:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e44d3519-b4bc-4c28-9b92-a82d7b7bb31b tempest-VolumesTransfersTest-1370844302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:49:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e44d3519-b4bc-4c28-9b92-a82d7b7bb31b tempest-VolumesTransfersTest-1370844302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:49:11 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-e44d3519-b4bc-4c28-9b92-a82d7b7bb31b tempest-VolumesTransfersTest-1370844302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:49:11 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-e44d3519-b4bc-4c28-9b92-a82d7b7bb31b tempest-VolumesTransfersTest-1370844302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:49:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e44d3519-b4bc-4c28-9b92-a82d7b7bb31b tempest-VolumesTransfersTest-1370844302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:49:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e44d3519-b4bc-4c28-9b92-a82d7b7bb31b tempest-VolumesTransfersTest-1370844302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:11 devstack sudo[95984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:49:11 devstack sudo[95984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:11 devstack sudo[95984]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e44d3519-b4bc-4c28-9b92-a82d7b7bb31b tempest-VolumesTransfersTest-1370844302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.384s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:11 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-e44d3519-b4bc-4c28-9b92-a82d7b7bb31b tempest-VolumesTransfersTest-1370844302 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:49:11 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-e44d3519-b4bc-4c28-9b92-a82d7b7bb31b tempest-VolumesTransfersTest-1370844302 None] Deleted volume successfully.
Nov 06 11:49:11 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e44d3519-b4bc-4c28-9b92-a82d7b7bb31b tempest-VolumesTransfersTest-1370844302 None] Lock "cinder-1d320cd1-6c1b-468e-932c-8af1e1a11569-delete_volume" released by "delete_volume" :: held 2.398s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:49:12 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7f621c0-1c1b-4d87-9e19-29cffe9d749a tempest-VolumesTransfersTest-225064145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:49:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b7f621c0-1c1b-4d87-9e19-29cffe9d749a tempest-VolumesTransfersTest-225064145 None] Flow 'volume_create_manager' (3af063a6-e5e6-4d21-a8e0-881424b80d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:49:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b7f621c0-1c1b-4d87-9e19-29cffe9d749a tempest-VolumesTransfersTest-225064145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40161e5d-5e9f-4292-8b61-22c841b85523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b7f621c0-1c1b-4d87-9e19-29cffe9d749a tempest-VolumesTransfersTest-225064145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40161e5d-5e9f-4292-8b61-22c841b85523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:49:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2072860644',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f750a4d-80d0-448c-bbae-0f123546c6ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1eee33968dd4e129da050822f4e2ac1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:49:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:49:13Z,use_quota=True,user_id='bf300a745d954d0d8deb9de7b6de7c47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b7f621c0-1c1b-4d87-9e19-29cffe9d749a tempest-VolumesTransfersTest-225064145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (796003ab-146f-4713-8e92-1fcdb31ea886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b7f621c0-1c1b-4d87-9e19-29cffe9d749a tempest-VolumesTransfersTest-225064145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (796003ab-146f-4713-8e92-1fcdb31ea886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b7f621c0-1c1b-4d87-9e19-29cffe9d749a tempest-VolumesTransfersTest-225064145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1450333-a06e-4431-b948-26f1aecdedc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b7f621c0-1c1b-4d87-9e19-29cffe9d749a tempest-VolumesTransfersTest-225064145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1450333-a06e-4431-b948-26f1aecdedc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f750a4d-80d0-448c-bbae-0f123546c6ce', 'volume_name': 'volume-3f750a4d-80d0-448c-bbae-0f123546c6ce', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b7f621c0-1c1b-4d87-9e19-29cffe9d749a tempest-VolumesTransfersTest-225064145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bab60ac-9046-42eb-a6d1-317d938583ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b7f621c0-1c1b-4d87-9e19-29cffe9d749a tempest-VolumesTransfersTest-225064145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bab60ac-9046-42eb-a6d1-317d938583ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b7f621c0-1c1b-4d87-9e19-29cffe9d749a tempest-VolumesTransfersTest-225064145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3699f27-d952-4bd4-9f6f-b0afcd08cd6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:13 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-b7f621c0-1c1b-4d87-9e19-29cffe9d749a tempest-VolumesTransfersTest-225064145 None] Volume 3f750a4d-80d0-448c-bbae-0f123546c6ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f750a4d-80d0-448c-bbae-0f123546c6ce', 'volume_size': 1}
Nov 06 11:49:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b7f621c0-1c1b-4d87-9e19-29cffe9d749a tempest-VolumesTransfersTest-225064145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:49:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b7f621c0-1c1b-4d87-9e19-29cffe9d749a tempest-VolumesTransfersTest-225064145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:49:13 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b7f621c0-1c1b-4d87-9e19-29cffe9d749a tempest-VolumesTransfersTest-225064145 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:49:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2072860644',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f750a4d-80d0-448c-bbae-0f123546c6ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1eee33968dd4e129da050822f4e2ac1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:49:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:49:13Z,use_quota=True,user_id='bf300a745d954d0d8deb9de7b6de7c47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:49:13 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-b7f621c0-1c1b-4d87-9e19-29cffe9d749a tempest-VolumesTransfersTest-225064145 None] Creating volume 3f750a4d-80d0-448c-bbae-0f123546c6ce {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:49:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b7f621c0-1c1b-4d87-9e19-29cffe9d749a tempest-VolumesTransfersTest-225064145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:49:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b7f621c0-1c1b-4d87-9e19-29cffe9d749a tempest-VolumesTransfersTest-225064145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:49:13 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b7f621c0-1c1b-4d87-9e19-29cffe9d749a tempest-VolumesTransfersTest-225064145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:49:13 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b7f621c0-1c1b-4d87-9e19-29cffe9d749a tempest-VolumesTransfersTest-225064145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:49:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b7f621c0-1c1b-4d87-9e19-29cffe9d749a tempest-VolumesTransfersTest-225064145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:49:13 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b7f621c0-1c1b-4d87-9e19-29cffe9d749a tempest-VolumesTransfersTest-225064145 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:49:13 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-b7f621c0-1c1b-4d87-9e19-29cffe9d749a tempest-VolumesTransfersTest-225064145 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:49:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b7f621c0-1c1b-4d87-9e19-29cffe9d749a tempest-VolumesTransfersTest-225064145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3f750a4d-80d0-448c-bbae-0f123546c6ce 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:13 devstack sudo[95988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3f750a4d-80d0-448c-bbae-0f123546c6ce 1073741824
Nov 06 11:49:13 devstack sudo[95988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:14 devstack sudo[95988]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b7f621c0-1c1b-4d87-9e19-29cffe9d749a tempest-VolumesTransfersTest-225064145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3f750a4d-80d0-448c-bbae-0f123546c6ce 1073741824" returned: 0 in 1.216s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b7f621c0-1c1b-4d87-9e19-29cffe9d749a tempest-VolumesTransfersTest-225064145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3f750a4d-80d0-448c-bbae-0f123546c6ce {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:14 devstack sudo[95995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3f750a4d-80d0-448c-bbae-0f123546c6ce
Nov 06 11:49:14 devstack sudo[95995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:15 devstack sudo[95995]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b7f621c0-1c1b-4d87-9e19-29cffe9d749a tempest-VolumesTransfersTest-225064145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3f750a4d-80d0-448c-bbae-0f123546c6ce" returned: 0 in 0.724s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:15 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b7f621c0-1c1b-4d87-9e19-29cffe9d749a tempest-VolumesTransfersTest-225064145 None] <== create_volume: return (2038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:49:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b7f621c0-1c1b-4d87-9e19-29cffe9d749a tempest-VolumesTransfersTest-225064145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.042s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:49:15 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b7f621c0-1c1b-4d87-9e19-29cffe9d749a tempest-VolumesTransfersTest-225064145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3699f27-d952-4bd4-9f6f-b0afcd08cd6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f750a4d-80d0-448c-bbae-0f123546c6ce', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:15 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b7f621c0-1c1b-4d87-9e19-29cffe9d749a tempest-VolumesTransfersTest-225064145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58ceb12d-9b90-473e-bbe5-212bd0e6b787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:15 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-b7f621c0-1c1b-4d87-9e19-29cffe9d749a tempest-VolumesTransfersTest-225064145 None] Volume volume-3f750a4d-80d0-448c-bbae-0f123546c6ce (3f750a4d-80d0-448c-bbae-0f123546c6ce): created successfully
Nov 06 11:49:15 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b7f621c0-1c1b-4d87-9e19-29cffe9d749a tempest-VolumesTransfersTest-225064145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58ceb12d-9b90-473e-bbe5-212bd0e6b787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:15 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b7f621c0-1c1b-4d87-9e19-29cffe9d749a tempest-VolumesTransfersTest-225064145 None] Flow 'volume_create_manager' (3af063a6-e5e6-4d21-a8e0-881424b80d7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:49:15 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-b7f621c0-1c1b-4d87-9e19-29cffe9d749a tempest-VolumesTransfersTest-225064145 None] Created volume successfully.
Nov 06 11:49:15 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-02da1211-0ca9-45f9-b02f-0277a4db040c tempest-SnapshotMetadataTestJSON-911780222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:49:15 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-02da1211-0ca9-45f9-b02f-0277a4db040c tempest-SnapshotMetadataTestJSON-911780222 None] Flow 'volume_create_manager' (cf0999be-f232-4148-8be2-cdcdb77125d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:49:15 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-02da1211-0ca9-45f9-b02f-0277a4db040c tempest-SnapshotMetadataTestJSON-911780222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e5d73a7-d30f-413b-8894-51adec82758a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:15 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-02da1211-0ca9-45f9-b02f-0277a4db040c tempest-SnapshotMetadataTestJSON-911780222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e5d73a7-d30f-413b-8894-51adec82758a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:49:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-233446693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=188383cf-ed00-4fe6-8d12-7a0bf56db589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d918a334623409cbe9ff10455a18998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:49:16Z,use_quota=True,user_id='90a74de76f0e4cca97118e26321a7f43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:15 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-02da1211-0ca9-45f9-b02f-0277a4db040c tempest-SnapshotMetadataTestJSON-911780222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b283ab9a-fd5c-482f-b3c2-3385aa624d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:15 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-02da1211-0ca9-45f9-b02f-0277a4db040c tempest-SnapshotMetadataTestJSON-911780222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b283ab9a-fd5c-482f-b3c2-3385aa624d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:15 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-02da1211-0ca9-45f9-b02f-0277a4db040c tempest-SnapshotMetadataTestJSON-911780222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f39c01b-c270-4055-a85b-460261f97e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:15 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-02da1211-0ca9-45f9-b02f-0277a4db040c tempest-SnapshotMetadataTestJSON-911780222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f39c01b-c270-4055-a85b-460261f97e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '188383cf-ed00-4fe6-8d12-7a0bf56db589', 'volume_name': 'volume-188383cf-ed00-4fe6-8d12-7a0bf56db589', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:15 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-02da1211-0ca9-45f9-b02f-0277a4db040c tempest-SnapshotMetadataTestJSON-911780222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12d28064-39eb-4583-bdce-8551abbfe798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:15 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-02da1211-0ca9-45f9-b02f-0277a4db040c tempest-SnapshotMetadataTestJSON-911780222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12d28064-39eb-4583-bdce-8551abbfe798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:15 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-02da1211-0ca9-45f9-b02f-0277a4db040c tempest-SnapshotMetadataTestJSON-911780222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de0336cd-8b73-478b-92df-bdb36ce873a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:15 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-02da1211-0ca9-45f9-b02f-0277a4db040c tempest-SnapshotMetadataTestJSON-911780222 None] Volume 188383cf-ed00-4fe6-8d12-7a0bf56db589: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-188383cf-ed00-4fe6-8d12-7a0bf56db589', 'volume_size': 1}
Nov 06 11:49:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-02da1211-0ca9-45f9-b02f-0277a4db040c tempest-SnapshotMetadataTestJSON-911780222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:49:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-02da1211-0ca9-45f9-b02f-0277a4db040c tempest-SnapshotMetadataTestJSON-911780222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:49:15 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-02da1211-0ca9-45f9-b02f-0277a4db040c tempest-SnapshotMetadataTestJSON-911780222 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:49:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-233446693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=188383cf-ed00-4fe6-8d12-7a0bf56db589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d918a334623409cbe9ff10455a18998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:49:16Z,use_quota=True,user_id='90a74de76f0e4cca97118e26321a7f43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:49:15 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-02da1211-0ca9-45f9-b02f-0277a4db040c tempest-SnapshotMetadataTestJSON-911780222 None] Creating volume 188383cf-ed00-4fe6-8d12-7a0bf56db589 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:49:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-02da1211-0ca9-45f9-b02f-0277a4db040c tempest-SnapshotMetadataTestJSON-911780222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:49:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-02da1211-0ca9-45f9-b02f-0277a4db040c tempest-SnapshotMetadataTestJSON-911780222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:49:15 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-02da1211-0ca9-45f9-b02f-0277a4db040c tempest-SnapshotMetadataTestJSON-911780222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:49:15 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-02da1211-0ca9-45f9-b02f-0277a4db040c tempest-SnapshotMetadataTestJSON-911780222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:49:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-02da1211-0ca9-45f9-b02f-0277a4db040c tempest-SnapshotMetadataTestJSON-911780222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:49:15 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-02da1211-0ca9-45f9-b02f-0277a4db040c tempest-SnapshotMetadataTestJSON-911780222 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:49:15 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-02da1211-0ca9-45f9-b02f-0277a4db040c tempest-SnapshotMetadataTestJSON-911780222 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:49:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-02da1211-0ca9-45f9-b02f-0277a4db040c tempest-SnapshotMetadataTestJSON-911780222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-188383cf-ed00-4fe6-8d12-7a0bf56db589 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:15 devstack sudo[96014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-188383cf-ed00-4fe6-8d12-7a0bf56db589 1073741824
Nov 06 11:49:15 devstack sudo[96014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:16 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5dcdca07-8672-450f-a1a1-decc7cdd0dfd tempest-VolumesTransfersTest-1370844302 None] Acquiring lock "cinder-3f750a4d-80d0-448c-bbae-0f123546c6ce-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:49:16 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5dcdca07-8672-450f-a1a1-decc7cdd0dfd tempest-VolumesTransfersTest-1370844302 None] Lock "cinder-3f750a4d-80d0-448c-bbae-0f123546c6ce-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:49:16 devstack sudo[96014]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:16 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5dcdca07-8672-450f-a1a1-decc7cdd0dfd tempest-VolumesTransfersTest-1370844302 None] Acquiring lock "cinder-quobyte-3f750a4d-80d0-448c-bbae-0f123546c6ce" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:49:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-02da1211-0ca9-45f9-b02f-0277a4db040c tempest-SnapshotMetadataTestJSON-911780222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-188383cf-ed00-4fe6-8d12-7a0bf56db589 1073741824" returned: 0 in 0.903s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:16 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5dcdca07-8672-450f-a1a1-decc7cdd0dfd tempest-VolumesTransfersTest-1370844302 None] Lock "cinder-quobyte-3f750a4d-80d0-448c-bbae-0f123546c6ce" acquired by "delete_volume" :: waited 0.047s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:49:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-02da1211-0ca9-45f9-b02f-0277a4db040c tempest-SnapshotMetadataTestJSON-911780222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-188383cf-ed00-4fe6-8d12-7a0bf56db589 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:16 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da487c7-a4b8-4d5e-8fa0-14f5a4a8469e]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:49:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5dcdca07-8672-450f-a1a1-decc7cdd0dfd tempest-VolumesTransfersTest-1370844302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3f750a4d-80d0-448c-bbae-0f123546c6ce {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:16 devstack sudo[96041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-188383cf-ed00-4fe6-8d12-7a0bf56db589
Nov 06 11:49:16 devstack sudo[96041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:17 devstack sudo[96043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3f750a4d-80d0-448c-bbae-0f123546c6ce
Nov 06 11:49:17 devstack sudo[96043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:17 devstack cinder-volume[87165]: DEBUG oslo_service.periodic_task [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 11:49:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:49:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:49:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:49:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:49:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:49:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:17 devstack sudo[96045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:49:17 devstack sudo[96045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:17 devstack sudo[96041]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-02da1211-0ca9-45f9-b02f-0277a4db040c tempest-SnapshotMetadataTestJSON-911780222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-188383cf-ed00-4fe6-8d12-7a0bf56db589" returned: 0 in 0.575s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-02da1211-0ca9-45f9-b02f-0277a4db040c tempest-SnapshotMetadataTestJSON-911780222 None] <== create_volume: return (1574ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:49:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-02da1211-0ca9-45f9-b02f-0277a4db040c tempest-SnapshotMetadataTestJSON-911780222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:49:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-02da1211-0ca9-45f9-b02f-0277a4db040c tempest-SnapshotMetadataTestJSON-911780222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de0336cd-8b73-478b-92df-bdb36ce873a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-188383cf-ed00-4fe6-8d12-7a0bf56db589', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-02da1211-0ca9-45f9-b02f-0277a4db040c tempest-SnapshotMetadataTestJSON-911780222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37fcc32a-c92d-4f54-bbf9-84663caa5514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:17 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-02da1211-0ca9-45f9-b02f-0277a4db040c tempest-SnapshotMetadataTestJSON-911780222 None] Volume volume-188383cf-ed00-4fe6-8d12-7a0bf56db589 (188383cf-ed00-4fe6-8d12-7a0bf56db589): created successfully
Nov 06 11:49:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-02da1211-0ca9-45f9-b02f-0277a4db040c tempest-SnapshotMetadataTestJSON-911780222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37fcc32a-c92d-4f54-bbf9-84663caa5514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-02da1211-0ca9-45f9-b02f-0277a4db040c tempest-SnapshotMetadataTestJSON-911780222 None] Flow 'volume_create_manager' (cf0999be-f232-4148-8be2-cdcdb77125d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:49:17 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-02da1211-0ca9-45f9-b02f-0277a4db040c tempest-SnapshotMetadataTestJSON-911780222 None] Created volume successfully.
Nov 06 11:49:17 devstack sudo[96045]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.705s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:17 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:49:17 devstack cinder-volume[87165]: DEBUG oslo_service.periodic_task [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running periodic task VolumeManager._thread_info {{(pid=87165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 11:49:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] thread count: 28 {{(pid=87165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 11:49:17 devstack sudo[96043]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] thread info: [<_MainThread(MainThread, started 127732956901504)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127732842693056)>, <Thread(Thread-3 (stat_writer), started daemon 127732841891136)>, <Thread(Rabbit-heartbeat, started daemon 127732842515648)>, <Thread(Thread-5 (_runner), started daemon 127732840534464)>, <Thread(Thread-7 (_runner), started daemon 127732840636032)>, <Thread(fd_logger, started daemon 127732838664256)>, <Thread(privsep_reader, started daemon 127732838673408)>, <Thread(tpool_thread_0, started daemon 127732829828800)>, <Thread(tpool_thread_1, started daemon 127732821436096)>, <Thread(tpool_thread_2, started daemon 127732813043392)>, <Thread(tpool_thread_3, started daemon 127732804650688)>, <Thread(tpool_thread_4, started daemon 127732796257984)>, <Thread(tpool_thread_5, started daemon 127732787865280)>, <Thread(tpool_thread_6, started daemon 127732779456192)>, <Thread(tpool_thread_7, started daemon 127732771047104)>, <Thread(tpool_thread_8, started daemon 127732762638016)>, <Thread(tpool_thread_9, started daemon 127732754228928)>, <Thread(tpool_thread_10, started daemon 127732745819840)>, <Thread(tpool_thread_11, started daemon 127732737410752)>, <Thread(tpool_thread_12, started daemon 127732729001664)>, <Thread(tpool_thread_13, started daemon 127732720592576)>, <Thread(tpool_thread_14, started daemon 127732712183488)>, <Thread(tpool_thread_15, started daemon 127732703774400)>, <Thread(tpool_thread_16, started daemon 127732695365312)>, <Thread(tpool_thread_17, started daemon 127732686956224)>, <Thread(tpool_thread_18, started daemon 127732678547136)>, <Thread(tpool_thread_19, started daemon 127732670138048)>] {{(pid=87165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 11:49:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5dcdca07-8672-450f-a1a1-decc7cdd0dfd tempest-VolumesTransfersTest-1370844302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3f750a4d-80d0-448c-bbae-0f123546c6ce" returned: 0 in 1.069s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5dcdca07-8672-450f-a1a1-decc7cdd0dfd tempest-VolumesTransfersTest-1370844302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3f750a4d-80d0-448c-bbae-0f123546c6ce {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:17 devstack sudo[96053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3f750a4d-80d0-448c-bbae-0f123546c6ce
Nov 06 11:49:17 devstack sudo[96053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-91d9d5c6-0768-4880-ad97-6439e38068a9 tempest-SnapshotMetadataTestJSON-911780222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:49:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-91d9d5c6-0768-4880-ad97-6439e38068a9 tempest-SnapshotMetadataTestJSON-911780222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:49:18 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-91d9d5c6-0768-4880-ad97-6439e38068a9 tempest-SnapshotMetadataTestJSON-911780222 None] Creating offline snapshot c524ebc7-55cc-40bf-a394-681c5f9f6d45 of volume 188383cf-ed00-4fe6-8d12-7a0bf56db589 {{(pid=87165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 11:49:18 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f202070-93f2-4f67-a71b-7c21531a974a]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:49:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-91d9d5c6-0768-4880-ad97-6439e38068a9 tempest-SnapshotMetadataTestJSON-911780222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-188383cf-ed00-4fe6-8d12-7a0bf56db589 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:18 devstack sudo[96053]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5dcdca07-8672-450f-a1a1-decc7cdd0dfd tempest-VolumesTransfersTest-1370844302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3f750a4d-80d0-448c-bbae-0f123546c6ce" returned: 0 in 0.675s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:18 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5dcdca07-8672-450f-a1a1-decc7cdd0dfd tempest-VolumesTransfersTest-1370844302 None] Lock "cinder-quobyte-3f750a4d-80d0-448c-bbae-0f123546c6ce" released by "delete_volume" :: held 1.860s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:49:18 devstack sudo[96055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-188383cf-ed00-4fe6-8d12-7a0bf56db589
Nov 06 11:49:18 devstack sudo[96055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:18 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-5dcdca07-8672-450f-a1a1-decc7cdd0dfd tempest-VolumesTransfersTest-1370844302 None] Created reservations ['1e4f976d-96a9-4404-b99f-0cccc1cf4d84', '5324fb4b-71bd-415f-b45e-68fbdfd64592', '7c543dc0-ef1f-4da8-be6b-7523bc3c87c8', '2f84a7d2-6f16-4cdd-b1ce-6f4a083154d5'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:49:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5dcdca07-8672-450f-a1a1-decc7cdd0dfd tempest-VolumesTransfersTest-1370844302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:49:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5dcdca07-8672-450f-a1a1-decc7cdd0dfd tempest-VolumesTransfersTest-1370844302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:49:18 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5dcdca07-8672-450f-a1a1-decc7cdd0dfd tempest-VolumesTransfersTest-1370844302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:49:18 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5dcdca07-8672-450f-a1a1-decc7cdd0dfd tempest-VolumesTransfersTest-1370844302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:49:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5dcdca07-8672-450f-a1a1-decc7cdd0dfd tempest-VolumesTransfersTest-1370844302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:49:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5dcdca07-8672-450f-a1a1-decc7cdd0dfd tempest-VolumesTransfersTest-1370844302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:18 devstack sudo[96058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:49:18 devstack sudo[96058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:19 devstack sudo[96055]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-91d9d5c6-0768-4880-ad97-6439e38068a9 tempest-SnapshotMetadataTestJSON-911780222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-188383cf-ed00-4fe6-8d12-7a0bf56db589" returned: 0 in 0.927s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-91d9d5c6-0768-4880-ad97-6439e38068a9 tempest-SnapshotMetadataTestJSON-911780222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-188383cf-ed00-4fe6-8d12-7a0bf56db589,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-188383cf-ed00-4fe6-8d12-7a0bf56db589.c524ebc7-55cc-40bf-a394-681c5f9f6d45 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:19 devstack sudo[96058]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:19 devstack sudo[96064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-188383cf-ed00-4fe6-8d12-7a0bf56db589,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-188383cf-ed00-4fe6-8d12-7a0bf56db589.c524ebc7-55cc-40bf-a394-681c5f9f6d45 1G
Nov 06 11:49:19 devstack sudo[96064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5dcdca07-8672-450f-a1a1-decc7cdd0dfd tempest-VolumesTransfersTest-1370844302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.631s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:19 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-5dcdca07-8672-450f-a1a1-decc7cdd0dfd tempest-VolumesTransfersTest-1370844302 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:49:19 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-5dcdca07-8672-450f-a1a1-decc7cdd0dfd tempest-VolumesTransfersTest-1370844302 None] Deleted volume successfully.
Nov 06 11:49:19 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5dcdca07-8672-450f-a1a1-decc7cdd0dfd tempest-VolumesTransfersTest-1370844302 None] Lock "cinder-3f750a4d-80d0-448c-bbae-0f123546c6ce-delete_volume" released by "delete_volume" :: held 2.961s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:49:20 devstack sudo[96064]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-91d9d5c6-0768-4880-ad97-6439e38068a9 tempest-SnapshotMetadataTestJSON-911780222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-188383cf-ed00-4fe6-8d12-7a0bf56db589,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-188383cf-ed00-4fe6-8d12-7a0bf56db589.c524ebc7-55cc-40bf-a394-681c5f9f6d45 1G" returned: 0 in 1.251s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-91d9d5c6-0768-4880-ad97-6439e38068a9 tempest-SnapshotMetadataTestJSON-911780222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-188383cf-ed00-4fe6-8d12-7a0bf56db589 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-188383cf-ed00-4fe6-8d12-7a0bf56db589.c524ebc7-55cc-40bf-a394-681c5f9f6d45 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:20 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-69c523c4-037d-4e5a-88d0-812032eb8fe3 tempest-ServerRescueNegativeTestJSON-1404270336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:49:20 devstack sudo[96071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-188383cf-ed00-4fe6-8d12-7a0bf56db589 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-188383cf-ed00-4fe6-8d12-7a0bf56db589.c524ebc7-55cc-40bf-a394-681c5f9f6d45
Nov 06 11:49:20 devstack sudo[96071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:20 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-69c523c4-037d-4e5a-88d0-812032eb8fe3 tempest-ServerRescueNegativeTestJSON-1404270336 None] Flow 'volume_create_manager' (99270d88-2429-4b23-b325-14a588cde924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:49:20 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-69c523c4-037d-4e5a-88d0-812032eb8fe3 tempest-ServerRescueNegativeTestJSON-1404270336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f47b85a-6908-4db8-9cab-d64fc9e2dcf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:20 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-69c523c4-037d-4e5a-88d0-812032eb8fe3 tempest-ServerRescueNegativeTestJSON-1404270336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f47b85a-6908-4db8-9cab-d64fc9e2dcf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:49:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-97398139',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01f507f7-0a4a-4bb2-b1b3-ce558e319430,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='083f9fad2f4c49e3b5476de3b2e916dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:49:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:49:21Z,use_quota=True,user_id='cbbf059ab0504454a3b45deea8b65c22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:20 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-69c523c4-037d-4e5a-88d0-812032eb8fe3 tempest-ServerRescueNegativeTestJSON-1404270336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48036adb-81a6-4511-aff7-70f5daea978e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:20 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-69c523c4-037d-4e5a-88d0-812032eb8fe3 tempest-ServerRescueNegativeTestJSON-1404270336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48036adb-81a6-4511-aff7-70f5daea978e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:20 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-69c523c4-037d-4e5a-88d0-812032eb8fe3 tempest-ServerRescueNegativeTestJSON-1404270336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cb20371-ec50-40ae-b855-ea82aaba2f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:20 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-69c523c4-037d-4e5a-88d0-812032eb8fe3 tempest-ServerRescueNegativeTestJSON-1404270336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cb20371-ec50-40ae-b855-ea82aaba2f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01f507f7-0a4a-4bb2-b1b3-ce558e319430', 'volume_name': 'volume-01f507f7-0a4a-4bb2-b1b3-ce558e319430', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:20 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-69c523c4-037d-4e5a-88d0-812032eb8fe3 tempest-ServerRescueNegativeTestJSON-1404270336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8b73054-7b38-458a-8348-f669023cc421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:20 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-69c523c4-037d-4e5a-88d0-812032eb8fe3 tempest-ServerRescueNegativeTestJSON-1404270336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8b73054-7b38-458a-8348-f669023cc421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:20 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-69c523c4-037d-4e5a-88d0-812032eb8fe3 tempest-ServerRescueNegativeTestJSON-1404270336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04064f62-0f1a-4895-ac04-4997deddbd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:20 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-69c523c4-037d-4e5a-88d0-812032eb8fe3 tempest-ServerRescueNegativeTestJSON-1404270336 None] Volume 01f507f7-0a4a-4bb2-b1b3-ce558e319430: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01f507f7-0a4a-4bb2-b1b3-ce558e319430', 'volume_size': 1}
Nov 06 11:49:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-69c523c4-037d-4e5a-88d0-812032eb8fe3 tempest-ServerRescueNegativeTestJSON-1404270336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:49:21 devstack sudo[96071]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-91d9d5c6-0768-4880-ad97-6439e38068a9 tempest-SnapshotMetadataTestJSON-911780222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-188383cf-ed00-4fe6-8d12-7a0bf56db589 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-188383cf-ed00-4fe6-8d12-7a0bf56db589.c524ebc7-55cc-40bf-a394-681c5f9f6d45" returned: 0 in 0.629s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:21 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-91d9d5c6-0768-4880-ad97-6439e38068a9 tempest-SnapshotMetadataTestJSON-911780222 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-188383cf-ed00-4fe6-8d12-7a0bf56db589.c524ebc7-55cc-40bf-a394-681c5f9f6d45 is being set with open permissions: ugo+rw
Nov 06 11:49:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-91d9d5c6-0768-4880-ad97-6439e38068a9 tempest-SnapshotMetadataTestJSON-911780222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-188383cf-ed00-4fe6-8d12-7a0bf56db589.c524ebc7-55cc-40bf-a394-681c5f9f6d45 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:21 devstack sudo[96090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-188383cf-ed00-4fe6-8d12-7a0bf56db589.c524ebc7-55cc-40bf-a394-681c5f9f6d45
Nov 06 11:49:21 devstack sudo[96090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:21 devstack sudo[96090]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-91d9d5c6-0768-4880-ad97-6439e38068a9 tempest-SnapshotMetadataTestJSON-911780222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-188383cf-ed00-4fe6-8d12-7a0bf56db589.c524ebc7-55cc-40bf-a394-681c5f9f6d45" returned: 0 in 0.565s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-91d9d5c6-0768-4880-ad97-6439e38068a9 tempest-SnapshotMetadataTestJSON-911780222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-188383cf-ed00-4fe6-8d12-7a0bf56db589.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:21 devstack sudo[96093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-188383cf-ed00-4fe6-8d12-7a0bf56db589.info
Nov 06 11:49:21 devstack sudo[96093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:22 devstack sudo[96093]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-91d9d5c6-0768-4880-ad97-6439e38068a9 tempest-SnapshotMetadataTestJSON-911780222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-188383cf-ed00-4fe6-8d12-7a0bf56db589.info" returned: 0 in 0.331s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:22 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-91d9d5c6-0768-4880-ad97-6439e38068a9 tempest-SnapshotMetadataTestJSON-911780222 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-188383cf-ed00-4fe6-8d12-7a0bf56db589.info is being set with open permissions: ugo+rw
Nov 06 11:49:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-91d9d5c6-0768-4880-ad97-6439e38068a9 tempest-SnapshotMetadataTestJSON-911780222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-188383cf-ed00-4fe6-8d12-7a0bf56db589.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:22 devstack sudo[96096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-188383cf-ed00-4fe6-8d12-7a0bf56db589.info
Nov 06 11:49:22 devstack sudo[96096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:22 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-aac5390a-8ec7-411b-91a6-3ab61a9a2929 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:49:22 devstack sudo[96096]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:22 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-aac5390a-8ec7-411b-91a6-3ab61a9a2929 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Flow 'volume_create_manager' (c21bb904-384d-4066-af13-75e20eeea770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:49:22 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-aac5390a-8ec7-411b-91a6-3ab61a9a2929 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f61c5552-115c-4749-8d31-fd9ae8acc88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-91d9d5c6-0768-4880-ad97-6439e38068a9 tempest-SnapshotMetadataTestJSON-911780222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-188383cf-ed00-4fe6-8d12-7a0bf56db589.info" returned: 0 in 0.505s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-91d9d5c6-0768-4880-ad97-6439e38068a9 tempest-SnapshotMetadataTestJSON-911780222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.372s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:49:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-69c523c4-037d-4e5a-88d0-812032eb8fe3 tempest-ServerRescueNegativeTestJSON-1404270336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.837s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:49:22 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-69c523c4-037d-4e5a-88d0-812032eb8fe3 tempest-ServerRescueNegativeTestJSON-1404270336 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:49:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-97398139',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01f507f7-0a4a-4bb2-b1b3-ce558e319430,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='083f9fad2f4c49e3b5476de3b2e916dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:49:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:49:21Z,use_quota=True,user_id='cbbf059ab0504454a3b45deea8b65c22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:49:22 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-69c523c4-037d-4e5a-88d0-812032eb8fe3 tempest-ServerRescueNegativeTestJSON-1404270336 None] Creating volume 01f507f7-0a4a-4bb2-b1b3-ce558e319430 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:49:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-69c523c4-037d-4e5a-88d0-812032eb8fe3 tempest-ServerRescueNegativeTestJSON-1404270336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:49:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-69c523c4-037d-4e5a-88d0-812032eb8fe3 tempest-ServerRescueNegativeTestJSON-1404270336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:49:22 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-69c523c4-037d-4e5a-88d0-812032eb8fe3 tempest-ServerRescueNegativeTestJSON-1404270336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:49:22 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-69c523c4-037d-4e5a-88d0-812032eb8fe3 tempest-ServerRescueNegativeTestJSON-1404270336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:49:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-69c523c4-037d-4e5a-88d0-812032eb8fe3 tempest-ServerRescueNegativeTestJSON-1404270336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:49:22 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-69c523c4-037d-4e5a-88d0-812032eb8fe3 tempest-ServerRescueNegativeTestJSON-1404270336 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:49:22 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-69c523c4-037d-4e5a-88d0-812032eb8fe3 tempest-ServerRescueNegativeTestJSON-1404270336 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:49:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-69c523c4-037d-4e5a-88d0-812032eb8fe3 tempest-ServerRescueNegativeTestJSON-1404270336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-01f507f7-0a4a-4bb2-b1b3-ce558e319430 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:22 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-aac5390a-8ec7-411b-91a6-3ab61a9a2929 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f61c5552-115c-4749-8d31-fd9ae8acc88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1216257319',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dac05608-2a94-4d1d-8a5e-ae26e4307b16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c4a5d039ff64e359b4990f6f52b7363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:49:23Z,use_quota=True,user_id='5b7a8dc0533e47eaaf9cc3eb56cdf64a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:22 devstack sudo[96099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-01f507f7-0a4a-4bb2-b1b3-ce558e319430 1073741824
Nov 06 11:49:22 devstack sudo[96099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:22 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-aac5390a-8ec7-411b-91a6-3ab61a9a2929 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe244b8-2c38-4394-97ec-98ccbe60ef2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:22 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-aac5390a-8ec7-411b-91a6-3ab61a9a2929 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe244b8-2c38-4394-97ec-98ccbe60ef2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:22 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-aac5390a-8ec7-411b-91a6-3ab61a9a2929 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f4d782a-00d2-4943-bec2-94b4c4e28ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:22 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-aac5390a-8ec7-411b-91a6-3ab61a9a2929 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f4d782a-00d2-4943-bec2-94b4c4e28ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dac05608-2a94-4d1d-8a5e-ae26e4307b16', 'volume_name': 'volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:22 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-aac5390a-8ec7-411b-91a6-3ab61a9a2929 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0918d289-f2d0-4705-8886-bfed5c096341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:22 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-aac5390a-8ec7-411b-91a6-3ab61a9a2929 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0918d289-f2d0-4705-8886-bfed5c096341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:22 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-aac5390a-8ec7-411b-91a6-3ab61a9a2929 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8130b87d-5c8f-4ba2-8813-e6c819b2f353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:22 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-aac5390a-8ec7-411b-91a6-3ab61a9a2929 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Volume dac05608-2a94-4d1d-8a5e-ae26e4307b16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16', 'volume_size': 1}
Nov 06 11:49:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-aac5390a-8ec7-411b-91a6-3ab61a9a2929 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:49:22 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-91d9d5c6-0768-4880-ad97-6439e38068a9 tempest-SnapshotMetadataTestJSON-911780222 None] Create snapshot completed successfully
Nov 06 11:49:23 devstack sudo[96099]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-69c523c4-037d-4e5a-88d0-812032eb8fe3 tempest-ServerRescueNegativeTestJSON-1404270336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-01f507f7-0a4a-4bb2-b1b3-ce558e319430 1073741824" returned: 0 in 0.566s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-69c523c4-037d-4e5a-88d0-812032eb8fe3 tempest-ServerRescueNegativeTestJSON-1404270336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-01f507f7-0a4a-4bb2-b1b3-ce558e319430 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:23 devstack sudo[96105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-01f507f7-0a4a-4bb2-b1b3-ce558e319430
Nov 06 11:49:23 devstack sudo[96105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:23 devstack sudo[96105]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-69c523c4-037d-4e5a-88d0-812032eb8fe3 tempest-ServerRescueNegativeTestJSON-1404270336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-01f507f7-0a4a-4bb2-b1b3-ce558e319430" returned: 0 in 0.366s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:23 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-69c523c4-037d-4e5a-88d0-812032eb8fe3 tempest-ServerRescueNegativeTestJSON-1404270336 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:49:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-69c523c4-037d-4e5a-88d0-812032eb8fe3 tempest-ServerRescueNegativeTestJSON-1404270336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:49:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-aac5390a-8ec7-411b-91a6-3ab61a9a2929 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.914s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:49:23 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-aac5390a-8ec7-411b-91a6-3ab61a9a2929 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1216257319',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dac05608-2a94-4d1d-8a5e-ae26e4307b16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c4a5d039ff64e359b4990f6f52b7363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:49:23Z,use_quota=True,user_id='5b7a8dc0533e47eaaf9cc3eb56cdf64a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:49:23 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-aac5390a-8ec7-411b-91a6-3ab61a9a2929 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Creating volume dac05608-2a94-4d1d-8a5e-ae26e4307b16 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:49:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-aac5390a-8ec7-411b-91a6-3ab61a9a2929 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:49:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-aac5390a-8ec7-411b-91a6-3ab61a9a2929 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:49:23 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-aac5390a-8ec7-411b-91a6-3ab61a9a2929 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:49:23 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-aac5390a-8ec7-411b-91a6-3ab61a9a2929 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:49:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-aac5390a-8ec7-411b-91a6-3ab61a9a2929 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:49:23 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-aac5390a-8ec7-411b-91a6-3ab61a9a2929 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:49:23 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-aac5390a-8ec7-411b-91a6-3ab61a9a2929 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:49:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-aac5390a-8ec7-411b-91a6-3ab61a9a2929 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:23 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-69c523c4-037d-4e5a-88d0-812032eb8fe3 tempest-ServerRescueNegativeTestJSON-1404270336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04064f62-0f1a-4895-ac04-4997deddbd09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01f507f7-0a4a-4bb2-b1b3-ce558e319430', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:23 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-69c523c4-037d-4e5a-88d0-812032eb8fe3 tempest-ServerRescueNegativeTestJSON-1404270336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a31dcab-e44b-4f77-b347-ad223274c62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:23 devstack sudo[96108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16 1073741824
Nov 06 11:49:23 devstack sudo[96108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:23 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-69c523c4-037d-4e5a-88d0-812032eb8fe3 tempest-ServerRescueNegativeTestJSON-1404270336 None] Volume volume-01f507f7-0a4a-4bb2-b1b3-ce558e319430 (01f507f7-0a4a-4bb2-b1b3-ce558e319430): created successfully
Nov 06 11:49:23 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-69c523c4-037d-4e5a-88d0-812032eb8fe3 tempest-ServerRescueNegativeTestJSON-1404270336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a31dcab-e44b-4f77-b347-ad223274c62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:23 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-69c523c4-037d-4e5a-88d0-812032eb8fe3 tempest-ServerRescueNegativeTestJSON-1404270336 None] Flow 'volume_create_manager' (99270d88-2429-4b23-b325-14a588cde924) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:49:23 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-69c523c4-037d-4e5a-88d0-812032eb8fe3 tempest-ServerRescueNegativeTestJSON-1404270336 None] Created volume successfully.
Nov 06 11:49:24 devstack sudo[96108]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-aac5390a-8ec7-411b-91a6-3ab61a9a2929 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16 1073741824" returned: 0 in 0.646s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-aac5390a-8ec7-411b-91a6-3ab61a9a2929 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:24 devstack sudo[96115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16
Nov 06 11:49:24 devstack sudo[96115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:24 devstack sudo[96115]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-aac5390a-8ec7-411b-91a6-3ab61a9a2929 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16" returned: 0 in 0.421s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:24 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-aac5390a-8ec7-411b-91a6-3ab61a9a2929 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:49:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-aac5390a-8ec7-411b-91a6-3ab61a9a2929 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:49:24 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-aac5390a-8ec7-411b-91a6-3ab61a9a2929 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8130b87d-5c8f-4ba2-8813-e6c819b2f353) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:24 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-aac5390a-8ec7-411b-91a6-3ab61a9a2929 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de1eb765-badf-4e05-bdf5-2b50b19a9d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:24 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-aac5390a-8ec7-411b-91a6-3ab61a9a2929 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Volume volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16 (dac05608-2a94-4d1d-8a5e-ae26e4307b16): created successfully
Nov 06 11:49:25 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-aac5390a-8ec7-411b-91a6-3ab61a9a2929 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de1eb765-badf-4e05-bdf5-2b50b19a9d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:25 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-aac5390a-8ec7-411b-91a6-3ab61a9a2929 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Flow 'volume_create_manager' (c21bb904-384d-4066-af13-75e20eeea770) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:49:25 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-aac5390a-8ec7-411b-91a6-3ab61a9a2929 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Created volume successfully.
Nov 06 11:49:25 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-52c544cd-82e8-4301-96be-c9890dcb4530 tempest-SnapshotMetadataTestJSON-911780222 None] Acquiring lock "cinder-c524ebc7-55cc-40bf-a394-681c5f9f6d45-delete_snapshot" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:49:25 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-52c544cd-82e8-4301-96be-c9890dcb4530 tempest-SnapshotMetadataTestJSON-911780222 None] Lock "cinder-c524ebc7-55cc-40bf-a394-681c5f9f6d45-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:49:25 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-52c544cd-82e8-4301-96be-c9890dcb4530 tempest-SnapshotMetadataTestJSON-911780222 None] Acquiring lock "cinder-quobyte-188383cf-ed00-4fe6-8d12-7a0bf56db589" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:49:25 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-52c544cd-82e8-4301-96be-c9890dcb4530 tempest-SnapshotMetadataTestJSON-911780222 None] Lock "cinder-quobyte-188383cf-ed00-4fe6-8d12-7a0bf56db589" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:49:25 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-52c544cd-82e8-4301-96be-c9890dcb4530 tempest-SnapshotMetadataTestJSON-911780222 None] Acquiring lock "cinder-quobyte-c524ebc7-55cc-40bf-a394-681c5f9f6d45" by "_delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:49:25 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-52c544cd-82e8-4301-96be-c9890dcb4530 tempest-SnapshotMetadataTestJSON-911780222 None] Lock "cinder-quobyte-c524ebc7-55cc-40bf-a394-681c5f9f6d45" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:49:25 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-52c544cd-82e8-4301-96be-c9890dcb4530 tempest-SnapshotMetadataTestJSON-911780222 None] Deleting offline snapshot c524ebc7-55cc-40bf-a394-681c5f9f6d45 of volume 188383cf-ed00-4fe6-8d12-7a0bf56db589 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 11:49:25 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-52c544cd-82e8-4301-96be-c9890dcb4530 tempest-SnapshotMetadataTestJSON-911780222 None] snapshot_file for this snap is: volume-188383cf-ed00-4fe6-8d12-7a0bf56db589.c524ebc7-55cc-40bf-a394-681c5f9f6d45 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 11:49:25 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[661e56e7-3423-4ee0-a498-90ad615db523]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:49:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-52c544cd-82e8-4301-96be-c9890dcb4530 tempest-SnapshotMetadataTestJSON-911780222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-188383cf-ed00-4fe6-8d12-7a0bf56db589.c524ebc7-55cc-40bf-a394-681c5f9f6d45 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:25 devstack sudo[96119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-188383cf-ed00-4fe6-8d12-7a0bf56db589.c524ebc7-55cc-40bf-a394-681c5f9f6d45
Nov 06 11:49:25 devstack sudo[96119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:26 devstack sudo[96119]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-52c544cd-82e8-4301-96be-c9890dcb4530 tempest-SnapshotMetadataTestJSON-911780222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-188383cf-ed00-4fe6-8d12-7a0bf56db589.c524ebc7-55cc-40bf-a394-681c5f9f6d45" returned: 0 in 0.625s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:26 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-52c544cd-82e8-4301-96be-c9890dcb4530 tempest-SnapshotMetadataTestJSON-911780222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-188383cf-ed00-4fe6-8d12-7a0bf56db589(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:49:26 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6685842e-6153-403f-8afa-0f427b7ee6a1]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:49:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-52c544cd-82e8-4301-96be-c9890dcb4530 tempest-SnapshotMetadataTestJSON-911780222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-188383cf-ed00-4fe6-8d12-7a0bf56db589 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-799402df-2c55-4178-946e-9e0412f85da0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:49:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-799402df-2c55-4178-946e-9e0412f85da0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:49:26 devstack sudo[96124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-188383cf-ed00-4fe6-8d12-7a0bf56db589
Nov 06 11:49:26 devstack sudo[96124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:26 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-799402df-2c55-4178-946e-9e0412f85da0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Creating offline snapshot 897b8ed2-0b9f-4d55-95fc-7db5c879cf9e of volume dac05608-2a94-4d1d-8a5e-ae26e4307b16 {{(pid=87165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 11:49:26 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f842092-d013-487a-8ccc-6f50f4256313]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:49:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-799402df-2c55-4178-946e-9e0412f85da0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:26 devstack sudo[96126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16
Nov 06 11:49:26 devstack sudo[96126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:26 devstack sudo[96124]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-52c544cd-82e8-4301-96be-c9890dcb4530 tempest-SnapshotMetadataTestJSON-911780222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-188383cf-ed00-4fe6-8d12-7a0bf56db589" returned: 0 in 0.738s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-52c544cd-82e8-4301-96be-c9890dcb4530 tempest-SnapshotMetadataTestJSON-911780222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-188383cf-ed00-4fe6-8d12-7a0bf56db589.c524ebc7-55cc-40bf-a394-681c5f9f6d45 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:27 devstack sudo[96132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-188383cf-ed00-4fe6-8d12-7a0bf56db589.c524ebc7-55cc-40bf-a394-681c5f9f6d45
Nov 06 11:49:27 devstack sudo[96132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:27 devstack sudo[96126]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-799402df-2c55-4178-946e-9e0412f85da0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16" returned: 0 in 0.755s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-799402df-2c55-4178-946e-9e0412f85da0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16.897b8ed2-0b9f-4d55-95fc-7db5c879cf9e 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:27 devstack sudo[96141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16.897b8ed2-0b9f-4d55-95fc-7db5c879cf9e 1G
Nov 06 11:49:27 devstack sudo[96141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:27 devstack sudo[96132]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-52c544cd-82e8-4301-96be-c9890dcb4530 tempest-SnapshotMetadataTestJSON-911780222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-188383cf-ed00-4fe6-8d12-7a0bf56db589.c524ebc7-55cc-40bf-a394-681c5f9f6d45" returned: 0 in 0.557s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-52c544cd-82e8-4301-96be-c9890dcb4530 tempest-SnapshotMetadataTestJSON-911780222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-188383cf-ed00-4fe6-8d12-7a0bf56db589.c524ebc7-55cc-40bf-a394-681c5f9f6d45 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:27 devstack sudo[96147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-188383cf-ed00-4fe6-8d12-7a0bf56db589.c524ebc7-55cc-40bf-a394-681c5f9f6d45
Nov 06 11:49:27 devstack sudo[96147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:27 devstack sudo[96141]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-799402df-2c55-4178-946e-9e0412f85da0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16.897b8ed2-0b9f-4d55-95fc-7db5c879cf9e 1G" returned: 0 in 0.758s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-799402df-2c55-4178-946e-9e0412f85da0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16.897b8ed2-0b9f-4d55-95fc-7db5c879cf9e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:28 devstack sudo[96164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16.897b8ed2-0b9f-4d55-95fc-7db5c879cf9e
Nov 06 11:49:28 devstack sudo[96164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:28 devstack sudo[96147]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-52c544cd-82e8-4301-96be-c9890dcb4530 tempest-SnapshotMetadataTestJSON-911780222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-188383cf-ed00-4fe6-8d12-7a0bf56db589.c524ebc7-55cc-40bf-a394-681c5f9f6d45" returned: 0 in 0.510s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:28 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-52c544cd-82e8-4301-96be-c9890dcb4530 tempest-SnapshotMetadataTestJSON-911780222 None] Lock "cinder-quobyte-c524ebc7-55cc-40bf-a394-681c5f9f6d45" released by "_delete_snapshot" :: held 2.600s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:49:28 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-52c544cd-82e8-4301-96be-c9890dcb4530 tempest-SnapshotMetadataTestJSON-911780222 None] Lock "cinder-quobyte-188383cf-ed00-4fe6-8d12-7a0bf56db589" released by "delete_snapshot" :: held 2.641s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:49:28 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-52c544cd-82e8-4301-96be-c9890dcb4530 tempest-SnapshotMetadataTestJSON-911780222 None] Created reservations ['c1cb4da9-18b9-496e-828a-174b8d089716', '7a36b0d7-580b-4f63-9d1f-8b4b218283cd', 'a4048ccc-13a1-422d-8cdc-e169c0fc1392', 'aca99250-ac3b-4a0b-8947-3e863c17b053'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:49:28 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-52c544cd-82e8-4301-96be-c9890dcb4530 tempest-SnapshotMetadataTestJSON-911780222 None] Delete snapshot completed successfully.
Nov 06 11:49:28 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-52c544cd-82e8-4301-96be-c9890dcb4530 tempest-SnapshotMetadataTestJSON-911780222 None] Lock "cinder-c524ebc7-55cc-40bf-a394-681c5f9f6d45-delete_snapshot" released by "delete_snapshot" :: held 2.873s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:49:28 devstack sudo[96164]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-799402df-2c55-4178-946e-9e0412f85da0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16.897b8ed2-0b9f-4d55-95fc-7db5c879cf9e" returned: 0 in 0.553s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:28 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-799402df-2c55-4178-946e-9e0412f85da0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16.897b8ed2-0b9f-4d55-95fc-7db5c879cf9e is being set with open permissions: ugo+rw
Nov 06 11:49:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-799402df-2c55-4178-946e-9e0412f85da0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16.897b8ed2-0b9f-4d55-95fc-7db5c879cf9e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:28 devstack sudo[96192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16.897b8ed2-0b9f-4d55-95fc-7db5c879cf9e
Nov 06 11:49:28 devstack sudo[96192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:28 devstack sudo[96192]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-799402df-2c55-4178-946e-9e0412f85da0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16.897b8ed2-0b9f-4d55-95fc-7db5c879cf9e" returned: 0 in 0.360s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-799402df-2c55-4178-946e-9e0412f85da0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:29 devstack sudo[96195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16.info
Nov 06 11:49:29 devstack sudo[96195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:29 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e88e4096-5210-45e6-8a07-1bef0a4d5c24 tempest-SnapshotMetadataTestJSON-911780222 None] Acquiring lock "cinder-188383cf-ed00-4fe6-8d12-7a0bf56db589-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:49:29 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e88e4096-5210-45e6-8a07-1bef0a4d5c24 tempest-SnapshotMetadataTestJSON-911780222 None] Lock "cinder-188383cf-ed00-4fe6-8d12-7a0bf56db589-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:49:29 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e88e4096-5210-45e6-8a07-1bef0a4d5c24 tempest-SnapshotMetadataTestJSON-911780222 None] Acquiring lock "cinder-quobyte-188383cf-ed00-4fe6-8d12-7a0bf56db589" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:49:29 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e88e4096-5210-45e6-8a07-1bef0a4d5c24 tempest-SnapshotMetadataTestJSON-911780222 None] Lock "cinder-quobyte-188383cf-ed00-4fe6-8d12-7a0bf56db589" acquired by "delete_volume" :: waited 0.028s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:49:29 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[839ff17e-2301-469e-8a70-594b932267eb]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:49:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e88e4096-5210-45e6-8a07-1bef0a4d5c24 tempest-SnapshotMetadataTestJSON-911780222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-188383cf-ed00-4fe6-8d12-7a0bf56db589 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:29 devstack sudo[96197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-188383cf-ed00-4fe6-8d12-7a0bf56db589
Nov 06 11:49:29 devstack sudo[96197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:29 devstack sudo[96195]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-799402df-2c55-4178-946e-9e0412f85da0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16.info" returned: 0 in 0.494s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:29 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-799402df-2c55-4178-946e-9e0412f85da0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16.info is being set with open permissions: ugo+rw
Nov 06 11:49:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-799402df-2c55-4178-946e-9e0412f85da0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:29 devstack sudo[96200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16.info
Nov 06 11:49:29 devstack sudo[96200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:29 devstack sudo[96197]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e88e4096-5210-45e6-8a07-1bef0a4d5c24 tempest-SnapshotMetadataTestJSON-911780222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-188383cf-ed00-4fe6-8d12-7a0bf56db589" returned: 0 in 0.488s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e88e4096-5210-45e6-8a07-1bef0a4d5c24 tempest-SnapshotMetadataTestJSON-911780222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-188383cf-ed00-4fe6-8d12-7a0bf56db589 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:29 devstack sudo[96206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-188383cf-ed00-4fe6-8d12-7a0bf56db589
Nov 06 11:49:29 devstack sudo[96206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:29 devstack sudo[96200]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-799402df-2c55-4178-946e-9e0412f85da0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16.info" returned: 0 in 0.440s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-799402df-2c55-4178-946e-9e0412f85da0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.588s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:49:30 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-799402df-2c55-4178-946e-9e0412f85da0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Create snapshot completed successfully
Nov 06 11:49:30 devstack sudo[96206]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e88e4096-5210-45e6-8a07-1bef0a4d5c24 tempest-SnapshotMetadataTestJSON-911780222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-188383cf-ed00-4fe6-8d12-7a0bf56db589" returned: 0 in 0.678s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:30 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e88e4096-5210-45e6-8a07-1bef0a4d5c24 tempest-SnapshotMetadataTestJSON-911780222 None] Lock "cinder-quobyte-188383cf-ed00-4fe6-8d12-7a0bf56db589" released by "delete_volume" :: held 1.287s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:49:30 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-e88e4096-5210-45e6-8a07-1bef0a4d5c24 tempest-SnapshotMetadataTestJSON-911780222 None] Created reservations ['a38ea8c9-c7e4-4097-b5cd-7272d5655317', 'c1629906-bdfa-45e8-96b5-0339baa089da', '56a68b58-9723-4091-91c8-aa06b140023d', '01c14058-a4e2-4b5a-aa09-dfbb455af74e'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:49:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e88e4096-5210-45e6-8a07-1bef0a4d5c24 tempest-SnapshotMetadataTestJSON-911780222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:49:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e88e4096-5210-45e6-8a07-1bef0a4d5c24 tempest-SnapshotMetadataTestJSON-911780222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:49:30 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-e88e4096-5210-45e6-8a07-1bef0a4d5c24 tempest-SnapshotMetadataTestJSON-911780222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:49:30 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-e88e4096-5210-45e6-8a07-1bef0a4d5c24 tempest-SnapshotMetadataTestJSON-911780222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:49:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e88e4096-5210-45e6-8a07-1bef0a4d5c24 tempest-SnapshotMetadataTestJSON-911780222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:49:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e88e4096-5210-45e6-8a07-1bef0a4d5c24 tempest-SnapshotMetadataTestJSON-911780222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:30 devstack sudo[96211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:49:30 devstack sudo[96211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:31 devstack sudo[96211]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e88e4096-5210-45e6-8a07-1bef0a4d5c24 tempest-SnapshotMetadataTestJSON-911780222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.495s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:31 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-e88e4096-5210-45e6-8a07-1bef0a4d5c24 tempest-SnapshotMetadataTestJSON-911780222 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:49:31 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-e88e4096-5210-45e6-8a07-1bef0a4d5c24 tempest-SnapshotMetadataTestJSON-911780222 None] Deleted volume successfully.
Nov 06 11:49:31 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e88e4096-5210-45e6-8a07-1bef0a4d5c24 tempest-SnapshotMetadataTestJSON-911780222 None] Lock "cinder-188383cf-ed00-4fe6-8d12-7a0bf56db589-delete_volume" released by "delete_volume" :: held 2.174s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:49:31 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-48519206-ae38-47e9-8065-b017b56d6c76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Acquiring lock "cinder-897b8ed2-0b9f-4d55-95fc-7db5c879cf9e-delete_snapshot" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:49:31 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-48519206-ae38-47e9-8065-b017b56d6c76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Lock "cinder-897b8ed2-0b9f-4d55-95fc-7db5c879cf9e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:49:31 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-48519206-ae38-47e9-8065-b017b56d6c76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Acquiring lock "cinder-quobyte-dac05608-2a94-4d1d-8a5e-ae26e4307b16" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:49:31 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-48519206-ae38-47e9-8065-b017b56d6c76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Lock "cinder-quobyte-dac05608-2a94-4d1d-8a5e-ae26e4307b16" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:49:31 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-48519206-ae38-47e9-8065-b017b56d6c76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Acquiring lock "cinder-quobyte-897b8ed2-0b9f-4d55-95fc-7db5c879cf9e" by "_delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:49:31 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-48519206-ae38-47e9-8065-b017b56d6c76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Lock "cinder-quobyte-897b8ed2-0b9f-4d55-95fc-7db5c879cf9e" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:49:31 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-48519206-ae38-47e9-8065-b017b56d6c76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Deleting offline snapshot 897b8ed2-0b9f-4d55-95fc-7db5c879cf9e of volume dac05608-2a94-4d1d-8a5e-ae26e4307b16 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 11:49:31 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-48519206-ae38-47e9-8065-b017b56d6c76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] snapshot_file for this snap is: volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16.897b8ed2-0b9f-4d55-95fc-7db5c879cf9e {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 11:49:31 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[795f3f3e-55ca-4616-af1e-154167fa7cf2]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:49:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-48519206-ae38-47e9-8065-b017b56d6c76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16.897b8ed2-0b9f-4d55-95fc-7db5c879cf9e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:31 devstack sudo[96215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16.897b8ed2-0b9f-4d55-95fc-7db5c879cf9e
Nov 06 11:49:31 devstack sudo[96215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:32 devstack sudo[96215]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-48519206-ae38-47e9-8065-b017b56d6c76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16.897b8ed2-0b9f-4d55-95fc-7db5c879cf9e" returned: 0 in 0.707s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:32 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-48519206-ae38-47e9-8065-b017b56d6c76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:49:32 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[917a619d-4a80-40f3-9fd7-e97004922bf0]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:49:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-48519206-ae38-47e9-8065-b017b56d6c76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:32 devstack sudo[96247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16
Nov 06 11:49:32 devstack sudo[96247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:33 devstack sudo[96247]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-48519206-ae38-47e9-8065-b017b56d6c76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16" returned: 0 in 0.800s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-48519206-ae38-47e9-8065-b017b56d6c76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16.897b8ed2-0b9f-4d55-95fc-7db5c879cf9e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:33 devstack sudo[96253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16.897b8ed2-0b9f-4d55-95fc-7db5c879cf9e
Nov 06 11:49:33 devstack sudo[96253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:33 devstack sudo[96253]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-48519206-ae38-47e9-8065-b017b56d6c76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16.897b8ed2-0b9f-4d55-95fc-7db5c879cf9e" returned: 0 in 0.485s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-48519206-ae38-47e9-8065-b017b56d6c76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16.897b8ed2-0b9f-4d55-95fc-7db5c879cf9e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:33 devstack sudo[96267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16.897b8ed2-0b9f-4d55-95fc-7db5c879cf9e
Nov 06 11:49:33 devstack sudo[96267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:34 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-eff3682b-ed99-4872-99ae-b01c676be778 tempest-VolumesTransfersV355Test-598583156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:49:34 devstack sudo[96267]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:34 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-eff3682b-ed99-4872-99ae-b01c676be778 tempest-VolumesTransfersV355Test-598583156 None] Flow 'volume_create_manager' (82a7f7ef-9225-414f-bb8e-edd62394c788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:49:34 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-eff3682b-ed99-4872-99ae-b01c676be778 tempest-VolumesTransfersV355Test-598583156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de1d2913-306c-4455-b780-19e18940f53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-48519206-ae38-47e9-8065-b017b56d6c76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16.897b8ed2-0b9f-4d55-95fc-7db5c879cf9e" returned: 0 in 0.428s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:34 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-eff3682b-ed99-4872-99ae-b01c676be778 tempest-VolumesTransfersV355Test-598583156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de1d2913-306c-4455-b780-19e18940f53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:49:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-17331181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fac8f534-cc3d-4301-9da1-545080383e04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc483948a16406b96447da5794f5c8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:49:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:49:34Z,use_quota=True,user_id='c575ac772da54555b71c0781fe24d526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:34 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-eff3682b-ed99-4872-99ae-b01c676be778 tempest-VolumesTransfersV355Test-598583156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6db9c574-6c5a-46f6-8d63-30936f6232f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:34 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-eff3682b-ed99-4872-99ae-b01c676be778 tempest-VolumesTransfersV355Test-598583156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6db9c574-6c5a-46f6-8d63-30936f6232f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:34 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-eff3682b-ed99-4872-99ae-b01c676be778 tempest-VolumesTransfersV355Test-598583156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dcd0b66-599a-45ed-932d-84de1ec9d4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:34 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-eff3682b-ed99-4872-99ae-b01c676be778 tempest-VolumesTransfersV355Test-598583156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dcd0b66-599a-45ed-932d-84de1ec9d4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fac8f534-cc3d-4301-9da1-545080383e04', 'volume_name': 'volume-fac8f534-cc3d-4301-9da1-545080383e04', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:34 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-eff3682b-ed99-4872-99ae-b01c676be778 tempest-VolumesTransfersV355Test-598583156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54e35b74-90c2-464d-82a3-a3da7deb9b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:34 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-eff3682b-ed99-4872-99ae-b01c676be778 tempest-VolumesTransfersV355Test-598583156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54e35b74-90c2-464d-82a3-a3da7deb9b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:34 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-eff3682b-ed99-4872-99ae-b01c676be778 tempest-VolumesTransfersV355Test-598583156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73dce81e-039a-437b-be15-e1bfa2198b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:34 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-eff3682b-ed99-4872-99ae-b01c676be778 tempest-VolumesTransfersV355Test-598583156 None] Volume fac8f534-cc3d-4301-9da1-545080383e04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fac8f534-cc3d-4301-9da1-545080383e04', 'volume_size': 1}
Nov 06 11:49:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-eff3682b-ed99-4872-99ae-b01c676be778 tempest-VolumesTransfersV355Test-598583156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:49:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-eff3682b-ed99-4872-99ae-b01c676be778 tempest-VolumesTransfersV355Test-598583156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:49:34 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-eff3682b-ed99-4872-99ae-b01c676be778 tempest-VolumesTransfersV355Test-598583156 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:49:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-17331181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fac8f534-cc3d-4301-9da1-545080383e04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc483948a16406b96447da5794f5c8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:49:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:49:34Z,use_quota=True,user_id='c575ac772da54555b71c0781fe24d526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:49:34 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-eff3682b-ed99-4872-99ae-b01c676be778 tempest-VolumesTransfersV355Test-598583156 None] Creating volume fac8f534-cc3d-4301-9da1-545080383e04 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:49:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-eff3682b-ed99-4872-99ae-b01c676be778 tempest-VolumesTransfersV355Test-598583156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:49:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-eff3682b-ed99-4872-99ae-b01c676be778 tempest-VolumesTransfersV355Test-598583156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:49:34 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-eff3682b-ed99-4872-99ae-b01c676be778 tempest-VolumesTransfersV355Test-598583156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:49:34 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-eff3682b-ed99-4872-99ae-b01c676be778 tempest-VolumesTransfersV355Test-598583156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:49:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-eff3682b-ed99-4872-99ae-b01c676be778 tempest-VolumesTransfersV355Test-598583156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:49:34 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-eff3682b-ed99-4872-99ae-b01c676be778 tempest-VolumesTransfersV355Test-598583156 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:49:34 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-eff3682b-ed99-4872-99ae-b01c676be778 tempest-VolumesTransfersV355Test-598583156 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:49:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-eff3682b-ed99-4872-99ae-b01c676be778 tempest-VolumesTransfersV355Test-598583156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fac8f534-cc3d-4301-9da1-545080383e04 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:34 devstack sudo[96289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fac8f534-cc3d-4301-9da1-545080383e04 1073741824
Nov 06 11:49:34 devstack sudo[96289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:34 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-48519206-ae38-47e9-8065-b017b56d6c76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Lock "cinder-quobyte-897b8ed2-0b9f-4d55-95fc-7db5c879cf9e" released by "_delete_snapshot" :: held 2.791s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:49:34 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-48519206-ae38-47e9-8065-b017b56d6c76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Lock "cinder-quobyte-dac05608-2a94-4d1d-8a5e-ae26e4307b16" released by "delete_snapshot" :: held 2.841s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:49:34 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-48519206-ae38-47e9-8065-b017b56d6c76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Created reservations ['0c0c2890-c895-4a3a-b3c2-ae2770bbe777', '40fe46cd-54c4-411d-adc7-34df575d86bd', '07745dd9-5a42-4bc2-9845-52c4b8bd3110', '32650bf3-21f8-4fcf-b6b1-c8b1fbdf7bee'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:49:34 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-48519206-ae38-47e9-8065-b017b56d6c76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Delete snapshot completed successfully.
Nov 06 11:49:34 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-48519206-ae38-47e9-8065-b017b56d6c76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Lock "cinder-897b8ed2-0b9f-4d55-95fc-7db5c879cf9e-delete_snapshot" released by "delete_snapshot" :: held 3.101s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:49:34 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d194a449-67b9-4699-850b-503ab042bddf tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Acquiring lock "cinder-dac05608-2a94-4d1d-8a5e-ae26e4307b16-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:49:34 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d194a449-67b9-4699-850b-503ab042bddf tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Lock "cinder-dac05608-2a94-4d1d-8a5e-ae26e4307b16-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:49:34 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d194a449-67b9-4699-850b-503ab042bddf tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Acquiring lock "cinder-quobyte-dac05608-2a94-4d1d-8a5e-ae26e4307b16" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:49:34 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d194a449-67b9-4699-850b-503ab042bddf tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Lock "cinder-quobyte-dac05608-2a94-4d1d-8a5e-ae26e4307b16" acquired by "delete_volume" :: waited 0.016s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:49:34 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed626bc-624a-4abf-a728-4ca28493b416]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:49:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d194a449-67b9-4699-850b-503ab042bddf tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:35 devstack sudo[96289]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-eff3682b-ed99-4872-99ae-b01c676be778 tempest-VolumesTransfersV355Test-598583156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fac8f534-cc3d-4301-9da1-545080383e04 1073741824" returned: 0 in 0.802s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-eff3682b-ed99-4872-99ae-b01c676be778 tempest-VolumesTransfersV355Test-598583156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fac8f534-cc3d-4301-9da1-545080383e04 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:35 devstack sudo[96295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16
Nov 06 11:49:35 devstack sudo[96295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:35 devstack sudo[96296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fac8f534-cc3d-4301-9da1-545080383e04
Nov 06 11:49:35 devstack sudo[96296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:35 devstack sudo[96296]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-eff3682b-ed99-4872-99ae-b01c676be778 tempest-VolumesTransfersV355Test-598583156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fac8f534-cc3d-4301-9da1-545080383e04" returned: 0 in 0.482s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:35 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-eff3682b-ed99-4872-99ae-b01c676be778 tempest-VolumesTransfersV355Test-598583156 None] <== create_volume: return (1345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:49:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-eff3682b-ed99-4872-99ae-b01c676be778 tempest-VolumesTransfersV355Test-598583156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.349s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:49:35 devstack sudo[96295]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d194a449-67b9-4699-850b-503ab042bddf tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16" returned: 0 in 0.641s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d194a449-67b9-4699-850b-503ab042bddf tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:35 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-eff3682b-ed99-4872-99ae-b01c676be778 tempest-VolumesTransfersV355Test-598583156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73dce81e-039a-437b-be15-e1bfa2198b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fac8f534-cc3d-4301-9da1-545080383e04', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:35 devstack sudo[96304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16
Nov 06 11:49:35 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-eff3682b-ed99-4872-99ae-b01c676be778 tempest-VolumesTransfersV355Test-598583156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5742e371-2f48-423f-a734-b348462eab1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:35 devstack sudo[96304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:35 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-eff3682b-ed99-4872-99ae-b01c676be778 tempest-VolumesTransfersV355Test-598583156 None] Volume volume-fac8f534-cc3d-4301-9da1-545080383e04 (fac8f534-cc3d-4301-9da1-545080383e04): created successfully
Nov 06 11:49:35 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-eff3682b-ed99-4872-99ae-b01c676be778 tempest-VolumesTransfersV355Test-598583156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5742e371-2f48-423f-a734-b348462eab1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:35 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-eff3682b-ed99-4872-99ae-b01c676be778 tempest-VolumesTransfersV355Test-598583156 None] Flow 'volume_create_manager' (82a7f7ef-9225-414f-bb8e-edd62394c788) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:49:35 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-eff3682b-ed99-4872-99ae-b01c676be778 tempest-VolumesTransfersV355Test-598583156 None] Created volume successfully.
Nov 06 11:49:35 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-48dec398-b03e-4edd-8194-1452c371fc3d tempest-ServerRescueNegativeTestJSON-1404270336 None] Acquiring lock "cinder-01f507f7-0a4a-4bb2-b1b3-ce558e319430-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:49:35 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-48dec398-b03e-4edd-8194-1452c371fc3d tempest-ServerRescueNegativeTestJSON-1404270336 None] Lock "cinder-01f507f7-0a4a-4bb2-b1b3-ce558e319430-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:49:36 devstack sudo[96304]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d194a449-67b9-4699-850b-503ab042bddf tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-dac05608-2a94-4d1d-8a5e-ae26e4307b16" returned: 0 in 0.467s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:36 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d194a449-67b9-4699-850b-503ab042bddf tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Lock "cinder-quobyte-dac05608-2a94-4d1d-8a5e-ae26e4307b16" released by "delete_volume" :: held 1.256s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:49:36 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-48dec398-b03e-4edd-8194-1452c371fc3d tempest-ServerRescueNegativeTestJSON-1404270336 None] Acquiring lock "cinder-quobyte-01f507f7-0a4a-4bb2-b1b3-ce558e319430" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:49:36 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-48dec398-b03e-4edd-8194-1452c371fc3d tempest-ServerRescueNegativeTestJSON-1404270336 None] Lock "cinder-quobyte-01f507f7-0a4a-4bb2-b1b3-ce558e319430" acquired by "delete_volume" :: waited 0.047s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:49:36 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c86a66-d4f3-414f-9d87-ce4afd3c9ea3]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:49:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-48dec398-b03e-4edd-8194-1452c371fc3d tempest-ServerRescueNegativeTestJSON-1404270336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-01f507f7-0a4a-4bb2-b1b3-ce558e319430 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:36 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-d194a449-67b9-4699-850b-503ab042bddf tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Created reservations ['fc19e070-9042-4cc8-b93a-312f96fe3238', '4b60691a-257a-452c-8fdc-13c2f6569091', '764cc6b6-dda1-4141-bbde-a4d6bdd0130d', '20826af2-5b53-42c0-b31a-5a682d6a24e2'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:49:36 devstack sudo[96307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-01f507f7-0a4a-4bb2-b1b3-ce558e319430
Nov 06 11:49:36 devstack sudo[96307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d194a449-67b9-4699-850b-503ab042bddf tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:49:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d194a449-67b9-4699-850b-503ab042bddf tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:49:36 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-d194a449-67b9-4699-850b-503ab042bddf tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:49:36 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-d194a449-67b9-4699-850b-503ab042bddf tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:49:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d194a449-67b9-4699-850b-503ab042bddf tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:49:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d194a449-67b9-4699-850b-503ab042bddf tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:36 devstack sudo[96310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:49:36 devstack sudo[96310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:36 devstack sudo[96310]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d194a449-67b9-4699-850b-503ab042bddf tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.370s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:36 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-d194a449-67b9-4699-850b-503ab042bddf tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:49:36 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-d194a449-67b9-4699-850b-503ab042bddf tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Deleted volume successfully.
Nov 06 11:49:36 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d194a449-67b9-4699-850b-503ab042bddf tempest-VolumeSnapshotQuotasNegativeTestJSON-1095406208 None] Lock "cinder-dac05608-2a94-4d1d-8a5e-ae26e4307b16-delete_volume" released by "delete_volume" :: held 2.062s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:49:36 devstack sudo[96307]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-48dec398-b03e-4edd-8194-1452c371fc3d tempest-ServerRescueNegativeTestJSON-1404270336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-01f507f7-0a4a-4bb2-b1b3-ce558e319430" returned: 0 in 0.676s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-48dec398-b03e-4edd-8194-1452c371fc3d tempest-ServerRescueNegativeTestJSON-1404270336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-01f507f7-0a4a-4bb2-b1b3-ce558e319430 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:36 devstack sudo[96317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-01f507f7-0a4a-4bb2-b1b3-ce558e319430
Nov 06 11:49:36 devstack sudo[96317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:37 devstack sudo[96317]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-48dec398-b03e-4edd-8194-1452c371fc3d tempest-ServerRescueNegativeTestJSON-1404270336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-01f507f7-0a4a-4bb2-b1b3-ce558e319430" returned: 0 in 0.348s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:37 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-48dec398-b03e-4edd-8194-1452c371fc3d tempest-ServerRescueNegativeTestJSON-1404270336 None] Lock "cinder-quobyte-01f507f7-0a4a-4bb2-b1b3-ce558e319430" released by "delete_volume" :: held 1.101s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:49:37 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-48dec398-b03e-4edd-8194-1452c371fc3d tempest-ServerRescueNegativeTestJSON-1404270336 None] Created reservations ['52530ddf-c0d4-4e32-9236-9c09bb7a231b', '36f54ec7-892c-4dec-9958-9be809172007', 'e1a31777-381e-49a4-b087-dffc90c60e26', '222d3a2f-204e-4a71-b8d2-b622429ae38c'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:49:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-48dec398-b03e-4edd-8194-1452c371fc3d tempest-ServerRescueNegativeTestJSON-1404270336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:49:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-48dec398-b03e-4edd-8194-1452c371fc3d tempest-ServerRescueNegativeTestJSON-1404270336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:49:37 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-48dec398-b03e-4edd-8194-1452c371fc3d tempest-ServerRescueNegativeTestJSON-1404270336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:49:37 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-48dec398-b03e-4edd-8194-1452c371fc3d tempest-ServerRescueNegativeTestJSON-1404270336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:49:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-48dec398-b03e-4edd-8194-1452c371fc3d tempest-ServerRescueNegativeTestJSON-1404270336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:49:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-48dec398-b03e-4edd-8194-1452c371fc3d tempest-ServerRescueNegativeTestJSON-1404270336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:37 devstack sudo[96320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:49:37 devstack sudo[96320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:37 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-17528ca4-964d-4828-950f-e7106f582eae tempest-VolumesTransfersV355Test-1994153365 None] Transfer volume completed successfully.
Nov 06 11:49:37 devstack sudo[96320]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-48dec398-b03e-4edd-8194-1452c371fc3d tempest-ServerRescueNegativeTestJSON-1404270336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.528s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:37 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-48dec398-b03e-4edd-8194-1452c371fc3d tempest-ServerRescueNegativeTestJSON-1404270336 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:49:38 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-48dec398-b03e-4edd-8194-1452c371fc3d tempest-ServerRescueNegativeTestJSON-1404270336 None] Deleted volume successfully.
Nov 06 11:49:38 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-48dec398-b03e-4edd-8194-1452c371fc3d tempest-ServerRescueNegativeTestJSON-1404270336 None] Lock "cinder-01f507f7-0a4a-4bb2-b1b3-ce558e319430-delete_volume" released by "delete_volume" :: held 2.091s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:49:38 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-5538eb3e-64f7-43e8-9d54-330682d37dfa tempest-VolumesDeleteCascade-1197991359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:49:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5538eb3e-64f7-43e8-9d54-330682d37dfa tempest-VolumesDeleteCascade-1197991359 None] Flow 'volume_create_manager' (992a4357-791a-4907-8ca9-e132baedf9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:49:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5538eb3e-64f7-43e8-9d54-330682d37dfa tempest-VolumesDeleteCascade-1197991359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (160f9035-125b-4b11-a474-f3227987ee7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5538eb3e-64f7-43e8-9d54-330682d37dfa tempest-VolumesDeleteCascade-1197991359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (160f9035-125b-4b11-a474-f3227987ee7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1388411164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f743ae6b-60f2-4c26-91cb-e5b864bc51bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1869d4d82b410790a0e3d043c1b5ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:49:38Z,use_quota=True,user_id='1171df5aba8844699f9aea72341bc7f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5538eb3e-64f7-43e8-9d54-330682d37dfa tempest-VolumesDeleteCascade-1197991359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6b868d3-999c-452e-b62b-8a5275ebce1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5538eb3e-64f7-43e8-9d54-330682d37dfa tempest-VolumesDeleteCascade-1197991359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6b868d3-999c-452e-b62b-8a5275ebce1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5538eb3e-64f7-43e8-9d54-330682d37dfa tempest-VolumesDeleteCascade-1197991359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b69f3078-58b2-4b08-a535-c25382688bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5538eb3e-64f7-43e8-9d54-330682d37dfa tempest-VolumesDeleteCascade-1197991359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b69f3078-58b2-4b08-a535-c25382688bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f743ae6b-60f2-4c26-91cb-e5b864bc51bd', 'volume_name': 'volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5538eb3e-64f7-43e8-9d54-330682d37dfa tempest-VolumesDeleteCascade-1197991359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9759aeda-acdb-48e9-9807-30373829e5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5538eb3e-64f7-43e8-9d54-330682d37dfa tempest-VolumesDeleteCascade-1197991359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9759aeda-acdb-48e9-9807-30373829e5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5538eb3e-64f7-43e8-9d54-330682d37dfa tempest-VolumesDeleteCascade-1197991359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feb38247-e3a3-42e5-9852-1f607f48ddc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:38 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-5538eb3e-64f7-43e8-9d54-330682d37dfa tempest-VolumesDeleteCascade-1197991359 None] Volume f743ae6b-60f2-4c26-91cb-e5b864bc51bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd', 'volume_size': 1}
Nov 06 11:49:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5538eb3e-64f7-43e8-9d54-330682d37dfa tempest-VolumesDeleteCascade-1197991359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:49:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5538eb3e-64f7-43e8-9d54-330682d37dfa tempest-VolumesDeleteCascade-1197991359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:49:38 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5538eb3e-64f7-43e8-9d54-330682d37dfa tempest-VolumesDeleteCascade-1197991359 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1388411164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f743ae6b-60f2-4c26-91cb-e5b864bc51bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1869d4d82b410790a0e3d043c1b5ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:49:38Z,use_quota=True,user_id='1171df5aba8844699f9aea72341bc7f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:49:38 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-5538eb3e-64f7-43e8-9d54-330682d37dfa tempest-VolumesDeleteCascade-1197991359 None] Creating volume f743ae6b-60f2-4c26-91cb-e5b864bc51bd {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:49:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5538eb3e-64f7-43e8-9d54-330682d37dfa tempest-VolumesDeleteCascade-1197991359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:49:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5538eb3e-64f7-43e8-9d54-330682d37dfa tempest-VolumesDeleteCascade-1197991359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:49:38 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5538eb3e-64f7-43e8-9d54-330682d37dfa tempest-VolumesDeleteCascade-1197991359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:49:38 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5538eb3e-64f7-43e8-9d54-330682d37dfa tempest-VolumesDeleteCascade-1197991359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:49:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5538eb3e-64f7-43e8-9d54-330682d37dfa tempest-VolumesDeleteCascade-1197991359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:49:38 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5538eb3e-64f7-43e8-9d54-330682d37dfa tempest-VolumesDeleteCascade-1197991359 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:49:38 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-5538eb3e-64f7-43e8-9d54-330682d37dfa tempest-VolumesDeleteCascade-1197991359 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:49:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5538eb3e-64f7-43e8-9d54-330682d37dfa tempest-VolumesDeleteCascade-1197991359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:38 devstack sudo[96325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd 1073741824
Nov 06 11:49:38 devstack sudo[96325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:39 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-1d405618-4a37-4d9e-8811-1f123c6c9fc2 tempest-VolumesTransfersV355Test-1108326084 None] Acquiring lock "cinder-fac8f534-cc3d-4301-9da1-545080383e04-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:49:39 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-1d405618-4a37-4d9e-8811-1f123c6c9fc2 tempest-VolumesTransfersV355Test-1108326084 None] Lock "cinder-fac8f534-cc3d-4301-9da1-545080383e04-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:49:39 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:SELECT=94,cinder:UPDATE=107,cinder:INSERT=32,cinder:DELETE=10 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 11:49:39 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-1d405618-4a37-4d9e-8811-1f123c6c9fc2 tempest-VolumesTransfersV355Test-1108326084 None] Acquiring lock "cinder-quobyte-fac8f534-cc3d-4301-9da1-545080383e04" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:49:39 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-1d405618-4a37-4d9e-8811-1f123c6c9fc2 tempest-VolumesTransfersV355Test-1108326084 None] Lock "cinder-quobyte-fac8f534-cc3d-4301-9da1-545080383e04" acquired by "delete_volume" :: waited 0.030s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:49:39 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4567fd45-ba5b-41be-a4cd-357ffb829767]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:49:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1d405618-4a37-4d9e-8811-1f123c6c9fc2 tempest-VolumesTransfersV355Test-1108326084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fac8f534-cc3d-4301-9da1-545080383e04 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:39 devstack sudo[96354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fac8f534-cc3d-4301-9da1-545080383e04
Nov 06 11:49:39 devstack sudo[96354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:39 devstack sudo[96325]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5538eb3e-64f7-43e8-9d54-330682d37dfa tempest-VolumesDeleteCascade-1197991359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd 1073741824" returned: 0 in 1.151s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:39 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:SELECT=92,cinder:UPDATE=103,cinder:INSERT=28,cinder:DELETE=7 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 11:49:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5538eb3e-64f7-43e8-9d54-330682d37dfa tempest-VolumesDeleteCascade-1197991359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:39 devstack sudo[96357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd
Nov 06 11:49:39 devstack sudo[96357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:40 devstack sudo[96354]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1d405618-4a37-4d9e-8811-1f123c6c9fc2 tempest-VolumesTransfersV355Test-1108326084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fac8f534-cc3d-4301-9da1-545080383e04" returned: 0 in 0.769s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1d405618-4a37-4d9e-8811-1f123c6c9fc2 tempest-VolumesTransfersV355Test-1108326084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fac8f534-cc3d-4301-9da1-545080383e04 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:40 devstack sudo[96363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fac8f534-cc3d-4301-9da1-545080383e04
Nov 06 11:49:40 devstack sudo[96363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:40 devstack sudo[96357]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5538eb3e-64f7-43e8-9d54-330682d37dfa tempest-VolumesDeleteCascade-1197991359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd" returned: 0 in 0.496s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:40 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5538eb3e-64f7-43e8-9d54-330682d37dfa tempest-VolumesDeleteCascade-1197991359 None] <== create_volume: return (1767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:49:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5538eb3e-64f7-43e8-9d54-330682d37dfa tempest-VolumesDeleteCascade-1197991359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.769s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:49:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5538eb3e-64f7-43e8-9d54-330682d37dfa tempest-VolumesDeleteCascade-1197991359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feb38247-e3a3-42e5-9852-1f607f48ddc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5538eb3e-64f7-43e8-9d54-330682d37dfa tempest-VolumesDeleteCascade-1197991359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f60fc139-a23b-4112-ad96-6dccbafb7bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:40 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-5538eb3e-64f7-43e8-9d54-330682d37dfa tempest-VolumesDeleteCascade-1197991359 None] Volume volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd (f743ae6b-60f2-4c26-91cb-e5b864bc51bd): created successfully
Nov 06 11:49:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5538eb3e-64f7-43e8-9d54-330682d37dfa tempest-VolumesDeleteCascade-1197991359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f60fc139-a23b-4112-ad96-6dccbafb7bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5538eb3e-64f7-43e8-9d54-330682d37dfa tempest-VolumesDeleteCascade-1197991359 None] Flow 'volume_create_manager' (992a4357-791a-4907-8ca9-e132baedf9c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:49:40 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-5538eb3e-64f7-43e8-9d54-330682d37dfa tempest-VolumesDeleteCascade-1197991359 None] Created volume successfully.
Nov 06 11:49:40 devstack sudo[96363]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1d405618-4a37-4d9e-8811-1f123c6c9fc2 tempest-VolumesTransfersV355Test-1108326084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fac8f534-cc3d-4301-9da1-545080383e04" returned: 0 in 0.450s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:40 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-1d405618-4a37-4d9e-8811-1f123c6c9fc2 tempest-VolumesTransfersV355Test-1108326084 None] Lock "cinder-quobyte-fac8f534-cc3d-4301-9da1-545080383e04" released by "delete_volume" :: held 1.302s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:49:40 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-1d405618-4a37-4d9e-8811-1f123c6c9fc2 tempest-VolumesTransfersV355Test-1108326084 None] Created reservations ['7c907848-9759-412a-a1c9-489179935cc1', 'eb3eead2-b1f1-4b13-8710-bbf634e13a84', '5998ee9d-41b3-412f-9390-7165329f3033', '78857d2d-90b8-46c5-998d-f5b35a4beea3'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:49:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-1d405618-4a37-4d9e-8811-1f123c6c9fc2 tempest-VolumesTransfersV355Test-1108326084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:49:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-1d405618-4a37-4d9e-8811-1f123c6c9fc2 tempest-VolumesTransfersV355Test-1108326084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:49:40 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-1d405618-4a37-4d9e-8811-1f123c6c9fc2 tempest-VolumesTransfersV355Test-1108326084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:49:40 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-1d405618-4a37-4d9e-8811-1f123c6c9fc2 tempest-VolumesTransfersV355Test-1108326084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:49:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-1d405618-4a37-4d9e-8811-1f123c6c9fc2 tempest-VolumesTransfersV355Test-1108326084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:49:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1d405618-4a37-4d9e-8811-1f123c6c9fc2 tempest-VolumesTransfersV355Test-1108326084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:40 devstack sudo[96368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:49:40 devstack sudo[96368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:41 devstack sudo[96368]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1d405618-4a37-4d9e-8811-1f123c6c9fc2 tempest-VolumesTransfersV355Test-1108326084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.338s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:41 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-1d405618-4a37-4d9e-8811-1f123c6c9fc2 tempest-VolumesTransfersV355Test-1108326084 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:49:41 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-1d405618-4a37-4d9e-8811-1f123c6c9fc2 tempest-VolumesTransfersV355Test-1108326084 None] Deleted volume successfully.
Nov 06 11:49:41 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-1d405618-4a37-4d9e-8811-1f123c6c9fc2 tempest-VolumesTransfersV355Test-1108326084 None] Lock "cinder-fac8f534-cc3d-4301-9da1-545080383e04-delete_volume" released by "delete_volume" :: held 2.074s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:49:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-fc9d91ed-c3ec-45e5-b0bf-76916e2f9d23 tempest-VolumesDeleteCascade-1197991359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:49:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-fc9d91ed-c3ec-45e5-b0bf-76916e2f9d23 tempest-VolumesDeleteCascade-1197991359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:49:42 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-fc9d91ed-c3ec-45e5-b0bf-76916e2f9d23 tempest-VolumesDeleteCascade-1197991359 None] Creating offline snapshot ace60b34-dadd-4515-b2a4-1a3ef1f4ef99 of volume f743ae6b-60f2-4c26-91cb-e5b864bc51bd {{(pid=87165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 11:49:42 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[783adab7-8639-4546-9d36-e96b83ad2453]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:49:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-fc9d91ed-c3ec-45e5-b0bf-76916e2f9d23 tempest-VolumesDeleteCascade-1197991359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:42 devstack sudo[96371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd
Nov 06 11:49:42 devstack sudo[96371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:42 devstack sudo[96371]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-fc9d91ed-c3ec-45e5-b0bf-76916e2f9d23 tempest-VolumesDeleteCascade-1197991359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd" returned: 0 in 0.454s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-fc9d91ed-c3ec-45e5-b0bf-76916e2f9d23 tempest-VolumesDeleteCascade-1197991359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.ace60b34-dadd-4515-b2a4-1a3ef1f4ef99 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:42 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-16f14e78-8e84-4771-9ebe-c3a78f3e0c07 tempest-VolumesTransfersV355Test-598583156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:49:42 devstack sudo[96377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.ace60b34-dadd-4515-b2a4-1a3ef1f4ef99 1G
Nov 06 11:49:42 devstack sudo[96377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-16f14e78-8e84-4771-9ebe-c3a78f3e0c07 tempest-VolumesTransfersV355Test-598583156 None] Flow 'volume_create_manager' (45540c48-2c9b-4464-b7b4-345eba3b2b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:49:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-16f14e78-8e84-4771-9ebe-c3a78f3e0c07 tempest-VolumesTransfersV355Test-598583156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e83c39cb-ddb8-4272-a006-a83a5e87bf69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-16f14e78-8e84-4771-9ebe-c3a78f3e0c07 tempest-VolumesTransfersV355Test-598583156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e83c39cb-ddb8-4272-a006-a83a5e87bf69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-806033272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50874ddc-422f-44e2-ab23-fe363a653b9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc483948a16406b96447da5794f5c8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:49:42Z,use_quota=True,user_id='c575ac772da54555b71c0781fe24d526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-16f14e78-8e84-4771-9ebe-c3a78f3e0c07 tempest-VolumesTransfersV355Test-598583156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c608c4c3-2f9b-4e16-92f4-68a109e08288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-16f14e78-8e84-4771-9ebe-c3a78f3e0c07 tempest-VolumesTransfersV355Test-598583156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c608c4c3-2f9b-4e16-92f4-68a109e08288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-16f14e78-8e84-4771-9ebe-c3a78f3e0c07 tempest-VolumesTransfersV355Test-598583156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (306cf5c5-f741-4e4c-9148-3711885dcf0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-16f14e78-8e84-4771-9ebe-c3a78f3e0c07 tempest-VolumesTransfersV355Test-598583156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (306cf5c5-f741-4e4c-9148-3711885dcf0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50874ddc-422f-44e2-ab23-fe363a653b9d', 'volume_name': 'volume-50874ddc-422f-44e2-ab23-fe363a653b9d', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-16f14e78-8e84-4771-9ebe-c3a78f3e0c07 tempest-VolumesTransfersV355Test-598583156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4ae9284-e342-4488-9f39-ca7a53fc2500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-16f14e78-8e84-4771-9ebe-c3a78f3e0c07 tempest-VolumesTransfersV355Test-598583156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4ae9284-e342-4488-9f39-ca7a53fc2500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-16f14e78-8e84-4771-9ebe-c3a78f3e0c07 tempest-VolumesTransfersV355Test-598583156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa2f4acc-0390-4e6c-817d-29853a750a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:42 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-16f14e78-8e84-4771-9ebe-c3a78f3e0c07 tempest-VolumesTransfersV355Test-598583156 None] Volume 50874ddc-422f-44e2-ab23-fe363a653b9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50874ddc-422f-44e2-ab23-fe363a653b9d', 'volume_size': 1}
Nov 06 11:49:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-16f14e78-8e84-4771-9ebe-c3a78f3e0c07 tempest-VolumesTransfersV355Test-598583156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:49:43 devstack sudo[96377]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-fc9d91ed-c3ec-45e5-b0bf-76916e2f9d23 tempest-VolumesDeleteCascade-1197991359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.ace60b34-dadd-4515-b2a4-1a3ef1f4ef99 1G" returned: 0 in 0.591s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-fc9d91ed-c3ec-45e5-b0bf-76916e2f9d23 tempest-VolumesDeleteCascade-1197991359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.ace60b34-dadd-4515-b2a4-1a3ef1f4ef99 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:43 devstack sudo[96385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.ace60b34-dadd-4515-b2a4-1a3ef1f4ef99
Nov 06 11:49:43 devstack sudo[96385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:43 devstack sudo[96385]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-fc9d91ed-c3ec-45e5-b0bf-76916e2f9d23 tempest-VolumesDeleteCascade-1197991359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.ace60b34-dadd-4515-b2a4-1a3ef1f4ef99" returned: 0 in 0.475s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:43 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-fc9d91ed-c3ec-45e5-b0bf-76916e2f9d23 tempest-VolumesDeleteCascade-1197991359 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.ace60b34-dadd-4515-b2a4-1a3ef1f4ef99 is being set with open permissions: ugo+rw
Nov 06 11:49:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-fc9d91ed-c3ec-45e5-b0bf-76916e2f9d23 tempest-VolumesDeleteCascade-1197991359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.ace60b34-dadd-4515-b2a4-1a3ef1f4ef99 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:43 devstack sudo[96406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.ace60b34-dadd-4515-b2a4-1a3ef1f4ef99
Nov 06 11:49:43 devstack sudo[96406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:43 devstack sudo[96406]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-fc9d91ed-c3ec-45e5-b0bf-76916e2f9d23 tempest-VolumesDeleteCascade-1197991359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.ace60b34-dadd-4515-b2a4-1a3ef1f4ef99" returned: 0 in 0.287s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-fc9d91ed-c3ec-45e5-b0bf-76916e2f9d23 tempest-VolumesDeleteCascade-1197991359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:43 devstack sudo[96414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.info
Nov 06 11:49:43 devstack sudo[96414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:44 devstack sudo[96414]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-fc9d91ed-c3ec-45e5-b0bf-76916e2f9d23 tempest-VolumesDeleteCascade-1197991359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.info" returned: 0 in 0.294s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:44 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-fc9d91ed-c3ec-45e5-b0bf-76916e2f9d23 tempest-VolumesDeleteCascade-1197991359 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.info is being set with open permissions: ugo+rw
Nov 06 11:49:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-fc9d91ed-c3ec-45e5-b0bf-76916e2f9d23 tempest-VolumesDeleteCascade-1197991359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:44 devstack sudo[96418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.info
Nov 06 11:49:44 devstack sudo[96418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:44 devstack sudo[96418]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-fc9d91ed-c3ec-45e5-b0bf-76916e2f9d23 tempest-VolumesDeleteCascade-1197991359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.info" returned: 0 in 0.335s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-fc9d91ed-c3ec-45e5-b0bf-76916e2f9d23 tempest-VolumesDeleteCascade-1197991359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.579s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:49:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-16f14e78-8e84-4771-9ebe-c3a78f3e0c07 tempest-VolumesTransfersV355Test-598583156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.950s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:49:44 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-16f14e78-8e84-4771-9ebe-c3a78f3e0c07 tempest-VolumesTransfersV355Test-598583156 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-806033272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50874ddc-422f-44e2-ab23-fe363a653b9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc483948a16406b96447da5794f5c8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:49:42Z,use_quota=True,user_id='c575ac772da54555b71c0781fe24d526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:49:44 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-16f14e78-8e84-4771-9ebe-c3a78f3e0c07 tempest-VolumesTransfersV355Test-598583156 None] Creating volume 50874ddc-422f-44e2-ab23-fe363a653b9d {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:49:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-16f14e78-8e84-4771-9ebe-c3a78f3e0c07 tempest-VolumesTransfersV355Test-598583156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:49:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-16f14e78-8e84-4771-9ebe-c3a78f3e0c07 tempest-VolumesTransfersV355Test-598583156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:49:44 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-16f14e78-8e84-4771-9ebe-c3a78f3e0c07 tempest-VolumesTransfersV355Test-598583156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:49:44 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-16f14e78-8e84-4771-9ebe-c3a78f3e0c07 tempest-VolumesTransfersV355Test-598583156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:49:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-16f14e78-8e84-4771-9ebe-c3a78f3e0c07 tempest-VolumesTransfersV355Test-598583156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:49:44 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-16f14e78-8e84-4771-9ebe-c3a78f3e0c07 tempest-VolumesTransfersV355Test-598583156 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:49:44 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-16f14e78-8e84-4771-9ebe-c3a78f3e0c07 tempest-VolumesTransfersV355Test-598583156 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:49:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-16f14e78-8e84-4771-9ebe-c3a78f3e0c07 tempest-VolumesTransfersV355Test-598583156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-50874ddc-422f-44e2-ab23-fe363a653b9d 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:44 devstack sudo[96422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-50874ddc-422f-44e2-ab23-fe363a653b9d 1073741824
Nov 06 11:49:44 devstack sudo[96422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:44 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-fc9d91ed-c3ec-45e5-b0bf-76916e2f9d23 tempest-VolumesDeleteCascade-1197991359 None] Create snapshot completed successfully
Nov 06 11:49:45 devstack sudo[96422]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-16f14e78-8e84-4771-9ebe-c3a78f3e0c07 tempest-VolumesTransfersV355Test-598583156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-50874ddc-422f-44e2-ab23-fe363a653b9d 1073741824" returned: 0 in 0.602s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-16f14e78-8e84-4771-9ebe-c3a78f3e0c07 tempest-VolumesTransfersV355Test-598583156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-50874ddc-422f-44e2-ab23-fe363a653b9d {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:45 devstack sudo[96430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-50874ddc-422f-44e2-ab23-fe363a653b9d
Nov 06 11:49:45 devstack sudo[96430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-da4e0b84-09c2-4d93-a2f1-7075e7b6dd42 tempest-VolumesDeleteCascade-1197991359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:49:45 devstack sudo[96430]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-16f14e78-8e84-4771-9ebe-c3a78f3e0c07 tempest-VolumesTransfersV355Test-598583156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-50874ddc-422f-44e2-ab23-fe363a653b9d" returned: 0 in 0.290s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:45 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-16f14e78-8e84-4771-9ebe-c3a78f3e0c07 tempest-VolumesTransfersV355Test-598583156 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:49:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-16f14e78-8e84-4771-9ebe-c3a78f3e0c07 tempest-VolumesTransfersV355Test-598583156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:49:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-da4e0b84-09c2-4d93-a2f1-7075e7b6dd42 tempest-VolumesDeleteCascade-1197991359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.161s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:49:45 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-da4e0b84-09c2-4d93-a2f1-7075e7b6dd42 tempest-VolumesDeleteCascade-1197991359 None] Creating offline snapshot 9729ecbc-8fa2-47ec-adfa-ca51b00b72bf of volume f743ae6b-60f2-4c26-91cb-e5b864bc51bd {{(pid=87165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 11:49:45 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-16f14e78-8e84-4771-9ebe-c3a78f3e0c07 tempest-VolumesTransfersV355Test-598583156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa2f4acc-0390-4e6c-817d-29853a750a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50874ddc-422f-44e2-ab23-fe363a653b9d', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:45 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-16f14e78-8e84-4771-9ebe-c3a78f3e0c07 tempest-VolumesTransfersV355Test-598583156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67ff3c57-8a71-4188-9cdc-f569626fe389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:45 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[493e63dc-a589-4f88-8284-7ae8c61ceb8c]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:49:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-da4e0b84-09c2-4d93-a2f1-7075e7b6dd42 tempest-VolumesDeleteCascade-1197991359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.ace60b34-dadd-4515-b2a4-1a3ef1f4ef99 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:45 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-16f14e78-8e84-4771-9ebe-c3a78f3e0c07 tempest-VolumesTransfersV355Test-598583156 None] Volume volume-50874ddc-422f-44e2-ab23-fe363a653b9d (50874ddc-422f-44e2-ab23-fe363a653b9d): created successfully
Nov 06 11:49:45 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-16f14e78-8e84-4771-9ebe-c3a78f3e0c07 tempest-VolumesTransfersV355Test-598583156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67ff3c57-8a71-4188-9cdc-f569626fe389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:45 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-16f14e78-8e84-4771-9ebe-c3a78f3e0c07 tempest-VolumesTransfersV355Test-598583156 None] Flow 'volume_create_manager' (45540c48-2c9b-4464-b7b4-345eba3b2b5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:49:45 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-16f14e78-8e84-4771-9ebe-c3a78f3e0c07 tempest-VolumesTransfersV355Test-598583156 None] Created volume successfully.
Nov 06 11:49:45 devstack sudo[96433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.ace60b34-dadd-4515-b2a4-1a3ef1f4ef99
Nov 06 11:49:45 devstack sudo[96433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:46 devstack sudo[96433]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-da4e0b84-09c2-4d93-a2f1-7075e7b6dd42 tempest-VolumesDeleteCascade-1197991359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.ace60b34-dadd-4515-b2a4-1a3ef1f4ef99" returned: 0 in 0.443s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:46 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-da4e0b84-09c2-4d93-a2f1-7075e7b6dd42 tempest-VolumesDeleteCascade-1197991359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:49:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-da4e0b84-09c2-4d93-a2f1-7075e7b6dd42 tempest-VolumesDeleteCascade-1197991359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.ace60b34-dadd-4515-b2a4-1a3ef1f4ef99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.9729ecbc-8fa2-47ec-adfa-ca51b00b72bf 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:46 devstack sudo[96438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.ace60b34-dadd-4515-b2a4-1a3ef1f4ef99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.9729ecbc-8fa2-47ec-adfa-ca51b00b72bf 1G
Nov 06 11:49:46 devstack sudo[96438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:46 devstack sudo[96438]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-da4e0b84-09c2-4d93-a2f1-7075e7b6dd42 tempest-VolumesDeleteCascade-1197991359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.ace60b34-dadd-4515-b2a4-1a3ef1f4ef99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.9729ecbc-8fa2-47ec-adfa-ca51b00b72bf 1G" returned: 0 in 0.527s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-da4e0b84-09c2-4d93-a2f1-7075e7b6dd42 tempest-VolumesDeleteCascade-1197991359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.ace60b34-dadd-4515-b2a4-1a3ef1f4ef99 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.9729ecbc-8fa2-47ec-adfa-ca51b00b72bf {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:46 devstack sudo[96444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.ace60b34-dadd-4515-b2a4-1a3ef1f4ef99 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.9729ecbc-8fa2-47ec-adfa-ca51b00b72bf
Nov 06 11:49:46 devstack sudo[96444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:46 devstack sudo[96444]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-da4e0b84-09c2-4d93-a2f1-7075e7b6dd42 tempest-VolumesDeleteCascade-1197991359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.ace60b34-dadd-4515-b2a4-1a3ef1f4ef99 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.9729ecbc-8fa2-47ec-adfa-ca51b00b72bf" returned: 0 in 0.374s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:46 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-da4e0b84-09c2-4d93-a2f1-7075e7b6dd42 tempest-VolumesDeleteCascade-1197991359 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.9729ecbc-8fa2-47ec-adfa-ca51b00b72bf is being set with open permissions: ugo+rw
Nov 06 11:49:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-da4e0b84-09c2-4d93-a2f1-7075e7b6dd42 tempest-VolumesDeleteCascade-1197991359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.9729ecbc-8fa2-47ec-adfa-ca51b00b72bf {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:47 devstack sudo[96450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.9729ecbc-8fa2-47ec-adfa-ca51b00b72bf
Nov 06 11:49:47 devstack sudo[96450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:47 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-58f3aa49-aa9d-472e-a4b6-9559328952b2 tempest-VolumesTransfersV355Test-1108326084 None] Acquiring lock "cinder-50874ddc-422f-44e2-ab23-fe363a653b9d-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:49:47 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-58f3aa49-aa9d-472e-a4b6-9559328952b2 tempest-VolumesTransfersV355Test-1108326084 None] Lock "cinder-50874ddc-422f-44e2-ab23-fe363a653b9d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:49:47 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-58f3aa49-aa9d-472e-a4b6-9559328952b2 tempest-VolumesTransfersV355Test-1108326084 None] Acquiring lock "cinder-quobyte-50874ddc-422f-44e2-ab23-fe363a653b9d" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:49:47 devstack sudo[96450]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-da4e0b84-09c2-4d93-a2f1-7075e7b6dd42 tempest-VolumesDeleteCascade-1197991359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.9729ecbc-8fa2-47ec-adfa-ca51b00b72bf" returned: 0 in 0.343s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:47 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-58f3aa49-aa9d-472e-a4b6-9559328952b2 tempest-VolumesTransfersV355Test-1108326084 None] Lock "cinder-quobyte-50874ddc-422f-44e2-ab23-fe363a653b9d" acquired by "delete_volume" :: waited 0.030s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:49:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-da4e0b84-09c2-4d93-a2f1-7075e7b6dd42 tempest-VolumesDeleteCascade-1197991359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.882s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:49:47 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc692d66-cb41-4383-a43c-d87b87cd0996]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:49:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-58f3aa49-aa9d-472e-a4b6-9559328952b2 tempest-VolumesTransfersV355Test-1108326084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-50874ddc-422f-44e2-ab23-fe363a653b9d {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:47 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-da4e0b84-09c2-4d93-a2f1-7075e7b6dd42 tempest-VolumesDeleteCascade-1197991359 None] Create snapshot completed successfully
Nov 06 11:49:47 devstack sudo[96455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-50874ddc-422f-44e2-ab23-fe363a653b9d
Nov 06 11:49:47 devstack sudo[96455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:47 devstack sudo[96455]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-58f3aa49-aa9d-472e-a4b6-9559328952b2 tempest-VolumesTransfersV355Test-1108326084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-50874ddc-422f-44e2-ab23-fe363a653b9d" returned: 0 in 0.439s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-58f3aa49-aa9d-472e-a4b6-9559328952b2 tempest-VolumesTransfersV355Test-1108326084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-50874ddc-422f-44e2-ab23-fe363a653b9d {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:47 devstack sudo[96461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-50874ddc-422f-44e2-ab23-fe363a653b9d
Nov 06 11:49:47 devstack sudo[96461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:48 devstack sudo[96461]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-58f3aa49-aa9d-472e-a4b6-9559328952b2 tempest-VolumesTransfersV355Test-1108326084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-50874ddc-422f-44e2-ab23-fe363a653b9d" returned: 0 in 0.273s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:48 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-58f3aa49-aa9d-472e-a4b6-9559328952b2 tempest-VolumesTransfersV355Test-1108326084 None] Lock "cinder-quobyte-50874ddc-422f-44e2-ab23-fe363a653b9d" released by "delete_volume" :: held 0.829s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:49:48 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-58f3aa49-aa9d-472e-a4b6-9559328952b2 tempest-VolumesTransfersV355Test-1108326084 None] Created reservations ['00ac38b2-67a4-42d3-98a6-f801f5a06967', '8e6f8858-504a-4441-964b-dc649f7aa358', '02a99898-9bb0-4643-9a2d-7e17172afdfc', '5ef00e20-418b-47be-b57d-fb8a3d20f744'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:49:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-58f3aa49-aa9d-472e-a4b6-9559328952b2 tempest-VolumesTransfersV355Test-1108326084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:49:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-58f3aa49-aa9d-472e-a4b6-9559328952b2 tempest-VolumesTransfersV355Test-1108326084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:49:48 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-58f3aa49-aa9d-472e-a4b6-9559328952b2 tempest-VolumesTransfersV355Test-1108326084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:49:48 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-58f3aa49-aa9d-472e-a4b6-9559328952b2 tempest-VolumesTransfersV355Test-1108326084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:49:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-58f3aa49-aa9d-472e-a4b6-9559328952b2 tempest-VolumesTransfersV355Test-1108326084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:49:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-58f3aa49-aa9d-472e-a4b6-9559328952b2 tempest-VolumesTransfersV355Test-1108326084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:48 devstack sudo[96464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:49:48 devstack sudo[96464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:48 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Acquiring lock "cinder-f743ae6b-60f2-4c26-91cb-e5b864bc51bd-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:49:48 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Lock "cinder-f743ae6b-60f2-4c26-91cb-e5b864bc51bd-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:49:48 devstack sudo[96464]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-58f3aa49-aa9d-472e-a4b6-9559328952b2 tempest-VolumesTransfersV355Test-1108326084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.383s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:48 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-58f3aa49-aa9d-472e-a4b6-9559328952b2 tempest-VolumesTransfersV355Test-1108326084 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:49:48 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-58f3aa49-aa9d-472e-a4b6-9559328952b2 tempest-VolumesTransfersV355Test-1108326084 None] Deleted volume successfully.
Nov 06 11:49:48 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Performing cascade delete. {{(pid=87165) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Nov 06 11:49:48 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-58f3aa49-aa9d-472e-a4b6-9559328952b2 tempest-VolumesTransfersV355Test-1108326084 None] Lock "cinder-50874ddc-422f-44e2-ab23-fe363a653b9d-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:49:48 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Acquiring lock "cinder-9729ecbc-8fa2-47ec-adfa-ca51b00b72bf-delete_snapshot" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:49:48 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Lock "cinder-9729ecbc-8fa2-47ec-adfa-ca51b00b72bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:49:48 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Acquiring lock "cinder-quobyte-f743ae6b-60f2-4c26-91cb-e5b864bc51bd" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:49:48 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Lock "cinder-quobyte-f743ae6b-60f2-4c26-91cb-e5b864bc51bd" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:49:48 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Acquiring lock "cinder-quobyte-9729ecbc-8fa2-47ec-adfa-ca51b00b72bf" by "_delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:49:48 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Lock "cinder-quobyte-9729ecbc-8fa2-47ec-adfa-ca51b00b72bf" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:49:48 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Deleting offline snapshot 9729ecbc-8fa2-47ec-adfa-ca51b00b72bf of volume f743ae6b-60f2-4c26-91cb-e5b864bc51bd {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 11:49:48 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] snapshot_file for this snap is: volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.9729ecbc-8fa2-47ec-adfa-ca51b00b72bf {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 11:49:48 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63b13fd-96eb-4dfe-8f99-16489eb5ad54]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:49:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.9729ecbc-8fa2-47ec-adfa-ca51b00b72bf {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:49 devstack sudo[96467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.9729ecbc-8fa2-47ec-adfa-ca51b00b72bf
Nov 06 11:49:49 devstack sudo[96467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:49 devstack sudo[96467]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.9729ecbc-8fa2-47ec-adfa-ca51b00b72bf" returned: 0 in 0.447s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:49 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:49:49 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5f9de6-4179-4ed9-a3bf-dcbe35df8d8b]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:49:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.ace60b34-dadd-4515-b2a4-1a3ef1f4ef99 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:49 devstack sudo[96472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.ace60b34-dadd-4515-b2a4-1a3ef1f4ef99
Nov 06 11:49:49 devstack sudo[96472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:49 devstack sudo[96472]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.ace60b34-dadd-4515-b2a4-1a3ef1f4ef99" returned: 0 in 0.501s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:49 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:49:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.9729ecbc-8fa2-47ec-adfa-ca51b00b72bf {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:49 devstack sudo[96479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.9729ecbc-8fa2-47ec-adfa-ca51b00b72bf
Nov 06 11:49:49 devstack sudo[96479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:50 devstack sudo[96479]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.9729ecbc-8fa2-47ec-adfa-ca51b00b72bf" returned: 0 in 0.513s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.9729ecbc-8fa2-47ec-adfa-ca51b00b72bf {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:50 devstack sudo[96485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.9729ecbc-8fa2-47ec-adfa-ca51b00b72bf
Nov 06 11:49:50 devstack sudo[96485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:50 devstack sudo[96485]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.9729ecbc-8fa2-47ec-adfa-ca51b00b72bf" returned: 0 in 0.290s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:50 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Lock "cinder-quobyte-9729ecbc-8fa2-47ec-adfa-ca51b00b72bf" released by "_delete_snapshot" :: held 1.916s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:49:50 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Lock "cinder-quobyte-f743ae6b-60f2-4c26-91cb-e5b864bc51bd" released by "delete_snapshot" :: held 1.955s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:49:50 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Created reservations ['8a305dab-cb60-46e4-bb71-14000888f4bd', '135d3841-39ee-40e9-a339-e166c311a946', '353ef69f-d832-4b8b-9e98-8010467bed37', '4f8c9c2f-4dba-4cf0-aa76-6fcd35c74a9c'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:49:50 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Delete snapshot completed successfully.
Nov 06 11:49:50 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Lock "cinder-9729ecbc-8fa2-47ec-adfa-ca51b00b72bf-delete_snapshot" released by "delete_snapshot" :: held 2.197s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:49:50 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Acquiring lock "cinder-ace60b34-dadd-4515-b2a4-1a3ef1f4ef99-delete_snapshot" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:49:50 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Lock "cinder-ace60b34-dadd-4515-b2a4-1a3ef1f4ef99-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:49:51 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Acquiring lock "cinder-quobyte-f743ae6b-60f2-4c26-91cb-e5b864bc51bd" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:49:51 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Lock "cinder-quobyte-f743ae6b-60f2-4c26-91cb-e5b864bc51bd" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:49:51 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Acquiring lock "cinder-quobyte-ace60b34-dadd-4515-b2a4-1a3ef1f4ef99" by "_delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:49:51 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Lock "cinder-quobyte-ace60b34-dadd-4515-b2a4-1a3ef1f4ef99" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:49:51 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Deleting offline snapshot ace60b34-dadd-4515-b2a4-1a3ef1f4ef99 of volume f743ae6b-60f2-4c26-91cb-e5b864bc51bd {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 11:49:51 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] snapshot_file for this snap is: volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.ace60b34-dadd-4515-b2a4-1a3ef1f4ef99 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 11:49:51 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c30377-741c-41ea-a09e-33e1ec1268c3]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:49:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.ace60b34-dadd-4515-b2a4-1a3ef1f4ef99 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:51 devstack sudo[96488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.ace60b34-dadd-4515-b2a4-1a3ef1f4ef99
Nov 06 11:49:51 devstack sudo[96488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:51 devstack sudo[96488]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.ace60b34-dadd-4515-b2a4-1a3ef1f4ef99" returned: 0 in 0.431s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:51 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:49:51 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[29177181-f476-4e7c-968b-6e958139a78b]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:49:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:51 devstack sudo[96495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd
Nov 06 11:49:51 devstack sudo[96495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:52 devstack sudo[96495]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd" returned: 0 in 0.452s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.ace60b34-dadd-4515-b2a4-1a3ef1f4ef99 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:52 devstack sudo[96500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.ace60b34-dadd-4515-b2a4-1a3ef1f4ef99
Nov 06 11:49:52 devstack sudo[96500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:52 devstack sudo[96500]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.ace60b34-dadd-4515-b2a4-1a3ef1f4ef99" returned: 0 in 0.478s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.ace60b34-dadd-4515-b2a4-1a3ef1f4ef99 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:52 devstack sudo[96506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.ace60b34-dadd-4515-b2a4-1a3ef1f4ef99
Nov 06 11:49:52 devstack sudo[96506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:52 devstack sudo[96506]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd.ace60b34-dadd-4515-b2a4-1a3ef1f4ef99" returned: 0 in 0.334s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:52 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Lock "cinder-quobyte-ace60b34-dadd-4515-b2a4-1a3ef1f4ef99" released by "_delete_snapshot" :: held 1.863s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:49:52 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Lock "cinder-quobyte-f743ae6b-60f2-4c26-91cb-e5b864bc51bd" released by "delete_snapshot" :: held 1.891s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:49:53 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Created reservations ['481e9527-d360-4a45-a032-5c5fad9e7c61', '4d5cef1d-ab75-449d-81c9-62ab1ab3471f', 'baac2e6d-6602-4728-8b7c-cc9bccc535ba', '36f51025-7202-42cf-a943-298ea78fc461'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:49:53 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Delete snapshot completed successfully.
Nov 06 11:49:53 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Lock "cinder-ace60b34-dadd-4515-b2a4-1a3ef1f4ef99-delete_snapshot" released by "delete_snapshot" :: held 2.123s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:49:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Snapshots deleted, issuing volume delete {{(pid=87165) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Nov 06 11:49:53 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Acquiring lock "cinder-quobyte-f743ae6b-60f2-4c26-91cb-e5b864bc51bd" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:49:53 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Lock "cinder-quobyte-f743ae6b-60f2-4c26-91cb-e5b864bc51bd" acquired by "delete_volume" :: waited 0.018s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:49:53 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a94fd7-88c9-4b43-900b-1cf9f796c605]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:49:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:53 devstack sudo[96509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd
Nov 06 11:49:53 devstack sudo[96509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:53 devstack sudo[96509]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd" returned: 0 in 0.404s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:53 devstack sudo[96515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd
Nov 06 11:49:53 devstack sudo[96515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:53 devstack sudo[96515]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f743ae6b-60f2-4c26-91cb-e5b864bc51bd" returned: 0 in 0.294s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:53 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Lock "cinder-quobyte-f743ae6b-60f2-4c26-91cb-e5b864bc51bd" released by "delete_volume" :: held 0.773s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:49:53 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Created reservations ['2da37591-96c9-4acc-9b3d-20f8ad4ed3b2', 'a5f0ab68-a306-48c6-a241-4118dd48d2c2', '09d71784-6578-43f5-b7cc-3c585f4f7596', '4e9d4cbd-8024-425a-bd57-6bf82adb637b'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:49:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:49:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:49:54 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:49:54 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:49:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:49:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:54 devstack sudo[96518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:49:54 devstack sudo[96518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:54 devstack sudo[96518]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.286s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:54 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:49:54 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Deleted volume successfully.
Nov 06 11:49:54 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-1832cb24-adc0-4284-a01b-8c7465740e26 tempest-VolumesDeleteCascade-1197991359 None] Lock "cinder-f743ae6b-60f2-4c26-91cb-e5b864bc51bd-delete_volume" released by "delete_volume" :: held 5.720s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:49:55 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-546fef93-7a64-4758-b246-6991016af760 tempest-VolumesDeleteCascade-1197991359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:49:55 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-546fef93-7a64-4758-b246-6991016af760 tempest-VolumesDeleteCascade-1197991359 None] Flow 'volume_create_manager' (b7a4b4b6-f7f0-48f9-8251-391028756d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:49:55 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-546fef93-7a64-4758-b246-6991016af760 tempest-VolumesDeleteCascade-1197991359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (937c3209-77d6-40a6-9908-47969b13aa76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:55 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-546fef93-7a64-4758-b246-6991016af760 tempest-VolumesDeleteCascade-1197991359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (937c3209-77d6-40a6-9908-47969b13aa76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:49:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-295793536',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b845d9b4-f414-4aad-895f-067eff181724,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1869d4d82b410790a0e3d043c1b5ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:49:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:49:55Z,use_quota=True,user_id='1171df5aba8844699f9aea72341bc7f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:55 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-546fef93-7a64-4758-b246-6991016af760 tempest-VolumesDeleteCascade-1197991359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e204f3c-693d-4284-ad40-9fe7cec33932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:55 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-546fef93-7a64-4758-b246-6991016af760 tempest-VolumesDeleteCascade-1197991359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e204f3c-693d-4284-ad40-9fe7cec33932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:55 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-546fef93-7a64-4758-b246-6991016af760 tempest-VolumesDeleteCascade-1197991359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (357c9aff-4274-4563-8ca4-e96701ee5573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:55 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-546fef93-7a64-4758-b246-6991016af760 tempest-VolumesDeleteCascade-1197991359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (357c9aff-4274-4563-8ca4-e96701ee5573) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b845d9b4-f414-4aad-895f-067eff181724', 'volume_name': 'volume-b845d9b4-f414-4aad-895f-067eff181724', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:55 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-546fef93-7a64-4758-b246-6991016af760 tempest-VolumesDeleteCascade-1197991359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28a686b6-a168-47be-9a3a-614efac5f5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:55 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-546fef93-7a64-4758-b246-6991016af760 tempest-VolumesDeleteCascade-1197991359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28a686b6-a168-47be-9a3a-614efac5f5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:55 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-546fef93-7a64-4758-b246-6991016af760 tempest-VolumesDeleteCascade-1197991359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2978635-6912-4a06-b5ff-23aa718dd75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:55 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-546fef93-7a64-4758-b246-6991016af760 tempest-VolumesDeleteCascade-1197991359 None] Volume b845d9b4-f414-4aad-895f-067eff181724: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b845d9b4-f414-4aad-895f-067eff181724', 'volume_size': 1}
Nov 06 11:49:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-546fef93-7a64-4758-b246-6991016af760 tempest-VolumesDeleteCascade-1197991359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:49:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-546fef93-7a64-4758-b246-6991016af760 tempest-VolumesDeleteCascade-1197991359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:49:55 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-546fef93-7a64-4758-b246-6991016af760 tempest-VolumesDeleteCascade-1197991359 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:49:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-295793536',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b845d9b4-f414-4aad-895f-067eff181724,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1869d4d82b410790a0e3d043c1b5ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:49:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:49:55Z,use_quota=True,user_id='1171df5aba8844699f9aea72341bc7f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:49:55 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-546fef93-7a64-4758-b246-6991016af760 tempest-VolumesDeleteCascade-1197991359 None] Creating volume b845d9b4-f414-4aad-895f-067eff181724 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:49:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-546fef93-7a64-4758-b246-6991016af760 tempest-VolumesDeleteCascade-1197991359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:49:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-546fef93-7a64-4758-b246-6991016af760 tempest-VolumesDeleteCascade-1197991359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:49:55 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-546fef93-7a64-4758-b246-6991016af760 tempest-VolumesDeleteCascade-1197991359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:49:55 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-546fef93-7a64-4758-b246-6991016af760 tempest-VolumesDeleteCascade-1197991359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:49:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-546fef93-7a64-4758-b246-6991016af760 tempest-VolumesDeleteCascade-1197991359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:49:55 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-546fef93-7a64-4758-b246-6991016af760 tempest-VolumesDeleteCascade-1197991359 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:49:55 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-546fef93-7a64-4758-b246-6991016af760 tempest-VolumesDeleteCascade-1197991359 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:49:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-546fef93-7a64-4758-b246-6991016af760 tempest-VolumesDeleteCascade-1197991359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:55 devstack sudo[96522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724 1073741824
Nov 06 11:49:55 devstack sudo[96522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:56 devstack sudo[96522]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-546fef93-7a64-4758-b246-6991016af760 tempest-VolumesDeleteCascade-1197991359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724 1073741824" returned: 0 in 0.697s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-546fef93-7a64-4758-b246-6991016af760 tempest-VolumesDeleteCascade-1197991359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:56 devstack sudo[96528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724
Nov 06 11:49:56 devstack sudo[96528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:56 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-80bfc50e-5bcd-469f-8273-79235c8bf532 tempest-AbsoluteLimitsTests-80441014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:49:56 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-80bfc50e-5bcd-469f-8273-79235c8bf532 tempest-AbsoluteLimitsTests-80441014 None] Flow 'volume_create_manager' (e67dea09-45cc-4566-9ff2-d8de99ffabd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:49:56 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-80bfc50e-5bcd-469f-8273-79235c8bf532 tempest-AbsoluteLimitsTests-80441014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95c5a0dd-e6c2-4541-bdb5-f632b93eb881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:56 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-80bfc50e-5bcd-469f-8273-79235c8bf532 tempest-AbsoluteLimitsTests-80441014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95c5a0dd-e6c2-4541-bdb5-f632b93eb881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:49:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1364458276',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebce3818-a935-4a01-be4c-8e5c39888679,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94f5074dfa0c48e3a24225dee52fa73c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:49:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:49:56Z,use_quota=True,user_id='8e8c4cf3c58a4b98a6658ab65199b1b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:56 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-80bfc50e-5bcd-469f-8273-79235c8bf532 tempest-AbsoluteLimitsTests-80441014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a2fe854-aed2-4764-afcb-95d6f375434c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:56 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-80bfc50e-5bcd-469f-8273-79235c8bf532 tempest-AbsoluteLimitsTests-80441014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a2fe854-aed2-4764-afcb-95d6f375434c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:56 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-80bfc50e-5bcd-469f-8273-79235c8bf532 tempest-AbsoluteLimitsTests-80441014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce9eeb6b-aa16-447b-abdd-4bccc7e15e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:56 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-80bfc50e-5bcd-469f-8273-79235c8bf532 tempest-AbsoluteLimitsTests-80441014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce9eeb6b-aa16-447b-abdd-4bccc7e15e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebce3818-a935-4a01-be4c-8e5c39888679', 'volume_name': 'volume-ebce3818-a935-4a01-be4c-8e5c39888679', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:56 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-80bfc50e-5bcd-469f-8273-79235c8bf532 tempest-AbsoluteLimitsTests-80441014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80844b7d-4a02-4d86-9d0f-90d7581fc4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:56 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-80bfc50e-5bcd-469f-8273-79235c8bf532 tempest-AbsoluteLimitsTests-80441014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80844b7d-4a02-4d86-9d0f-90d7581fc4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:56 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-80bfc50e-5bcd-469f-8273-79235c8bf532 tempest-AbsoluteLimitsTests-80441014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14263423-0e1c-4033-a44c-37bd2a9f1753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:56 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-80bfc50e-5bcd-469f-8273-79235c8bf532 tempest-AbsoluteLimitsTests-80441014 None] Volume ebce3818-a935-4a01-be4c-8e5c39888679: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebce3818-a935-4a01-be4c-8e5c39888679', 'volume_size': 1}
Nov 06 11:49:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-80bfc50e-5bcd-469f-8273-79235c8bf532 tempest-AbsoluteLimitsTests-80441014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:49:56 devstack sudo[96528]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-546fef93-7a64-4758-b246-6991016af760 tempest-VolumesDeleteCascade-1197991359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724" returned: 0 in 0.299s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:56 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-546fef93-7a64-4758-b246-6991016af760 tempest-VolumesDeleteCascade-1197991359 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:49:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-546fef93-7a64-4758-b246-6991016af760 tempest-VolumesDeleteCascade-1197991359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:49:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-80bfc50e-5bcd-469f-8273-79235c8bf532 tempest-AbsoluteLimitsTests-80441014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.163s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:49:56 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-80bfc50e-5bcd-469f-8273-79235c8bf532 tempest-AbsoluteLimitsTests-80441014 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:49:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1364458276',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebce3818-a935-4a01-be4c-8e5c39888679,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94f5074dfa0c48e3a24225dee52fa73c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:49:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:49:56Z,use_quota=True,user_id='8e8c4cf3c58a4b98a6658ab65199b1b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:49:56 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-80bfc50e-5bcd-469f-8273-79235c8bf532 tempest-AbsoluteLimitsTests-80441014 None] Creating volume ebce3818-a935-4a01-be4c-8e5c39888679 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:49:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-80bfc50e-5bcd-469f-8273-79235c8bf532 tempest-AbsoluteLimitsTests-80441014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:49:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-80bfc50e-5bcd-469f-8273-79235c8bf532 tempest-AbsoluteLimitsTests-80441014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:49:56 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-80bfc50e-5bcd-469f-8273-79235c8bf532 tempest-AbsoluteLimitsTests-80441014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:49:56 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-80bfc50e-5bcd-469f-8273-79235c8bf532 tempest-AbsoluteLimitsTests-80441014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:49:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-80bfc50e-5bcd-469f-8273-79235c8bf532 tempest-AbsoluteLimitsTests-80441014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:49:56 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-80bfc50e-5bcd-469f-8273-79235c8bf532 tempest-AbsoluteLimitsTests-80441014 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:49:56 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-80bfc50e-5bcd-469f-8273-79235c8bf532 tempest-AbsoluteLimitsTests-80441014 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:49:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-80bfc50e-5bcd-469f-8273-79235c8bf532 tempest-AbsoluteLimitsTests-80441014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ebce3818-a935-4a01-be4c-8e5c39888679 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:56 devstack sudo[96531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ebce3818-a935-4a01-be4c-8e5c39888679 1073741824
Nov 06 11:49:56 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-546fef93-7a64-4758-b246-6991016af760 tempest-VolumesDeleteCascade-1197991359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2978635-6912-4a06-b5ff-23aa718dd75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b845d9b4-f414-4aad-895f-067eff181724', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:56 devstack sudo[96531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:56 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-546fef93-7a64-4758-b246-6991016af760 tempest-VolumesDeleteCascade-1197991359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (660c24d3-9119-40ff-ae3f-4ef3be7eaacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:56 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-546fef93-7a64-4758-b246-6991016af760 tempest-VolumesDeleteCascade-1197991359 None] Volume volume-b845d9b4-f414-4aad-895f-067eff181724 (b845d9b4-f414-4aad-895f-067eff181724): created successfully
Nov 06 11:49:56 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-546fef93-7a64-4758-b246-6991016af760 tempest-VolumesDeleteCascade-1197991359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (660c24d3-9119-40ff-ae3f-4ef3be7eaacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:56 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-546fef93-7a64-4758-b246-6991016af760 tempest-VolumesDeleteCascade-1197991359 None] Flow 'volume_create_manager' (b7a4b4b6-f7f0-48f9-8251-391028756d0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:49:56 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-546fef93-7a64-4758-b246-6991016af760 tempest-VolumesDeleteCascade-1197991359 None] Created volume successfully.
Nov 06 11:49:56 devstack sudo[96531]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-80bfc50e-5bcd-469f-8273-79235c8bf532 tempest-AbsoluteLimitsTests-80441014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ebce3818-a935-4a01-be4c-8e5c39888679 1073741824" returned: 0 in 0.548s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-80bfc50e-5bcd-469f-8273-79235c8bf532 tempest-AbsoluteLimitsTests-80441014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ebce3818-a935-4a01-be4c-8e5c39888679 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:56 devstack sudo[96537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ebce3818-a935-4a01-be4c-8e5c39888679
Nov 06 11:49:56 devstack sudo[96537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:57 devstack sudo[96537]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-80bfc50e-5bcd-469f-8273-79235c8bf532 tempest-AbsoluteLimitsTests-80441014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ebce3818-a935-4a01-be4c-8e5c39888679" returned: 0 in 0.265s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:57 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-80bfc50e-5bcd-469f-8273-79235c8bf532 tempest-AbsoluteLimitsTests-80441014 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:49:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-80bfc50e-5bcd-469f-8273-79235c8bf532 tempest-AbsoluteLimitsTests-80441014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:49:57 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-80bfc50e-5bcd-469f-8273-79235c8bf532 tempest-AbsoluteLimitsTests-80441014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14263423-0e1c-4033-a44c-37bd2a9f1753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebce3818-a935-4a01-be4c-8e5c39888679', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:57 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-80bfc50e-5bcd-469f-8273-79235c8bf532 tempest-AbsoluteLimitsTests-80441014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27d59156-8e69-44ae-9c1f-614a01d2a24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:57 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-80bfc50e-5bcd-469f-8273-79235c8bf532 tempest-AbsoluteLimitsTests-80441014 None] Volume volume-ebce3818-a935-4a01-be4c-8e5c39888679 (ebce3818-a935-4a01-be4c-8e5c39888679): created successfully
Nov 06 11:49:57 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-80bfc50e-5bcd-469f-8273-79235c8bf532 tempest-AbsoluteLimitsTests-80441014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27d59156-8e69-44ae-9c1f-614a01d2a24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:57 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-80bfc50e-5bcd-469f-8273-79235c8bf532 tempest-AbsoluteLimitsTests-80441014 None] Flow 'volume_create_manager' (e67dea09-45cc-4566-9ff2-d8de99ffabd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:49:57 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-80bfc50e-5bcd-469f-8273-79235c8bf532 tempest-AbsoluteLimitsTests-80441014 None] Created volume successfully.
Nov 06 11:49:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a15d7bd9-77aa-4b67-a4cb-8ace60f1b15f tempest-VolumesDeleteCascade-1197991359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:49:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a15d7bd9-77aa-4b67-a4cb-8ace60f1b15f tempest-VolumesDeleteCascade-1197991359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:49:57 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-a15d7bd9-77aa-4b67-a4cb-8ace60f1b15f tempest-VolumesDeleteCascade-1197991359 None] Creating offline snapshot 1a70af18-227e-4ac7-95be-4be76b0c7fbd of volume b845d9b4-f414-4aad-895f-067eff181724 {{(pid=87165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 11:49:57 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7410bd0c-6812-4fde-99c3-585dc89f6d4c]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:49:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a15d7bd9-77aa-4b67-a4cb-8ace60f1b15f tempest-VolumesDeleteCascade-1197991359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:57 devstack sudo[96540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724
Nov 06 11:49:57 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:57 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8d546b4-8366-4d39-9e9d-c7d27f3a3aaa tempest-VolumesCloneTest-1577573170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:49:57 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b8d546b4-8366-4d39-9e9d-c7d27f3a3aaa tempest-VolumesCloneTest-1577573170 None] Flow 'volume_create_manager' (6a94dfa2-11d3-40a8-a3b6-6476301c9999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:49:57 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b8d546b4-8366-4d39-9e9d-c7d27f3a3aaa tempest-VolumesCloneTest-1577573170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c47744c9-00a3-4514-9b15-295ef79793e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:57 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b8d546b4-8366-4d39-9e9d-c7d27f3a3aaa tempest-VolumesCloneTest-1577573170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c47744c9-00a3-4514-9b15-295ef79793e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:49:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1327230657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c26384d9-5bb8-4c08-970c-3cdd328d871b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cac9b39a74e4c15bf071304de272466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:49:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:49:58Z,use_quota=True,user_id='faad314b55ff49f28e90dcc27909e4a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:57 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b8d546b4-8366-4d39-9e9d-c7d27f3a3aaa tempest-VolumesCloneTest-1577573170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (322540bd-8994-4f76-8f4b-9dbd7bf143c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:57 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b8d546b4-8366-4d39-9e9d-c7d27f3a3aaa tempest-VolumesCloneTest-1577573170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (322540bd-8994-4f76-8f4b-9dbd7bf143c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:57 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b8d546b4-8366-4d39-9e9d-c7d27f3a3aaa tempest-VolumesCloneTest-1577573170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0160cd45-3b8a-4f1b-8c17-add266455769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:57 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b8d546b4-8366-4d39-9e9d-c7d27f3a3aaa tempest-VolumesCloneTest-1577573170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0160cd45-3b8a-4f1b-8c17-add266455769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c26384d9-5bb8-4c08-970c-3cdd328d871b', 'volume_name': 'volume-c26384d9-5bb8-4c08-970c-3cdd328d871b', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:57 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b8d546b4-8366-4d39-9e9d-c7d27f3a3aaa tempest-VolumesCloneTest-1577573170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (230c8399-49a0-4cce-9849-b2d6ea29adf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:57 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b8d546b4-8366-4d39-9e9d-c7d27f3a3aaa tempest-VolumesCloneTest-1577573170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (230c8399-49a0-4cce-9849-b2d6ea29adf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:49:57 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b8d546b4-8366-4d39-9e9d-c7d27f3a3aaa tempest-VolumesCloneTest-1577573170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ebb326b-6a53-483d-8282-433ad4fba0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:49:57 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-b8d546b4-8366-4d39-9e9d-c7d27f3a3aaa tempest-VolumesCloneTest-1577573170 None] Volume c26384d9-5bb8-4c08-970c-3cdd328d871b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c26384d9-5bb8-4c08-970c-3cdd328d871b', 'volume_size': 1}
Nov 06 11:49:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b8d546b4-8366-4d39-9e9d-c7d27f3a3aaa tempest-VolumesCloneTest-1577573170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:49:57 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a15d7bd9-77aa-4b67-a4cb-8ace60f1b15f tempest-VolumesDeleteCascade-1197991359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724" returned: 0 in 0.392s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a15d7bd9-77aa-4b67-a4cb-8ace60f1b15f tempest-VolumesDeleteCascade-1197991359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724.1a70af18-227e-4ac7-95be-4be76b0c7fbd 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:58 devstack sudo[96545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724.1a70af18-227e-4ac7-95be-4be76b0c7fbd 1G
Nov 06 11:49:58 devstack sudo[96545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:58 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-83fdca49-14c2-4a38-921d-ed934a374508 tempest-AbsoluteLimitsTests-80441014 None] Acquiring lock "cinder-ebce3818-a935-4a01-be4c-8e5c39888679-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:49:58 devstack sudo[96545]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a15d7bd9-77aa-4b67-a4cb-8ace60f1b15f tempest-VolumesDeleteCascade-1197991359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724.1a70af18-227e-4ac7-95be-4be76b0c7fbd 1G" returned: 0 in 0.460s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a15d7bd9-77aa-4b67-a4cb-8ace60f1b15f tempest-VolumesDeleteCascade-1197991359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b845d9b4-f414-4aad-895f-067eff181724 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724.1a70af18-227e-4ac7-95be-4be76b0c7fbd {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:58 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-83fdca49-14c2-4a38-921d-ed934a374508 tempest-AbsoluteLimitsTests-80441014 None] Lock "cinder-ebce3818-a935-4a01-be4c-8e5c39888679-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:49:58 devstack sudo[96551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b845d9b4-f414-4aad-895f-067eff181724 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724.1a70af18-227e-4ac7-95be-4be76b0c7fbd
Nov 06 11:49:58 devstack sudo[96551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:58 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-83fdca49-14c2-4a38-921d-ed934a374508 tempest-AbsoluteLimitsTests-80441014 None] Acquiring lock "cinder-quobyte-ebce3818-a935-4a01-be4c-8e5c39888679" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:49:58 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-83fdca49-14c2-4a38-921d-ed934a374508 tempest-AbsoluteLimitsTests-80441014 None] Lock "cinder-quobyte-ebce3818-a935-4a01-be4c-8e5c39888679" acquired by "delete_volume" :: waited 0.016s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:49:58 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84fdc1a-fffd-4c5a-9d79-c82648d9e64f]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:49:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-83fdca49-14c2-4a38-921d-ed934a374508 tempest-AbsoluteLimitsTests-80441014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ebce3818-a935-4a01-be4c-8e5c39888679 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:58 devstack sudo[96553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ebce3818-a935-4a01-be4c-8e5c39888679
Nov 06 11:49:58 devstack sudo[96553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:58 devstack sudo[96551]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a15d7bd9-77aa-4b67-a4cb-8ace60f1b15f tempest-VolumesDeleteCascade-1197991359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b845d9b4-f414-4aad-895f-067eff181724 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724.1a70af18-227e-4ac7-95be-4be76b0c7fbd" returned: 0 in 0.370s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:58 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-a15d7bd9-77aa-4b67-a4cb-8ace60f1b15f tempest-VolumesDeleteCascade-1197991359 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724.1a70af18-227e-4ac7-95be-4be76b0c7fbd is being set with open permissions: ugo+rw
Nov 06 11:49:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a15d7bd9-77aa-4b67-a4cb-8ace60f1b15f tempest-VolumesDeleteCascade-1197991359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724.1a70af18-227e-4ac7-95be-4be76b0c7fbd {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:58 devstack sudo[96559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724.1a70af18-227e-4ac7-95be-4be76b0c7fbd
Nov 06 11:49:58 devstack sudo[96559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:58 devstack sudo[96553]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-83fdca49-14c2-4a38-921d-ed934a374508 tempest-AbsoluteLimitsTests-80441014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ebce3818-a935-4a01-be4c-8e5c39888679" returned: 0 in 0.439s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-83fdca49-14c2-4a38-921d-ed934a374508 tempest-AbsoluteLimitsTests-80441014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ebce3818-a935-4a01-be4c-8e5c39888679 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:59 devstack sudo[96564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ebce3818-a935-4a01-be4c-8e5c39888679
Nov 06 11:49:59 devstack sudo[96564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:59 devstack sudo[96559]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a15d7bd9-77aa-4b67-a4cb-8ace60f1b15f tempest-VolumesDeleteCascade-1197991359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724.1a70af18-227e-4ac7-95be-4be76b0c7fbd" returned: 0 in 0.271s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a15d7bd9-77aa-4b67-a4cb-8ace60f1b15f tempest-VolumesDeleteCascade-1197991359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:59 devstack sudo[96567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724.info
Nov 06 11:49:59 devstack sudo[96567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:59 devstack sudo[96564]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-83fdca49-14c2-4a38-921d-ed934a374508 tempest-AbsoluteLimitsTests-80441014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ebce3818-a935-4a01-be4c-8e5c39888679" returned: 0 in 0.264s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:59 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-83fdca49-14c2-4a38-921d-ed934a374508 tempest-AbsoluteLimitsTests-80441014 None] Lock "cinder-quobyte-ebce3818-a935-4a01-be4c-8e5c39888679" released by "delete_volume" :: held 0.768s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:49:59 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-83fdca49-14c2-4a38-921d-ed934a374508 tempest-AbsoluteLimitsTests-80441014 None] Created reservations ['0f14180c-d03c-4c35-be3d-20a57952079f', '3c920cb5-eb10-4638-abc3-24fa14990953', '45a22592-dbf2-495f-b8ac-0e9ff5e03fe9', '26bd23e4-bc09-488c-862e-2ec901d57db1'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:49:59 devstack sudo[96567]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a15d7bd9-77aa-4b67-a4cb-8ace60f1b15f tempest-VolumesDeleteCascade-1197991359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724.info" returned: 0 in 0.281s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:59 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-a15d7bd9-77aa-4b67-a4cb-8ace60f1b15f tempest-VolumesDeleteCascade-1197991359 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724.info is being set with open permissions: ugo+rw
Nov 06 11:49:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a15d7bd9-77aa-4b67-a4cb-8ace60f1b15f tempest-VolumesDeleteCascade-1197991359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-83fdca49-14c2-4a38-921d-ed934a374508 tempest-AbsoluteLimitsTests-80441014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:49:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-83fdca49-14c2-4a38-921d-ed934a374508 tempest-AbsoluteLimitsTests-80441014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:49:59 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-83fdca49-14c2-4a38-921d-ed934a374508 tempest-AbsoluteLimitsTests-80441014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:49:59 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-83fdca49-14c2-4a38-921d-ed934a374508 tempest-AbsoluteLimitsTests-80441014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:49:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-83fdca49-14c2-4a38-921d-ed934a374508 tempest-AbsoluteLimitsTests-80441014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:49:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-83fdca49-14c2-4a38-921d-ed934a374508 tempest-AbsoluteLimitsTests-80441014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:59 devstack sudo[96571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724.info
Nov 06 11:49:59 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:59 devstack sudo[96573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:49:59 devstack sudo[96573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:59 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a15d7bd9-77aa-4b67-a4cb-8ace60f1b15f tempest-VolumesDeleteCascade-1197991359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724.info" returned: 0 in 0.310s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:59 devstack sudo[96573]: pam_unix(sudo:session): session closed for user root
Nov 06 11:49:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a15d7bd9-77aa-4b67-a4cb-8ace60f1b15f tempest-VolumesDeleteCascade-1197991359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.219s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:49:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b8d546b4-8366-4d39-9e9d-c7d27f3a3aaa tempest-VolumesCloneTest-1577573170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.913s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:49:59 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b8d546b4-8366-4d39-9e9d-c7d27f3a3aaa tempest-VolumesCloneTest-1577573170 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:49:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1327230657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c26384d9-5bb8-4c08-970c-3cdd328d871b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cac9b39a74e4c15bf071304de272466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:49:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:49:58Z,use_quota=True,user_id='faad314b55ff49f28e90dcc27909e4a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:49:59 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-b8d546b4-8366-4d39-9e9d-c7d27f3a3aaa tempest-VolumesCloneTest-1577573170 None] Creating volume c26384d9-5bb8-4c08-970c-3cdd328d871b {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:49:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b8d546b4-8366-4d39-9e9d-c7d27f3a3aaa tempest-VolumesCloneTest-1577573170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:49:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b8d546b4-8366-4d39-9e9d-c7d27f3a3aaa tempest-VolumesCloneTest-1577573170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:49:59 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b8d546b4-8366-4d39-9e9d-c7d27f3a3aaa tempest-VolumesCloneTest-1577573170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:49:59 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b8d546b4-8366-4d39-9e9d-c7d27f3a3aaa tempest-VolumesCloneTest-1577573170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:49:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b8d546b4-8366-4d39-9e9d-c7d27f3a3aaa tempest-VolumesCloneTest-1577573170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:49:59 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b8d546b4-8366-4d39-9e9d-c7d27f3a3aaa tempest-VolumesCloneTest-1577573170 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:49:59 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-b8d546b4-8366-4d39-9e9d-c7d27f3a3aaa tempest-VolumesCloneTest-1577573170 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:49:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b8d546b4-8366-4d39-9e9d-c7d27f3a3aaa tempest-VolumesCloneTest-1577573170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:49:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-83fdca49-14c2-4a38-921d-ed934a374508 tempest-AbsoluteLimitsTests-80441014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.366s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:49:59 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-83fdca49-14c2-4a38-921d-ed934a374508 tempest-AbsoluteLimitsTests-80441014 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:49:59 devstack sudo[96577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b 1073741824
Nov 06 11:49:59 devstack sudo[96577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:49:59 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-83fdca49-14c2-4a38-921d-ed934a374508 tempest-AbsoluteLimitsTests-80441014 None] Deleted volume successfully.
Nov 06 11:49:59 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-a15d7bd9-77aa-4b67-a4cb-8ace60f1b15f tempest-VolumesDeleteCascade-1197991359 None] Create snapshot completed successfully
Nov 06 11:49:59 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-83fdca49-14c2-4a38-921d-ed934a374508 tempest-AbsoluteLimitsTests-80441014 None] Lock "cinder-ebce3818-a935-4a01-be4c-8e5c39888679-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:50:00 devstack sudo[96577]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b8d546b4-8366-4d39-9e9d-c7d27f3a3aaa tempest-VolumesCloneTest-1577573170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b 1073741824" returned: 0 in 0.546s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b8d546b4-8366-4d39-9e9d-c7d27f3a3aaa tempest-VolumesCloneTest-1577573170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:00 devstack sudo[96583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b
Nov 06 11:50:00 devstack sudo[96583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:00 devstack sudo[96583]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b8d546b4-8366-4d39-9e9d-c7d27f3a3aaa tempest-VolumesCloneTest-1577573170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b" returned: 0 in 0.304s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:00 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b8d546b4-8366-4d39-9e9d-c7d27f3a3aaa tempest-VolumesCloneTest-1577573170 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:50:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b8d546b4-8366-4d39-9e9d-c7d27f3a3aaa tempest-VolumesCloneTest-1577573170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:50:00 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b8d546b4-8366-4d39-9e9d-c7d27f3a3aaa tempest-VolumesCloneTest-1577573170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ebb326b-6a53-483d-8282-433ad4fba0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c26384d9-5bb8-4c08-970c-3cdd328d871b', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:50:00 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b8d546b4-8366-4d39-9e9d-c7d27f3a3aaa tempest-VolumesCloneTest-1577573170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc64d25e-c2ac-4f80-8698-70e815cb89a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:50:00 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-b8d546b4-8366-4d39-9e9d-c7d27f3a3aaa tempest-VolumesCloneTest-1577573170 None] Volume volume-c26384d9-5bb8-4c08-970c-3cdd328d871b (c26384d9-5bb8-4c08-970c-3cdd328d871b): created successfully
Nov 06 11:50:00 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b8d546b4-8366-4d39-9e9d-c7d27f3a3aaa tempest-VolumesCloneTest-1577573170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc64d25e-c2ac-4f80-8698-70e815cb89a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:50:00 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b8d546b4-8366-4d39-9e9d-c7d27f3a3aaa tempest-VolumesCloneTest-1577573170 None] Flow 'volume_create_manager' (6a94dfa2-11d3-40a8-a3b6-6476301c9999) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:50:00 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-b8d546b4-8366-4d39-9e9d-c7d27f3a3aaa tempest-VolumesCloneTest-1577573170 None] Created volume successfully.
Nov 06 11:50:01 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:50:01 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] Flow 'volume_create_manager' (7c4ad8ca-3b0d-4fc8-a00f-c1171c991d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:50:01 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bef58143-bfd1-4b83-8796-976bf652c46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:50:01 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bef58143-bfd1-4b83-8796-976bf652c46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-230768364',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fc28013-da94-44c7-859d-dc7cea453548,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1869d4d82b410790a0e3d043c1b5ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1a70af18-227e-4ac7-95be-4be76b0c7fbd,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:50:02Z,use_quota=True,user_id='1171df5aba8844699f9aea72341bc7f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:50:01 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (887fdc30-ade8-4047-9545-e8513641f6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:50:01 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (887fdc30-ade8-4047-9545-e8513641f6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:50:01 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a3305a3-f859-4321-965c-9c346407b9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:50:01 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a3305a3-f859-4321-965c-9c346407b9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3fc28013-da94-44c7-859d-dc7cea453548', 'volume_name': 'volume-3fc28013-da94-44c7-859d-dc7cea453548', 'volume_size': 1, 'snapshot_id': '1a70af18-227e-4ac7-95be-4be76b0c7fbd'}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:50:01 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e26edf4-8fb6-4d88-9652-ca3961a8c477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:50:01 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e26edf4-8fb6-4d88-9652-ca3961a8c477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:50:01 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c727f3a-8afa-4675-a2ca-4349a706bf7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:50:01 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] Volume 3fc28013-da94-44c7-859d-dc7cea453548: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3fc28013-da94-44c7-859d-dc7cea453548', 'volume_size': 1, 'snapshot_id': '1a70af18-227e-4ac7-95be-4be76b0c7fbd'}
Nov 06 11:50:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:50:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:50:01 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] Acquiring lock "cinder-quobyte-1a70af18-227e-4ac7-95be-4be76b0c7fbd-3fc28013-da94-44c7-859d-dc7cea453548" by "_create_volume_from_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:50:01 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] Lock "cinder-quobyte-1a70af18-227e-4ac7-95be-4be76b0c7fbd-3fc28013-da94-44c7-859d-dc7cea453548" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:50:01 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] Creating volume 3fc28013-da94-44c7-859d-dc7cea453548 from snapshot 1a70af18-227e-4ac7-95be-4be76b0c7fbd {{(pid=87165) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 06 11:50:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:50:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:50:01 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:50:01 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:50:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:50:01 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:50:01 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] Acquiring lock "cinder-quobyte-3fc28013-da94-44c7-859d-dc7cea453548" by "_copy_volume_from_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:50:01 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] Lock "cinder-quobyte-3fc28013-da94-44c7-859d-dc7cea453548" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:50:02 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] snapshot: 1a70af18-227e-4ac7-95be-4be76b0c7fbd, volume: 3fc28013-da94-44c7-859d-dc7cea453548,  {{(pid=87165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 06 11:50:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:50:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:50:02 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:50:02 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:50:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:50:02 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:50:02 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[24608ddd-787b-407e-9ed3-6b46ad4db258]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:50:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724.1a70af18-227e-4ac7-95be-4be76b0c7fbd {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:02 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Flow 'volume_create_manager' (30ef1f51-66d3-4a6e-b35b-4a20093db622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:50:02 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8486bd4-2160-4230-a236-2c307198cbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:50:02 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8486bd4-2160-4230-a236-2c307198cbf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1552174107',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fa365fa-6715-43ba-9032-1bc70b8404d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cac9b39a74e4c15bf071304de272466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:50:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=c26384d9-5bb8-4c08-970c-3cdd328d871b,status='creating',terminated_at=None,updated_at=2026-11-06T10:50:02Z,use_quota=True,user_id='faad314b55ff49f28e90dcc27909e4a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:50:02 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6247e883-88a1-41a9-9c8a-b2989d1cfa10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:50:02 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6247e883-88a1-41a9-9c8a-b2989d1cfa10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:50:02 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c3fac14-b3e9-4c83-8166-b364ce1e0823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:50:02 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c3fac14-b3e9-4c83-8166-b364ce1e0823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9fa365fa-6715-43ba-9032-1bc70b8404d2', 'volume_name': 'volume-9fa365fa-6715-43ba-9032-1bc70b8404d2', 'volume_size': 2, 'source_volid': 'c26384d9-5bb8-4c08-970c-3cdd328d871b', 'source_volstatus': 'available'}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:50:02 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec9ecd59-1dbb-42e3-96e8-45b7cb7294e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:50:02 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec9ecd59-1dbb-42e3-96e8-45b7cb7294e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:50:02 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (394fa899-5b33-46bf-9fa9-04526cc2b115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:50:02 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Volume 9fa365fa-6715-43ba-9032-1bc70b8404d2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9fa365fa-6715-43ba-9032-1bc70b8404d2', 'volume_size': 2, 'source_volid': 'c26384d9-5bb8-4c08-970c-3cdd328d871b', 'source_volstatus': 'available'}
Nov 06 11:50:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:50:02 devstack sudo[96626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724.1a70af18-227e-4ac7-95be-4be76b0c7fbd
Nov 06 11:50:02 devstack sudo[96626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:02 devstack sudo[96626]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724.1a70af18-227e-4ac7-95be-4be76b0c7fbd" returned: 0 in 0.510s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:02 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b845d9b4-f414-4aad-895f-067eff181724(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:50:02 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ffe3ec3-6224-495a-9e44-9884713cfba0]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:50:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:02 devstack sudo[96631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724
Nov 06 11:50:02 devstack sudo[96631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:03 devstack sudo[96631]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724" returned: 0 in 0.451s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:03 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724 {{(pid=87165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 06 11:50:03 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] Creating direct copy from snapshot {{(pid=87165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 06 11:50:03 devstack cinder-volume[87165]: DEBUG cinder.utils [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] Path /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3fc28013-da94-44c7-859d-dc7cea453548 not found in is_blk_device check {{(pid=87165) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 06 11:50:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3fc28013-da94-44c7-859d-dc7cea453548 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:03 devstack sudo[96637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3fc28013-da94-44c7-859d-dc7cea453548
Nov 06 11:50:03 devstack sudo[96637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3fc28013-da94-44c7-859d-dc7cea453548" returned: 0 in 8.443s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:11 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] Image conversion details: src /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724, size 1024.00 MB, duration 8.44 sec, destination /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3fc28013-da94-44c7-859d-dc7cea453548 {{(pid=87165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 11:50:11 devstack cinder-volume[87165]: INFO cinder.image.image_utils [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] Converted 1024.00 MB image at 121.26 MB/s
Nov 06 11:50:11 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3fc28013-da94-44c7-859d-dc7cea453548 is being set with open permissions: ugo+rw
Nov 06 11:50:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3fc28013-da94-44c7-859d-dc7cea453548 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:11 devstack sudo[96660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3fc28013-da94-44c7-859d-dc7cea453548
Nov 06 11:50:11 devstack sudo[96660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:11 devstack sudo[96660]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3fc28013-da94-44c7-859d-dc7cea453548" returned: 0 in 0.270s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:11 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] Lock "cinder-quobyte-3fc28013-da94-44c7-859d-dc7cea453548" released by "_copy_volume_from_snapshot" :: held 9.794s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:50:11 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] Lock "cinder-quobyte-1a70af18-227e-4ac7-95be-4be76b0c7fbd-3fc28013-da94-44c7-859d-dc7cea453548" released by "_create_volume_from_snapshot" :: held 9.889s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:50:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.913s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:50:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 9.622s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:50:11 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Cloning volume c26384d9-5bb8-4c08-970c-3cdd328d871b to volume 9fa365fa-6715-43ba-9032-1bc70b8404d2
Nov 06 11:50:11 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c727f3a-8afa-4675-a2ca-4349a706bf7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fc28013-da94-44c7-859d-dc7cea453548', 'volume_size': 1, 'snapshot_id': '1a70af18-227e-4ac7-95be-4be76b0c7fbd'}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:50:11 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89a1e0aa-530b-40aa-9845-2c02a896a9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:50:11 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Creating offline snapshot 0942872a-6667-425a-b5f4-b41b6781221b of volume c26384d9-5bb8-4c08-970c-3cdd328d871b {{(pid=87165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 11:50:11 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] Volume volume-3fc28013-da94-44c7-859d-dc7cea453548 (3fc28013-da94-44c7-859d-dc7cea453548): created successfully
Nov 06 11:50:11 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89a1e0aa-530b-40aa-9845-2c02a896a9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:50:11 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] Flow 'volume_create_manager' (7c4ad8ca-3b0d-4fc8-a00f-c1171c991d07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:50:11 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[505f1cd9-51f8-4544-a34a-90f9856b2a68]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:50:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:11 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-50939ed9-8722-4954-b263-5bab91cbcda6 tempest-VolumesDeleteCascade-1197991359 None] Created volume successfully.
Nov 06 11:50:12 devstack sudo[96663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b
Nov 06 11:50:12 devstack sudo[96663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:12 devstack sudo[96663]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b" returned: 0 in 0.408s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b.0942872a-6667-425a-b5f4-b41b6781221b 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:12 devstack sudo[96668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b.0942872a-6667-425a-b5f4-b41b6781221b 1G
Nov 06 11:50:12 devstack sudo[96668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:12 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b1efac13-5304-48b0-9bad-ba030ab73564 tempest-VolumesDeleteCascade-1197991359 None] Acquiring lock "cinder-b845d9b4-f414-4aad-895f-067eff181724-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:50:12 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b1efac13-5304-48b0-9bad-ba030ab73564 tempest-VolumesDeleteCascade-1197991359 None] Lock "cinder-b845d9b4-f414-4aad-895f-067eff181724-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:50:12 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b1efac13-5304-48b0-9bad-ba030ab73564 tempest-VolumesDeleteCascade-1197991359 None] Performing cascade delete. {{(pid=87165) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Nov 06 11:50:12 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b1efac13-5304-48b0-9bad-ba030ab73564 tempest-VolumesDeleteCascade-1197991359 None] Acquiring lock "cinder-1a70af18-227e-4ac7-95be-4be76b0c7fbd-delete_snapshot" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:50:12 devstack sudo[96668]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:12 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b1efac13-5304-48b0-9bad-ba030ab73564 tempest-VolumesDeleteCascade-1197991359 None] Lock "cinder-1a70af18-227e-4ac7-95be-4be76b0c7fbd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:50:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b.0942872a-6667-425a-b5f4-b41b6781221b 1G" returned: 0 in 0.618s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c26384d9-5bb8-4c08-970c-3cdd328d871b -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b.0942872a-6667-425a-b5f4-b41b6781221b {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:12 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b1efac13-5304-48b0-9bad-ba030ab73564 tempest-VolumesDeleteCascade-1197991359 None] Acquiring lock "cinder-quobyte-b845d9b4-f414-4aad-895f-067eff181724" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:50:12 devstack sudo[96674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c26384d9-5bb8-4c08-970c-3cdd328d871b -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b.0942872a-6667-425a-b5f4-b41b6781221b
Nov 06 11:50:12 devstack sudo[96674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:13 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b1efac13-5304-48b0-9bad-ba030ab73564 tempest-VolumesDeleteCascade-1197991359 None] Lock "cinder-quobyte-b845d9b4-f414-4aad-895f-067eff181724" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:50:13 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b1efac13-5304-48b0-9bad-ba030ab73564 tempest-VolumesDeleteCascade-1197991359 None] Acquiring lock "cinder-quobyte-1a70af18-227e-4ac7-95be-4be76b0c7fbd" by "_delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:50:13 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b1efac13-5304-48b0-9bad-ba030ab73564 tempest-VolumesDeleteCascade-1197991359 None] Lock "cinder-quobyte-1a70af18-227e-4ac7-95be-4be76b0c7fbd" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:50:13 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-b1efac13-5304-48b0-9bad-ba030ab73564 tempest-VolumesDeleteCascade-1197991359 None] Deleting offline snapshot 1a70af18-227e-4ac7-95be-4be76b0c7fbd of volume b845d9b4-f414-4aad-895f-067eff181724 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 11:50:13 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-b1efac13-5304-48b0-9bad-ba030ab73564 tempest-VolumesDeleteCascade-1197991359 None] snapshot_file for this snap is: volume-b845d9b4-f414-4aad-895f-067eff181724.1a70af18-227e-4ac7-95be-4be76b0c7fbd {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 11:50:13 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa651237-4744-43a9-a0bc-4b00d18883ce]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:50:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b1efac13-5304-48b0-9bad-ba030ab73564 tempest-VolumesDeleteCascade-1197991359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724.1a70af18-227e-4ac7-95be-4be76b0c7fbd {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:13 devstack sudo[96676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724.1a70af18-227e-4ac7-95be-4be76b0c7fbd
Nov 06 11:50:13 devstack sudo[96676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:13 devstack sudo[96674]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c26384d9-5bb8-4c08-970c-3cdd328d871b -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b.0942872a-6667-425a-b5f4-b41b6781221b" returned: 0 in 0.339s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:13 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b.0942872a-6667-425a-b5f4-b41b6781221b is being set with open permissions: ugo+rw
Nov 06 11:50:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b.0942872a-6667-425a-b5f4-b41b6781221b {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:13 devstack sudo[96682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b.0942872a-6667-425a-b5f4-b41b6781221b
Nov 06 11:50:13 devstack sudo[96682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:13 devstack sudo[96676]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b1efac13-5304-48b0-9bad-ba030ab73564 tempest-VolumesDeleteCascade-1197991359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724.1a70af18-227e-4ac7-95be-4be76b0c7fbd" returned: 0 in 0.456s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:13 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-b1efac13-5304-48b0-9bad-ba030ab73564 tempest-VolumesDeleteCascade-1197991359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b845d9b4-f414-4aad-895f-067eff181724(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:50:13 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c833d5-ec2a-4c2c-8597-e7bd18fac14f]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:50:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b1efac13-5304-48b0-9bad-ba030ab73564 tempest-VolumesDeleteCascade-1197991359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:13 devstack sudo[96682]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b.0942872a-6667-425a-b5f4-b41b6781221b" returned: 0 in 0.289s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:13 devstack sudo[96691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b.info
Nov 06 11:50:13 devstack sudo[96691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:13 devstack sudo[96688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724
Nov 06 11:50:13 devstack sudo[96688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:14 devstack sudo[96691]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b.info" returned: 0 in 0.421s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:14 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b.info is being set with open permissions: ugo+rw
Nov 06 11:50:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:14 devstack sudo[96698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b.info
Nov 06 11:50:14 devstack sudo[96698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:14 devstack sudo[96688]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b1efac13-5304-48b0-9bad-ba030ab73564 tempest-VolumesDeleteCascade-1197991359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724" returned: 0 in 0.712s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b1efac13-5304-48b0-9bad-ba030ab73564 tempest-VolumesDeleteCascade-1197991359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724.1a70af18-227e-4ac7-95be-4be76b0c7fbd {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:14 devstack sudo[96703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724.1a70af18-227e-4ac7-95be-4be76b0c7fbd
Nov 06 11:50:14 devstack sudo[96703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:14 devstack sudo[96698]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b.info" returned: 0 in 0.312s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:14 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Acquiring lock "cinder-quobyte-9fa365fa-6715-43ba-9032-1bc70b8404d2" by "_copy_volume_from_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:50:14 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Lock "cinder-quobyte-9fa365fa-6715-43ba-9032-1bc70b8404d2" acquired by "_copy_volume_from_snapshot" :: waited 0.044s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:50:14 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] snapshot: 0942872a-6667-425a-b5f4-b41b6781221b, volume: 9fa365fa-6715-43ba-9032-1bc70b8404d2,  {{(pid=87165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 06 11:50:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:50:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:50:14 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:50:14 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:50:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:50:14 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5498da-b7e8-43b9-bd3d-2edfde1e4854]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:50:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b.0942872a-6667-425a-b5f4-b41b6781221b {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:14 devstack sudo[96707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b.0942872a-6667-425a-b5f4-b41b6781221b
Nov 06 11:50:14 devstack sudo[96707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:14 devstack sudo[96703]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b1efac13-5304-48b0-9bad-ba030ab73564 tempest-VolumesDeleteCascade-1197991359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724.1a70af18-227e-4ac7-95be-4be76b0c7fbd" returned: 0 in 0.607s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b1efac13-5304-48b0-9bad-ba030ab73564 tempest-VolumesDeleteCascade-1197991359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724.1a70af18-227e-4ac7-95be-4be76b0c7fbd {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:14 devstack sudo[96713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724.1a70af18-227e-4ac7-95be-4be76b0c7fbd
Nov 06 11:50:14 devstack sudo[96713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:15 devstack sudo[96707]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b.0942872a-6667-425a-b5f4-b41b6781221b" returned: 0 in 0.637s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:15 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c26384d9-5bb8-4c08-970c-3cdd328d871b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:50:15 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6ba5fd-a01a-4330-a53a-288fdfb42a41]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:50:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:15 devstack sudo[96713]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b1efac13-5304-48b0-9bad-ba030ab73564 tempest-VolumesDeleteCascade-1197991359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724.1a70af18-227e-4ac7-95be-4be76b0c7fbd" returned: 0 in 0.418s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:15 devstack sudo[96718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b
Nov 06 11:50:15 devstack sudo[96718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:15 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b1efac13-5304-48b0-9bad-ba030ab73564 tempest-VolumesDeleteCascade-1197991359 None] Lock "cinder-quobyte-1a70af18-227e-4ac7-95be-4be76b0c7fbd" released by "_delete_snapshot" :: held 2.355s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:50:15 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b1efac13-5304-48b0-9bad-ba030ab73564 tempest-VolumesDeleteCascade-1197991359 None] Lock "cinder-quobyte-b845d9b4-f414-4aad-895f-067eff181724" released by "delete_snapshot" :: held 2.394s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:50:15 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-b1efac13-5304-48b0-9bad-ba030ab73564 tempest-VolumesDeleteCascade-1197991359 None] Created reservations ['66c90ed3-9c64-4858-b0ff-c256f34b6608', '5f8c3bc5-fac5-4399-b1dd-ecdcffc16ecd', '4c5d2c6b-8754-456e-9daa-6948fe4f92fe', '39328cf9-d666-4dc8-b31f-17245de636f5'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:50:15 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-b1efac13-5304-48b0-9bad-ba030ab73564 tempest-VolumesDeleteCascade-1197991359 None] Delete snapshot completed successfully.
Nov 06 11:50:15 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b1efac13-5304-48b0-9bad-ba030ab73564 tempest-VolumesDeleteCascade-1197991359 None] Lock "cinder-1a70af18-227e-4ac7-95be-4be76b0c7fbd-delete_snapshot" released by "delete_snapshot" :: held 2.677s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:50:15 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b1efac13-5304-48b0-9bad-ba030ab73564 tempest-VolumesDeleteCascade-1197991359 None] Snapshots deleted, issuing volume delete {{(pid=87165) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Nov 06 11:50:15 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b1efac13-5304-48b0-9bad-ba030ab73564 tempest-VolumesDeleteCascade-1197991359 None] Acquiring lock "cinder-quobyte-b845d9b4-f414-4aad-895f-067eff181724" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:50:15 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b1efac13-5304-48b0-9bad-ba030ab73564 tempest-VolumesDeleteCascade-1197991359 None] Lock "cinder-quobyte-b845d9b4-f414-4aad-895f-067eff181724" acquired by "delete_volume" :: waited 0.014s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:50:15 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e96b02a-37d8-4e11-a6fa-fcdd543a6124]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:50:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b1efac13-5304-48b0-9bad-ba030ab73564 tempest-VolumesDeleteCascade-1197991359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:15 devstack sudo[96718]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b" returned: 0 in 0.587s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:15 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b {{(pid=87165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 06 11:50:15 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Creating direct copy from snapshot {{(pid=87165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 06 11:50:15 devstack cinder-volume[87165]: DEBUG cinder.utils [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Path /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9fa365fa-6715-43ba-9032-1bc70b8404d2 not found in is_blk_device check {{(pid=87165) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 06 11:50:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9fa365fa-6715-43ba-9032-1bc70b8404d2 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:15 devstack sudo[96727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9fa365fa-6715-43ba-9032-1bc70b8404d2
Nov 06 11:50:15 devstack sudo[96727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:15 devstack sudo[96723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724
Nov 06 11:50:15 devstack sudo[96723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:16 devstack sudo[96723]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b1efac13-5304-48b0-9bad-ba030ab73564 tempest-VolumesDeleteCascade-1197991359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724" returned: 0 in 0.575s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b1efac13-5304-48b0-9bad-ba030ab73564 tempest-VolumesDeleteCascade-1197991359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:16 devstack sudo[96745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724
Nov 06 11:50:16 devstack sudo[96745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:16 devstack sudo[96745]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b1efac13-5304-48b0-9bad-ba030ab73564 tempest-VolumesDeleteCascade-1197991359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b845d9b4-f414-4aad-895f-067eff181724" returned: 0 in 0.483s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:16 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b1efac13-5304-48b0-9bad-ba030ab73564 tempest-VolumesDeleteCascade-1197991359 None] Lock "cinder-quobyte-b845d9b4-f414-4aad-895f-067eff181724" released by "delete_volume" :: held 1.192s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:50:17 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-b1efac13-5304-48b0-9bad-ba030ab73564 tempest-VolumesDeleteCascade-1197991359 None] Created reservations ['b70578ca-5384-47eb-9a66-4c6af53d7eea', '2697a95e-2c60-4718-a181-2655102faf36', '79a2e701-94fb-411d-b2e0-2074909b677d', '32bee802-abe9-447f-9752-0d89acaadc54'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:50:17 devstack cinder-volume[87165]: DEBUG oslo_service.periodic_task [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 11:50:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:50:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:50:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:50:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:50:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:50:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:17 devstack sudo[96762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:50:17 devstack sudo[96762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b1efac13-5304-48b0-9bad-ba030ab73564 tempest-VolumesDeleteCascade-1197991359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:50:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b1efac13-5304-48b0-9bad-ba030ab73564 tempest-VolumesDeleteCascade-1197991359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:50:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b1efac13-5304-48b0-9bad-ba030ab73564 tempest-VolumesDeleteCascade-1197991359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:50:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b1efac13-5304-48b0-9bad-ba030ab73564 tempest-VolumesDeleteCascade-1197991359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:50:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b1efac13-5304-48b0-9bad-ba030ab73564 tempest-VolumesDeleteCascade-1197991359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:50:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b1efac13-5304-48b0-9bad-ba030ab73564 tempest-VolumesDeleteCascade-1197991359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:17 devstack sudo[96764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:50:17 devstack sudo[96764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:17 devstack sudo[96762]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.439s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:17 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:50:17 devstack cinder-volume[87165]: DEBUG oslo_service.periodic_task [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running periodic task VolumeManager._thread_info {{(pid=87165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 11:50:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] thread count: 28 {{(pid=87165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 11:50:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] thread info: [<_MainThread(MainThread, started 127732956901504)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127732842693056)>, <Thread(Thread-3 (stat_writer), started daemon 127732841891136)>, <Thread(Rabbit-heartbeat, started daemon 127732842515648)>, <Thread(Thread-5 (_runner), started daemon 127732840534464)>, <Thread(Thread-7 (_runner), started daemon 127732840636032)>, <Thread(fd_logger, started daemon 127732838664256)>, <Thread(privsep_reader, started daemon 127732838673408)>, <Thread(tpool_thread_0, started daemon 127732829828800)>, <Thread(tpool_thread_1, started daemon 127732821436096)>, <Thread(tpool_thread_2, started daemon 127732813043392)>, <Thread(tpool_thread_3, started daemon 127732804650688)>, <Thread(tpool_thread_4, started daemon 127732796257984)>, <Thread(tpool_thread_5, started daemon 127732787865280)>, <Thread(tpool_thread_6, started daemon 127732779456192)>, <Thread(tpool_thread_7, started daemon 127732771047104)>, <Thread(tpool_thread_8, started daemon 127732762638016)>, <Thread(tpool_thread_9, started daemon 127732754228928)>, <Thread(tpool_thread_10, started daemon 127732745819840)>, <Thread(tpool_thread_11, started daemon 127732737410752)>, <Thread(tpool_thread_12, started daemon 127732729001664)>, <Thread(tpool_thread_13, started daemon 127732720592576)>, <Thread(tpool_thread_14, started daemon 127732712183488)>, <Thread(tpool_thread_15, started daemon 127732703774400)>, <Thread(tpool_thread_16, started daemon 127732695365312)>, <Thread(tpool_thread_17, started daemon 127732686956224)>, <Thread(tpool_thread_18, started daemon 127732678547136)>, <Thread(tpool_thread_19, started daemon 127732670138048)>] {{(pid=87165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 11:50:18 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-064066fd-c58b-41cf-ac53-965b983f6b33 tempest-VolumesDeleteCascade-1197991359 None] Acquiring lock "cinder-3fc28013-da94-44c7-859d-dc7cea453548-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:50:18 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-064066fd-c58b-41cf-ac53-965b983f6b33 tempest-VolumesDeleteCascade-1197991359 None] Lock "cinder-3fc28013-da94-44c7-859d-dc7cea453548-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:50:18 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-064066fd-c58b-41cf-ac53-965b983f6b33 tempest-VolumesDeleteCascade-1197991359 None] Acquiring lock "cinder-quobyte-3fc28013-da94-44c7-859d-dc7cea453548" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:50:18 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-064066fd-c58b-41cf-ac53-965b983f6b33 tempest-VolumesDeleteCascade-1197991359 None] Lock "cinder-quobyte-3fc28013-da94-44c7-859d-dc7cea453548" acquired by "delete_volume" :: waited 0.036s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:50:18 devstack sudo[96764]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b1efac13-5304-48b0-9bad-ba030ab73564 tempest-VolumesDeleteCascade-1197991359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.953s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:18 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-b1efac13-5304-48b0-9bad-ba030ab73564 tempest-VolumesDeleteCascade-1197991359 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:50:18 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-b1efac13-5304-48b0-9bad-ba030ab73564 tempest-VolumesDeleteCascade-1197991359 None] Deleted volume successfully.
Nov 06 11:50:18 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca66763-a2db-438a-88a5-ffc3fc697559]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:50:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-064066fd-c58b-41cf-ac53-965b983f6b33 tempest-VolumesDeleteCascade-1197991359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3fc28013-da94-44c7-859d-dc7cea453548 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:18 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b1efac13-5304-48b0-9bad-ba030ab73564 tempest-VolumesDeleteCascade-1197991359 None] Lock "cinder-b845d9b4-f414-4aad-895f-067eff181724-delete_volume" released by "delete_volume" :: held 5.545s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:50:18 devstack sudo[96768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3fc28013-da94-44c7-859d-dc7cea453548
Nov 06 11:50:18 devstack sudo[96768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:19 devstack sudo[96768]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-064066fd-c58b-41cf-ac53-965b983f6b33 tempest-VolumesDeleteCascade-1197991359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3fc28013-da94-44c7-859d-dc7cea453548" returned: 0 in 0.831s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-064066fd-c58b-41cf-ac53-965b983f6b33 tempest-VolumesDeleteCascade-1197991359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3fc28013-da94-44c7-859d-dc7cea453548 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:19 devstack sudo[96773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3fc28013-da94-44c7-859d-dc7cea453548
Nov 06 11:50:19 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:19 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-064066fd-c58b-41cf-ac53-965b983f6b33 tempest-VolumesDeleteCascade-1197991359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3fc28013-da94-44c7-859d-dc7cea453548" returned: 0 in 0.553s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:19 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-064066fd-c58b-41cf-ac53-965b983f6b33 tempest-VolumesDeleteCascade-1197991359 None] Lock "cinder-quobyte-3fc28013-da94-44c7-859d-dc7cea453548" released by "delete_volume" :: held 1.500s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:50:19 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-064066fd-c58b-41cf-ac53-965b983f6b33 tempest-VolumesDeleteCascade-1197991359 None] Created reservations ['1cf8b7ce-9b1c-41a5-a7ad-352c25a60e47', '6a79f5aa-278d-494f-a293-6bac807e16de', '811dd48f-49ad-4a0d-a61d-c034bd56cf83', 'f0ae7d78-6a38-4c5b-b334-9e973a3b69ef'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:50:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-064066fd-c58b-41cf-ac53-965b983f6b33 tempest-VolumesDeleteCascade-1197991359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:50:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-064066fd-c58b-41cf-ac53-965b983f6b33 tempest-VolumesDeleteCascade-1197991359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:50:20 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-064066fd-c58b-41cf-ac53-965b983f6b33 tempest-VolumesDeleteCascade-1197991359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:50:20 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-064066fd-c58b-41cf-ac53-965b983f6b33 tempest-VolumesDeleteCascade-1197991359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:50:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-064066fd-c58b-41cf-ac53-965b983f6b33 tempest-VolumesDeleteCascade-1197991359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:50:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-064066fd-c58b-41cf-ac53-965b983f6b33 tempest-VolumesDeleteCascade-1197991359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:20 devstack sudo[96776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:50:20 devstack sudo[96776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:20 devstack sudo[96776]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-064066fd-c58b-41cf-ac53-965b983f6b33 tempest-VolumesDeleteCascade-1197991359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.698s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:20 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-064066fd-c58b-41cf-ac53-965b983f6b33 tempest-VolumesDeleteCascade-1197991359 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:50:20 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-064066fd-c58b-41cf-ac53-965b983f6b33 tempest-VolumesDeleteCascade-1197991359 None] Deleted volume successfully.
Nov 06 11:50:20 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-064066fd-c58b-41cf-ac53-965b983f6b33 tempest-VolumesDeleteCascade-1197991359 None] Lock "cinder-3fc28013-da94-44c7-859d-dc7cea453548-delete_volume" released by "delete_volume" :: held 2.696s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:50:26 devstack sudo[96727]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9fa365fa-6715-43ba-9032-1bc70b8404d2" returned: 0 in 10.881s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:26 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Image conversion details: src /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b, size 1024.00 MB, duration 10.88 sec, destination /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9fa365fa-6715-43ba-9032-1bc70b8404d2 {{(pid=87165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 11:50:26 devstack cinder-volume[87165]: INFO cinder.image.image_utils [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Converted 1024.00 MB image at 94.10 MB/s
Nov 06 11:50:26 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9fa365fa-6715-43ba-9032-1bc70b8404d2 is being set with open permissions: ugo+rw
Nov 06 11:50:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9fa365fa-6715-43ba-9032-1bc70b8404d2 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:26 devstack sudo[96852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9fa365fa-6715-43ba-9032-1bc70b8404d2
Nov 06 11:50:26 devstack sudo[96852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:27 devstack sudo[96852]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9fa365fa-6715-43ba-9032-1bc70b8404d2" returned: 0 in 0.518s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:27 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Lock "cinder-quobyte-9fa365fa-6715-43ba-9032-1bc70b8404d2" released by "_copy_volume_from_snapshot" :: held 12.798s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:50:27 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Acquiring lock "cinder-quobyte-0942872a-6667-425a-b5f4-b41b6781221b" by "_delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:50:27 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Lock "cinder-quobyte-0942872a-6667-425a-b5f4-b41b6781221b" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:50:27 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Deleting offline snapshot 0942872a-6667-425a-b5f4-b41b6781221b of volume c26384d9-5bb8-4c08-970c-3cdd328d871b {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 11:50:27 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] snapshot_file for this snap is: volume-c26384d9-5bb8-4c08-970c-3cdd328d871b.0942872a-6667-425a-b5f4-b41b6781221b {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 11:50:27 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[746d741f-77d1-4835-8a92-e6edae0a0586]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:50:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b.0942872a-6667-425a-b5f4-b41b6781221b {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:27 devstack sudo[96855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b.0942872a-6667-425a-b5f4-b41b6781221b
Nov 06 11:50:27 devstack sudo[96855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:28 devstack sudo[96855]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b.0942872a-6667-425a-b5f4-b41b6781221b" returned: 0 in 0.682s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:28 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c26384d9-5bb8-4c08-970c-3cdd328d871b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:50:28 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b42de1-508e-43c5-b821-78de672c3e51]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:50:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:28 devstack sudo[96860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b
Nov 06 11:50:28 devstack sudo[96860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:29 devstack sudo[96860]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b" returned: 0 in 0.922s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b.0942872a-6667-425a-b5f4-b41b6781221b {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:29 devstack sudo[96866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b.0942872a-6667-425a-b5f4-b41b6781221b
Nov 06 11:50:29 devstack sudo[96866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:29 devstack sudo[96866]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b.0942872a-6667-425a-b5f4-b41b6781221b" returned: 0 in 0.519s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b.0942872a-6667-425a-b5f4-b41b6781221b {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:29 devstack sudo[96872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b.0942872a-6667-425a-b5f4-b41b6781221b
Nov 06 11:50:29 devstack sudo[96872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:29 devstack sudo[96872]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b.0942872a-6667-425a-b5f4-b41b6781221b" returned: 0 in 0.435s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:30 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Lock "cinder-quobyte-0942872a-6667-425a-b5f4-b41b6781221b" released by "_delete_snapshot" :: held 2.724s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:50:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.315s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:50:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (394fa899-5b33-46bf-9fa9-04526cc2b115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fa365fa-6715-43ba-9032-1bc70b8404d2', 'volume_size': 2, 'source_volid': 'c26384d9-5bb8-4c08-970c-3cdd328d871b', 'source_volstatus': 'available'}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:50:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdfdea00-06b8-4b1e-a274-a42bbf4df765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:50:30 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Volume volume-9fa365fa-6715-43ba-9032-1bc70b8404d2 (9fa365fa-6715-43ba-9032-1bc70b8404d2): created successfully
Nov 06 11:50:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdfdea00-06b8-4b1e-a274-a42bbf4df765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:50:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Flow 'volume_create_manager' (30ef1f51-66d3-4a6e-b35b-4a20093db622) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:50:30 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-5cb312d4-5c9a-4e7d-8814-43f36ead01dc tempest-VolumesCloneTest-1577573170 None] Created volume successfully.
Nov 06 11:50:30 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbf2aad9-2b4c-4154-999e-d2a159563f05 tempest-VolumesMetadataTest-489332532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:50:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-bbf2aad9-2b4c-4154-999e-d2a159563f05 tempest-VolumesMetadataTest-489332532 None] Flow 'volume_create_manager' (ee5d7c65-b620-4c70-9847-0531afca525c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:50:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-bbf2aad9-2b4c-4154-999e-d2a159563f05 tempest-VolumesMetadataTest-489332532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5dd1659-f8dc-4fce-a15b-63a9d7205dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:50:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-bbf2aad9-2b4c-4154-999e-d2a159563f05 tempest-VolumesMetadataTest-489332532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5dd1659-f8dc-4fce-a15b-63a9d7205dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-277063868',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb88758b-b0af-4431-a472-c54bf874f304,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fcceb81b03842d484d980a88ac81048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:50:31Z,use_quota=True,user_id='32fff35b80db4575906b087b13fd7724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:50:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-bbf2aad9-2b4c-4154-999e-d2a159563f05 tempest-VolumesMetadataTest-489332532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc9bc33-8c83-4cea-b9f2-986bb420aefa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:50:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-bbf2aad9-2b4c-4154-999e-d2a159563f05 tempest-VolumesMetadataTest-489332532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc9bc33-8c83-4cea-b9f2-986bb420aefa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:50:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-bbf2aad9-2b4c-4154-999e-d2a159563f05 tempest-VolumesMetadataTest-489332532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f2649b1-56fc-4ef1-84ac-83ca53bc8f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:50:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-bbf2aad9-2b4c-4154-999e-d2a159563f05 tempest-VolumesMetadataTest-489332532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f2649b1-56fc-4ef1-84ac-83ca53bc8f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb88758b-b0af-4431-a472-c54bf874f304', 'volume_name': 'volume-bb88758b-b0af-4431-a472-c54bf874f304', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:50:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-bbf2aad9-2b4c-4154-999e-d2a159563f05 tempest-VolumesMetadataTest-489332532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59d81401-ec3d-4a90-b57a-39295af67521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:50:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-bbf2aad9-2b4c-4154-999e-d2a159563f05 tempest-VolumesMetadataTest-489332532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59d81401-ec3d-4a90-b57a-39295af67521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:50:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-bbf2aad9-2b4c-4154-999e-d2a159563f05 tempest-VolumesMetadataTest-489332532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f35d6740-a432-4ede-8a31-37f88adf4ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:50:30 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-bbf2aad9-2b4c-4154-999e-d2a159563f05 tempest-VolumesMetadataTest-489332532 None] Volume bb88758b-b0af-4431-a472-c54bf874f304: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb88758b-b0af-4431-a472-c54bf874f304', 'volume_size': 1}
Nov 06 11:50:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-bbf2aad9-2b4c-4154-999e-d2a159563f05 tempest-VolumesMetadataTest-489332532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:50:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-bbf2aad9-2b4c-4154-999e-d2a159563f05 tempest-VolumesMetadataTest-489332532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:50:30 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-bbf2aad9-2b4c-4154-999e-d2a159563f05 tempest-VolumesMetadataTest-489332532 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-277063868',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb88758b-b0af-4431-a472-c54bf874f304,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fcceb81b03842d484d980a88ac81048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:50:31Z,use_quota=True,user_id='32fff35b80db4575906b087b13fd7724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:50:30 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-bbf2aad9-2b4c-4154-999e-d2a159563f05 tempest-VolumesMetadataTest-489332532 None] Creating volume bb88758b-b0af-4431-a472-c54bf874f304 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:50:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-bbf2aad9-2b4c-4154-999e-d2a159563f05 tempest-VolumesMetadataTest-489332532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:50:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-bbf2aad9-2b4c-4154-999e-d2a159563f05 tempest-VolumesMetadataTest-489332532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:50:30 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-bbf2aad9-2b4c-4154-999e-d2a159563f05 tempest-VolumesMetadataTest-489332532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:50:30 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-bbf2aad9-2b4c-4154-999e-d2a159563f05 tempest-VolumesMetadataTest-489332532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:50:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-bbf2aad9-2b4c-4154-999e-d2a159563f05 tempest-VolumesMetadataTest-489332532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:50:30 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-bbf2aad9-2b4c-4154-999e-d2a159563f05 tempest-VolumesMetadataTest-489332532 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:50:30 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-bbf2aad9-2b4c-4154-999e-d2a159563f05 tempest-VolumesMetadataTest-489332532 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:50:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bbf2aad9-2b4c-4154-999e-d2a159563f05 tempest-VolumesMetadataTest-489332532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bb88758b-b0af-4431-a472-c54bf874f304 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:30 devstack sudo[96875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bb88758b-b0af-4431-a472-c54bf874f304 1073741824
Nov 06 11:50:30 devstack sudo[96875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:31 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c1fca88c-1df3-4dcc-91b4-cb3c880c535e tempest-VolumesCloneTest-1577573170 None] Acquiring lock "cinder-9fa365fa-6715-43ba-9032-1bc70b8404d2-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:50:31 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6c1d037-fb8e-47ad-925f-a96ccaef1224 tempest-VolumesActionsTest-1030226880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:50:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f6c1d037-fb8e-47ad-925f-a96ccaef1224 tempest-VolumesActionsTest-1030226880 None] Flow 'volume_create_manager' (3df26f8e-f5b8-4284-8bef-50fbcdae83c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:50:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f6c1d037-fb8e-47ad-925f-a96ccaef1224 tempest-VolumesActionsTest-1030226880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e510faed-07d8-40bb-b080-bfdce95563cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:50:31 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c1fca88c-1df3-4dcc-91b4-cb3c880c535e tempest-VolumesCloneTest-1577573170 None] Lock "cinder-9fa365fa-6715-43ba-9032-1bc70b8404d2-delete_volume" acquired by "delete_volume" :: waited 0.149s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:50:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f6c1d037-fb8e-47ad-925f-a96ccaef1224 tempest-VolumesActionsTest-1030226880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e510faed-07d8-40bb-b080-bfdce95563cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1306183287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78f5be1d-0fc7-4c47-95da-3df83f2d9d38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95dcf7bf30dd48faa8e75e347bb76688',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:50:31Z,use_quota=True,user_id='00cc4a5791b942f998f51a5633f77b73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:50:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f6c1d037-fb8e-47ad-925f-a96ccaef1224 tempest-VolumesActionsTest-1030226880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eef5f475-1bec-46d4-8c32-40e8712a7e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:50:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f6c1d037-fb8e-47ad-925f-a96ccaef1224 tempest-VolumesActionsTest-1030226880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eef5f475-1bec-46d4-8c32-40e8712a7e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:50:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f6c1d037-fb8e-47ad-925f-a96ccaef1224 tempest-VolumesActionsTest-1030226880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (245bbec3-a813-4d1f-bb6d-f8ab1db2ed22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:50:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f6c1d037-fb8e-47ad-925f-a96ccaef1224 tempest-VolumesActionsTest-1030226880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (245bbec3-a813-4d1f-bb6d-f8ab1db2ed22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78f5be1d-0fc7-4c47-95da-3df83f2d9d38', 'volume_name': 'volume-78f5be1d-0fc7-4c47-95da-3df83f2d9d38', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:50:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f6c1d037-fb8e-47ad-925f-a96ccaef1224 tempest-VolumesActionsTest-1030226880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17ff8b37-eb56-4e18-8a69-cdfe5f152b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:50:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f6c1d037-fb8e-47ad-925f-a96ccaef1224 tempest-VolumesActionsTest-1030226880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17ff8b37-eb56-4e18-8a69-cdfe5f152b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:50:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f6c1d037-fb8e-47ad-925f-a96ccaef1224 tempest-VolumesActionsTest-1030226880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1d97923-3696-42af-b434-1c93718b62fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:50:31 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-f6c1d037-fb8e-47ad-925f-a96ccaef1224 tempest-VolumesActionsTest-1030226880 None] Volume 78f5be1d-0fc7-4c47-95da-3df83f2d9d38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78f5be1d-0fc7-4c47-95da-3df83f2d9d38', 'volume_size': 1}
Nov 06 11:50:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f6c1d037-fb8e-47ad-925f-a96ccaef1224 tempest-VolumesActionsTest-1030226880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:50:31 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c1fca88c-1df3-4dcc-91b4-cb3c880c535e tempest-VolumesCloneTest-1577573170 None] Acquiring lock "cinder-quobyte-9fa365fa-6715-43ba-9032-1bc70b8404d2" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:50:31 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c1fca88c-1df3-4dcc-91b4-cb3c880c535e tempest-VolumesCloneTest-1577573170 None] Lock "cinder-quobyte-9fa365fa-6715-43ba-9032-1bc70b8404d2" acquired by "delete_volume" :: waited 0.020s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:50:31 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3583c41-5dfa-45df-a9ee-4c84335b1ba3]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:50:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c1fca88c-1df3-4dcc-91b4-cb3c880c535e tempest-VolumesCloneTest-1577573170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9fa365fa-6715-43ba-9032-1bc70b8404d2 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:31 devstack sudo[96882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9fa365fa-6715-43ba-9032-1bc70b8404d2
Nov 06 11:50:31 devstack sudo[96882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:31 devstack sudo[96875]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bbf2aad9-2b4c-4154-999e-d2a159563f05 tempest-VolumesMetadataTest-489332532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bb88758b-b0af-4431-a472-c54bf874f304 1073741824" returned: 0 in 0.758s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bbf2aad9-2b4c-4154-999e-d2a159563f05 tempest-VolumesMetadataTest-489332532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bb88758b-b0af-4431-a472-c54bf874f304 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:31 devstack sudo[96884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bb88758b-b0af-4431-a472-c54bf874f304
Nov 06 11:50:31 devstack sudo[96884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:31 devstack sudo[96882]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c1fca88c-1df3-4dcc-91b4-cb3c880c535e tempest-VolumesCloneTest-1577573170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9fa365fa-6715-43ba-9032-1bc70b8404d2" returned: 0 in 0.540s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c1fca88c-1df3-4dcc-91b4-cb3c880c535e tempest-VolumesCloneTest-1577573170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9fa365fa-6715-43ba-9032-1bc70b8404d2 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:31 devstack sudo[96890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9fa365fa-6715-43ba-9032-1bc70b8404d2
Nov 06 11:50:31 devstack sudo[96890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:32 devstack sudo[96884]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bbf2aad9-2b4c-4154-999e-d2a159563f05 tempest-VolumesMetadataTest-489332532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bb88758b-b0af-4431-a472-c54bf874f304" returned: 0 in 0.356s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:32 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-bbf2aad9-2b4c-4154-999e-d2a159563f05 tempest-VolumesMetadataTest-489332532 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:50:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-bbf2aad9-2b4c-4154-999e-d2a159563f05 tempest-VolumesMetadataTest-489332532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:50:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f6c1d037-fb8e-47ad-925f-a96ccaef1224 tempest-VolumesActionsTest-1030226880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.704s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:50:32 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-f6c1d037-fb8e-47ad-925f-a96ccaef1224 tempest-VolumesActionsTest-1030226880 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1306183287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78f5be1d-0fc7-4c47-95da-3df83f2d9d38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95dcf7bf30dd48faa8e75e347bb76688',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:50:31Z,use_quota=True,user_id='00cc4a5791b942f998f51a5633f77b73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:50:32 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-f6c1d037-fb8e-47ad-925f-a96ccaef1224 tempest-VolumesActionsTest-1030226880 None] Creating volume 78f5be1d-0fc7-4c47-95da-3df83f2d9d38 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:50:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f6c1d037-fb8e-47ad-925f-a96ccaef1224 tempest-VolumesActionsTest-1030226880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:50:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f6c1d037-fb8e-47ad-925f-a96ccaef1224 tempest-VolumesActionsTest-1030226880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:50:32 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-f6c1d037-fb8e-47ad-925f-a96ccaef1224 tempest-VolumesActionsTest-1030226880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:50:32 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-f6c1d037-fb8e-47ad-925f-a96ccaef1224 tempest-VolumesActionsTest-1030226880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:50:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f6c1d037-fb8e-47ad-925f-a96ccaef1224 tempest-VolumesActionsTest-1030226880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:50:32 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-f6c1d037-fb8e-47ad-925f-a96ccaef1224 tempest-VolumesActionsTest-1030226880 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:50:32 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-f6c1d037-fb8e-47ad-925f-a96ccaef1224 tempest-VolumesActionsTest-1030226880 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:50:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f6c1d037-fb8e-47ad-925f-a96ccaef1224 tempest-VolumesActionsTest-1030226880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-78f5be1d-0fc7-4c47-95da-3df83f2d9d38 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-bbf2aad9-2b4c-4154-999e-d2a159563f05 tempest-VolumesMetadataTest-489332532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f35d6740-a432-4ede-8a31-37f88adf4ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb88758b-b0af-4431-a472-c54bf874f304', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:50:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-bbf2aad9-2b4c-4154-999e-d2a159563f05 tempest-VolumesMetadataTest-489332532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (280f0266-e167-4399-a9c5-b18aa256e91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:50:32 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-bbf2aad9-2b4c-4154-999e-d2a159563f05 tempest-VolumesMetadataTest-489332532 None] Volume volume-bb88758b-b0af-4431-a472-c54bf874f304 (bb88758b-b0af-4431-a472-c54bf874f304): created successfully
Nov 06 11:50:32 devstack sudo[96893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-78f5be1d-0fc7-4c47-95da-3df83f2d9d38 1073741824
Nov 06 11:50:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-bbf2aad9-2b4c-4154-999e-d2a159563f05 tempest-VolumesMetadataTest-489332532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (280f0266-e167-4399-a9c5-b18aa256e91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:50:32 devstack sudo[96893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-bbf2aad9-2b4c-4154-999e-d2a159563f05 tempest-VolumesMetadataTest-489332532 None] Flow 'volume_create_manager' (ee5d7c65-b620-4c70-9847-0531afca525c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:50:32 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-bbf2aad9-2b4c-4154-999e-d2a159563f05 tempest-VolumesMetadataTest-489332532 None] Created volume successfully.
Nov 06 11:50:32 devstack sudo[96890]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c1fca88c-1df3-4dcc-91b4-cb3c880c535e tempest-VolumesCloneTest-1577573170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9fa365fa-6715-43ba-9032-1bc70b8404d2" returned: 0 in 0.403s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:32 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c1fca88c-1df3-4dcc-91b4-cb3c880c535e tempest-VolumesCloneTest-1577573170 None] Lock "cinder-quobyte-9fa365fa-6715-43ba-9032-1bc70b8404d2" released by "delete_volume" :: held 0.999s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:50:32 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-c1fca88c-1df3-4dcc-91b4-cb3c880c535e tempest-VolumesCloneTest-1577573170 None] Created reservations ['54d54384-baf5-4b4e-86a0-abc9773b10cd', 'fa8ac32e-253a-47b7-a43c-714ad2a646c1', '5d503ef2-0c5a-4863-914b-a9800343a700', '96f6d032-c858-425b-a38d-2680a7b965cd'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:50:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c1fca88c-1df3-4dcc-91b4-cb3c880c535e tempest-VolumesCloneTest-1577573170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:50:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c1fca88c-1df3-4dcc-91b4-cb3c880c535e tempest-VolumesCloneTest-1577573170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:50:32 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-c1fca88c-1df3-4dcc-91b4-cb3c880c535e tempest-VolumesCloneTest-1577573170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:50:32 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-c1fca88c-1df3-4dcc-91b4-cb3c880c535e tempest-VolumesCloneTest-1577573170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:50:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c1fca88c-1df3-4dcc-91b4-cb3c880c535e tempest-VolumesCloneTest-1577573170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:50:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c1fca88c-1df3-4dcc-91b4-cb3c880c535e tempest-VolumesCloneTest-1577573170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:32 devstack sudo[96899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:50:32 devstack sudo[96899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:32 devstack sudo[96893]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f6c1d037-fb8e-47ad-925f-a96ccaef1224 tempest-VolumesActionsTest-1030226880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-78f5be1d-0fc7-4c47-95da-3df83f2d9d38 1073741824" returned: 0 in 0.613s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f6c1d037-fb8e-47ad-925f-a96ccaef1224 tempest-VolumesActionsTest-1030226880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-78f5be1d-0fc7-4c47-95da-3df83f2d9d38 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:32 devstack sudo[96902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-78f5be1d-0fc7-4c47-95da-3df83f2d9d38
Nov 06 11:50:32 devstack sudo[96902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:32 devstack sudo[96899]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c1fca88c-1df3-4dcc-91b4-cb3c880c535e tempest-VolumesCloneTest-1577573170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.341s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:32 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-c1fca88c-1df3-4dcc-91b4-cb3c880c535e tempest-VolumesCloneTest-1577573170 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:50:32 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-c1fca88c-1df3-4dcc-91b4-cb3c880c535e tempest-VolumesCloneTest-1577573170 None] Deleted volume successfully.
Nov 06 11:50:32 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c1fca88c-1df3-4dcc-91b4-cb3c880c535e tempest-VolumesCloneTest-1577573170 None] Lock "cinder-9fa365fa-6715-43ba-9032-1bc70b8404d2-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:50:33 devstack sudo[96902]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f6c1d037-fb8e-47ad-925f-a96ccaef1224 tempest-VolumesActionsTest-1030226880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-78f5be1d-0fc7-4c47-95da-3df83f2d9d38" returned: 0 in 0.416s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:33 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-f6c1d037-fb8e-47ad-925f-a96ccaef1224 tempest-VolumesActionsTest-1030226880 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:50:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f6c1d037-fb8e-47ad-925f-a96ccaef1224 tempest-VolumesActionsTest-1030226880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:50:33 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f6c1d037-fb8e-47ad-925f-a96ccaef1224 tempest-VolumesActionsTest-1030226880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1d97923-3696-42af-b434-1c93718b62fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78f5be1d-0fc7-4c47-95da-3df83f2d9d38', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:50:33 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f6c1d037-fb8e-47ad-925f-a96ccaef1224 tempest-VolumesActionsTest-1030226880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4fbd9ba-0415-449a-86d3-e53d1a7c7345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:50:33 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-f6c1d037-fb8e-47ad-925f-a96ccaef1224 tempest-VolumesActionsTest-1030226880 None] Volume volume-78f5be1d-0fc7-4c47-95da-3df83f2d9d38 (78f5be1d-0fc7-4c47-95da-3df83f2d9d38): created successfully
Nov 06 11:50:33 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f6c1d037-fb8e-47ad-925f-a96ccaef1224 tempest-VolumesActionsTest-1030226880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4fbd9ba-0415-449a-86d3-e53d1a7c7345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:50:33 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f6c1d037-fb8e-47ad-925f-a96ccaef1224 tempest-VolumesActionsTest-1030226880 None] Flow 'volume_create_manager' (3df26f8e-f5b8-4284-8bef-50fbcdae83c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:50:33 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-f6c1d037-fb8e-47ad-925f-a96ccaef1224 tempest-VolumesActionsTest-1030226880 None] Created volume successfully.
Nov 06 11:50:33 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c4b5e07d-576e-4a1b-9db1-008db59fc3d4 tempest-VolumesCloneTest-1577573170 None] Acquiring lock "cinder-c26384d9-5bb8-4c08-970c-3cdd328d871b-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:50:33 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c4b5e07d-576e-4a1b-9db1-008db59fc3d4 tempest-VolumesCloneTest-1577573170 None] Lock "cinder-c26384d9-5bb8-4c08-970c-3cdd328d871b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:50:33 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c4b5e07d-576e-4a1b-9db1-008db59fc3d4 tempest-VolumesCloneTest-1577573170 None] Acquiring lock "cinder-quobyte-c26384d9-5bb8-4c08-970c-3cdd328d871b" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:50:33 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c4b5e07d-576e-4a1b-9db1-008db59fc3d4 tempest-VolumesCloneTest-1577573170 None] Lock "cinder-quobyte-c26384d9-5bb8-4c08-970c-3cdd328d871b" acquired by "delete_volume" :: waited 0.030s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:50:33 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ac04bd-a91f-4dae-8295-3d4fb9d24941]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:50:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c4b5e07d-576e-4a1b-9db1-008db59fc3d4 tempest-VolumesCloneTest-1577573170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:33 devstack sudo[96906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b
Nov 06 11:50:33 devstack sudo[96906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:33 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ad5c5ea0-7f12-4ec1-8612-d0138de7b640 tempest-VolumesMetadataTest-489332532 None] Acquiring lock "cinder-bb88758b-b0af-4431-a472-c54bf874f304-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:50:33 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ad5c5ea0-7f12-4ec1-8612-d0138de7b640 tempest-VolumesMetadataTest-489332532 None] Lock "cinder-bb88758b-b0af-4431-a472-c54bf874f304-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:50:33 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ad5c5ea0-7f12-4ec1-8612-d0138de7b640 tempest-VolumesMetadataTest-489332532 None] Acquiring lock "cinder-quobyte-bb88758b-b0af-4431-a472-c54bf874f304" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:50:33 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ad5c5ea0-7f12-4ec1-8612-d0138de7b640 tempest-VolumesMetadataTest-489332532 None] Lock "cinder-quobyte-bb88758b-b0af-4431-a472-c54bf874f304" acquired by "delete_volume" :: waited 0.031s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:50:33 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0aa1027-4ff7-43f5-9b31-98a461c6233e]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:50:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ad5c5ea0-7f12-4ec1-8612-d0138de7b640 tempest-VolumesMetadataTest-489332532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bb88758b-b0af-4431-a472-c54bf874f304 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:34 devstack sudo[96908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bb88758b-b0af-4431-a472-c54bf874f304
Nov 06 11:50:34 devstack sudo[96908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:34 devstack sudo[96906]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c4b5e07d-576e-4a1b-9db1-008db59fc3d4 tempest-VolumesCloneTest-1577573170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b" returned: 0 in 0.560s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c4b5e07d-576e-4a1b-9db1-008db59fc3d4 tempest-VolumesCloneTest-1577573170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:34 devstack sudo[96913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b
Nov 06 11:50:34 devstack sudo[96913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:34 devstack sudo[96908]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ad5c5ea0-7f12-4ec1-8612-d0138de7b640 tempest-VolumesMetadataTest-489332532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bb88758b-b0af-4431-a472-c54bf874f304" returned: 0 in 0.480s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ad5c5ea0-7f12-4ec1-8612-d0138de7b640 tempest-VolumesMetadataTest-489332532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bb88758b-b0af-4431-a472-c54bf874f304 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:34 devstack sudo[96913]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c4b5e07d-576e-4a1b-9db1-008db59fc3d4 tempest-VolumesCloneTest-1577573170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c26384d9-5bb8-4c08-970c-3cdd328d871b" returned: 0 in 0.286s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:34 devstack sudo[96922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bb88758b-b0af-4431-a472-c54bf874f304
Nov 06 11:50:34 devstack sudo[96922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:34 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c4b5e07d-576e-4a1b-9db1-008db59fc3d4 tempest-VolumesCloneTest-1577573170 None] Lock "cinder-quobyte-c26384d9-5bb8-4c08-970c-3cdd328d871b" released by "delete_volume" :: held 0.941s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:50:34 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-c4b5e07d-576e-4a1b-9db1-008db59fc3d4 tempest-VolumesCloneTest-1577573170 None] Created reservations ['a19bd4ac-5445-40c6-90f2-027ad4c8831b', 'f63417bc-c19d-4a47-a5c8-5142f999670c', '9f42898c-28ca-4e78-9637-262c412cd19e', '8b9f8f64-39cc-4cc9-9f61-02b8ea447c3f'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:50:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c4b5e07d-576e-4a1b-9db1-008db59fc3d4 tempest-VolumesCloneTest-1577573170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:50:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c4b5e07d-576e-4a1b-9db1-008db59fc3d4 tempest-VolumesCloneTest-1577573170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:50:34 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-c4b5e07d-576e-4a1b-9db1-008db59fc3d4 tempest-VolumesCloneTest-1577573170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:50:34 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-c4b5e07d-576e-4a1b-9db1-008db59fc3d4 tempest-VolumesCloneTest-1577573170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:50:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c4b5e07d-576e-4a1b-9db1-008db59fc3d4 tempest-VolumesCloneTest-1577573170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:50:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c4b5e07d-576e-4a1b-9db1-008db59fc3d4 tempest-VolumesCloneTest-1577573170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:34 devstack sudo[96922]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ad5c5ea0-7f12-4ec1-8612-d0138de7b640 tempest-VolumesMetadataTest-489332532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bb88758b-b0af-4431-a472-c54bf874f304" returned: 0 in 0.319s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:34 devstack sudo[96925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:50:34 devstack sudo[96925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:34 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ad5c5ea0-7f12-4ec1-8612-d0138de7b640 tempest-VolumesMetadataTest-489332532 None] Lock "cinder-quobyte-bb88758b-b0af-4431-a472-c54bf874f304" released by "delete_volume" :: held 0.859s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:50:34 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-ad5c5ea0-7f12-4ec1-8612-d0138de7b640 tempest-VolumesMetadataTest-489332532 None] Created reservations ['b8a7d280-f887-46a9-90fa-b7e2754ee65e', 'ffb20b71-4cb2-4be0-aaa3-b57a88b35727', 'c13a6335-36be-4212-ad4e-8e9f8bfa806e', 'b7675feb-707d-46b0-9b22-8fec6be266cd'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:50:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ad5c5ea0-7f12-4ec1-8612-d0138de7b640 tempest-VolumesMetadataTest-489332532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:50:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ad5c5ea0-7f12-4ec1-8612-d0138de7b640 tempest-VolumesMetadataTest-489332532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:50:34 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ad5c5ea0-7f12-4ec1-8612-d0138de7b640 tempest-VolumesMetadataTest-489332532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:50:34 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ad5c5ea0-7f12-4ec1-8612-d0138de7b640 tempest-VolumesMetadataTest-489332532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:50:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ad5c5ea0-7f12-4ec1-8612-d0138de7b640 tempest-VolumesMetadataTest-489332532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:50:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ad5c5ea0-7f12-4ec1-8612-d0138de7b640 tempest-VolumesMetadataTest-489332532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:34 devstack sudo[96927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:50:34 devstack sudo[96927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:35 devstack sudo[96927]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:35 devstack sudo[96925]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c4b5e07d-576e-4a1b-9db1-008db59fc3d4 tempest-VolumesCloneTest-1577573170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.625s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:35 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-c4b5e07d-576e-4a1b-9db1-008db59fc3d4 tempest-VolumesCloneTest-1577573170 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:50:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ad5c5ea0-7f12-4ec1-8612-d0138de7b640 tempest-VolumesMetadataTest-489332532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.348s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:35 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-ad5c5ea0-7f12-4ec1-8612-d0138de7b640 tempest-VolumesMetadataTest-489332532 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:50:35 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-c4b5e07d-576e-4a1b-9db1-008db59fc3d4 tempest-VolumesCloneTest-1577573170 None] Deleted volume successfully.
Nov 06 11:50:35 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c4b5e07d-576e-4a1b-9db1-008db59fc3d4 tempest-VolumesCloneTest-1577573170 None] Lock "cinder-c26384d9-5bb8-4c08-970c-3cdd328d871b-delete_volume" released by "delete_volume" :: held 1.927s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:50:35 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-ad5c5ea0-7f12-4ec1-8612-d0138de7b640 tempest-VolumesMetadataTest-489332532 None] Deleted volume successfully.
Nov 06 11:50:35 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ad5c5ea0-7f12-4ec1-8612-d0138de7b640 tempest-VolumesMetadataTest-489332532 None] Lock "cinder-bb88758b-b0af-4431-a472-c54bf874f304-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:50:42 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:SELECT=98,cinder:INSERT=29,cinder:UPDATE=116,cinder:DELETE=8 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 11:50:42 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:UPDATE=125,cinder:DELETE=13,cinder:SELECT=86,cinder:INSERT=32 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 11:50:42 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-96e26b9a-6b27-4ba0-b3d7-f16bf5c78ca5 tempest-VolumesTransfersV357Test-277983063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:50:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-96e26b9a-6b27-4ba0-b3d7-f16bf5c78ca5 tempest-VolumesTransfersV357Test-277983063 None] Flow 'volume_create_manager' (0902a1d0-0a0d-4f43-b780-33b6a981eb1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:50:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-96e26b9a-6b27-4ba0-b3d7-f16bf5c78ca5 tempest-VolumesTransfersV357Test-277983063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e94feeb8-19c2-4ca4-9666-e53fa21fe962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:50:43 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-96e26b9a-6b27-4ba0-b3d7-f16bf5c78ca5 tempest-VolumesTransfersV357Test-277983063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e94feeb8-19c2-4ca4-9666-e53fa21fe962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:50:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1143599802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86e208ec-b84e-48d7-bcc5-67d409be4fa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4044ee54f26b4dc68e2bcab7999d62cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:50:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:50:43Z,use_quota=True,user_id='84aa291fdbe647fea0b62bb4e6d40dfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:50:43 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-96e26b9a-6b27-4ba0-b3d7-f16bf5c78ca5 tempest-VolumesTransfersV357Test-277983063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39578fd6-c640-4619-9148-6c6b6ea2dd59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:50:43 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-96e26b9a-6b27-4ba0-b3d7-f16bf5c78ca5 tempest-VolumesTransfersV357Test-277983063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39578fd6-c640-4619-9148-6c6b6ea2dd59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:50:43 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-96e26b9a-6b27-4ba0-b3d7-f16bf5c78ca5 tempest-VolumesTransfersV357Test-277983063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc89d681-5c7e-47dc-806c-e3474aa1a0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:50:43 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-96e26b9a-6b27-4ba0-b3d7-f16bf5c78ca5 tempest-VolumesTransfersV357Test-277983063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc89d681-5c7e-47dc-806c-e3474aa1a0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86e208ec-b84e-48d7-bcc5-67d409be4fa9', 'volume_name': 'volume-86e208ec-b84e-48d7-bcc5-67d409be4fa9', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:50:43 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-96e26b9a-6b27-4ba0-b3d7-f16bf5c78ca5 tempest-VolumesTransfersV357Test-277983063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb89777b-87af-4e3d-b7be-413ef6cfb799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:50:43 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-96e26b9a-6b27-4ba0-b3d7-f16bf5c78ca5 tempest-VolumesTransfersV357Test-277983063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb89777b-87af-4e3d-b7be-413ef6cfb799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:50:43 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-96e26b9a-6b27-4ba0-b3d7-f16bf5c78ca5 tempest-VolumesTransfersV357Test-277983063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65a9d0b6-4317-42bc-a636-036c23ef0528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:50:43 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-96e26b9a-6b27-4ba0-b3d7-f16bf5c78ca5 tempest-VolumesTransfersV357Test-277983063 None] Volume 86e208ec-b84e-48d7-bcc5-67d409be4fa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86e208ec-b84e-48d7-bcc5-67d409be4fa9', 'volume_size': 1}
Nov 06 11:50:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-96e26b9a-6b27-4ba0-b3d7-f16bf5c78ca5 tempest-VolumesTransfersV357Test-277983063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:50:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-96e26b9a-6b27-4ba0-b3d7-f16bf5c78ca5 tempest-VolumesTransfersV357Test-277983063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:50:43 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-96e26b9a-6b27-4ba0-b3d7-f16bf5c78ca5 tempest-VolumesTransfersV357Test-277983063 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:50:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1143599802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86e208ec-b84e-48d7-bcc5-67d409be4fa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4044ee54f26b4dc68e2bcab7999d62cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:50:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:50:43Z,use_quota=True,user_id='84aa291fdbe647fea0b62bb4e6d40dfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:50:43 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-96e26b9a-6b27-4ba0-b3d7-f16bf5c78ca5 tempest-VolumesTransfersV357Test-277983063 None] Creating volume 86e208ec-b84e-48d7-bcc5-67d409be4fa9 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:50:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-96e26b9a-6b27-4ba0-b3d7-f16bf5c78ca5 tempest-VolumesTransfersV357Test-277983063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:50:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-96e26b9a-6b27-4ba0-b3d7-f16bf5c78ca5 tempest-VolumesTransfersV357Test-277983063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:50:43 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-96e26b9a-6b27-4ba0-b3d7-f16bf5c78ca5 tempest-VolumesTransfersV357Test-277983063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:50:43 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-96e26b9a-6b27-4ba0-b3d7-f16bf5c78ca5 tempest-VolumesTransfersV357Test-277983063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:50:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-96e26b9a-6b27-4ba0-b3d7-f16bf5c78ca5 tempest-VolumesTransfersV357Test-277983063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:50:43 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-96e26b9a-6b27-4ba0-b3d7-f16bf5c78ca5 tempest-VolumesTransfersV357Test-277983063 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:50:43 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-96e26b9a-6b27-4ba0-b3d7-f16bf5c78ca5 tempest-VolumesTransfersV357Test-277983063 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:50:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-96e26b9a-6b27-4ba0-b3d7-f16bf5c78ca5 tempest-VolumesTransfersV357Test-277983063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-86e208ec-b84e-48d7-bcc5-67d409be4fa9 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:43 devstack sudo[97038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-86e208ec-b84e-48d7-bcc5-67d409be4fa9 1073741824
Nov 06 11:50:43 devstack sudo[97038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:43 devstack sudo[97038]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-96e26b9a-6b27-4ba0-b3d7-f16bf5c78ca5 tempest-VolumesTransfersV357Test-277983063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-86e208ec-b84e-48d7-bcc5-67d409be4fa9 1073741824" returned: 0 in 0.603s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-96e26b9a-6b27-4ba0-b3d7-f16bf5c78ca5 tempest-VolumesTransfersV357Test-277983063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-86e208ec-b84e-48d7-bcc5-67d409be4fa9 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:43 devstack sudo[97045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-86e208ec-b84e-48d7-bcc5-67d409be4fa9
Nov 06 11:50:43 devstack sudo[97045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:43 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-036619b1-76a4-4fbc-94f3-c04831163984 tempest-VolumesActionsTest-1030226880 None] Acquiring lock "cinder-78f5be1d-0fc7-4c47-95da-3df83f2d9d38" by "attach_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:50:43 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-036619b1-76a4-4fbc-94f3-c04831163984 tempest-VolumesActionsTest-1030226880 None] Lock "cinder-78f5be1d-0fc7-4c47-95da-3df83f2d9d38" acquired by "attach_volume" :: waited 0.042s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:50:44 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-036619b1-76a4-4fbc-94f3-c04831163984 tempest-VolumesActionsTest-1030226880 None] Attaching volume 78f5be1d-0fc7-4c47-95da-3df83f2d9d38 to instance f5557f9b-7e07-44e1-8ccd-c142176c3a7e at mountpoint /dev/vdb on host None.
Nov 06 11:50:44 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-036619b1-76a4-4fbc-94f3-c04831163984 tempest-VolumesActionsTest-1030226880 None] Attach volume completed successfully.
Nov 06 11:50:44 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-036619b1-76a4-4fbc-94f3-c04831163984 tempest-VolumesActionsTest-1030226880 None] Lock "cinder-78f5be1d-0fc7-4c47-95da-3df83f2d9d38" released by "attach_volume" :: held 0.173s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:50:44 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-2cc5d023-8806-44cb-9539-13550efe6b59 tempest-VolumesActionsTest-1030226880 None] Acquiring lock "cinder-78f5be1d-0fc7-4c47-95da-3df83f2d9d38-detach_volume" by "detach_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:50:44 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-2cc5d023-8806-44cb-9539-13550efe6b59 tempest-VolumesActionsTest-1030226880 None] Lock "cinder-78f5be1d-0fc7-4c47-95da-3df83f2d9d38-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:50:44 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-2cc5d023-8806-44cb-9539-13550efe6b59 tempest-VolumesActionsTest-1030226880 None] Detaching volume 78f5be1d-0fc7-4c47-95da-3df83f2d9d38 from instance f5557f9b-7e07-44e1-8ccd-c142176c3a7e.
Nov 06 11:50:44 devstack sudo[97045]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-96e26b9a-6b27-4ba0-b3d7-f16bf5c78ca5 tempest-VolumesTransfersV357Test-277983063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-86e208ec-b84e-48d7-bcc5-67d409be4fa9" returned: 0 in 0.539s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:44 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-96e26b9a-6b27-4ba0-b3d7-f16bf5c78ca5 tempest-VolumesTransfersV357Test-277983063 None] <== create_volume: return (1232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:50:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-96e26b9a-6b27-4ba0-b3d7-f16bf5c78ca5 tempest-VolumesTransfersV357Test-277983063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:50:44 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-96e26b9a-6b27-4ba0-b3d7-f16bf5c78ca5 tempest-VolumesTransfersV357Test-277983063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65a9d0b6-4317-42bc-a636-036c23ef0528) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86e208ec-b84e-48d7-bcc5-67d409be4fa9', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:50:44 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-96e26b9a-6b27-4ba0-b3d7-f16bf5c78ca5 tempest-VolumesTransfersV357Test-277983063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa224f25-3e94-4592-b19c-dbe9acd8fbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:50:44 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-2cc5d023-8806-44cb-9539-13550efe6b59 tempest-VolumesActionsTest-1030226880 None] Detach volume completed successfully.
Nov 06 11:50:44 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-96e26b9a-6b27-4ba0-b3d7-f16bf5c78ca5 tempest-VolumesTransfersV357Test-277983063 None] Volume volume-86e208ec-b84e-48d7-bcc5-67d409be4fa9 (86e208ec-b84e-48d7-bcc5-67d409be4fa9): created successfully
Nov 06 11:50:44 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-96e26b9a-6b27-4ba0-b3d7-f16bf5c78ca5 tempest-VolumesTransfersV357Test-277983063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa224f25-3e94-4592-b19c-dbe9acd8fbcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:50:44 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-96e26b9a-6b27-4ba0-b3d7-f16bf5c78ca5 tempest-VolumesTransfersV357Test-277983063 None] Flow 'volume_create_manager' (0902a1d0-0a0d-4f43-b780-33b6a981eb1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:50:44 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-2cc5d023-8806-44cb-9539-13550efe6b59 tempest-VolumesActionsTest-1030226880 None] Lock "cinder-78f5be1d-0fc7-4c47-95da-3df83f2d9d38-detach_volume" released by "detach_volume" :: held 0.136s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:50:44 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-96e26b9a-6b27-4ba0-b3d7-f16bf5c78ca5 tempest-VolumesTransfersV357Test-277983063 None] Created volume successfully.
Nov 06 11:50:46 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-bfd00f40-28d2-4c48-bc50-8877c69f7025 tempest-VolumesTransfersV357Test-462892227 None] Transfer volume completed successfully.
Nov 06 11:50:46 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-7784c31a-d761-44e8-99ce-c6f7e8d69174 tempest-VolumesTransfersV357Test-1377964454 None] Acquiring lock "cinder-86e208ec-b84e-48d7-bcc5-67d409be4fa9-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:50:46 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-7784c31a-d761-44e8-99ce-c6f7e8d69174 tempest-VolumesTransfersV357Test-1377964454 None] Lock "cinder-86e208ec-b84e-48d7-bcc5-67d409be4fa9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:50:46 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-7784c31a-d761-44e8-99ce-c6f7e8d69174 tempest-VolumesTransfersV357Test-1377964454 None] Acquiring lock "cinder-quobyte-86e208ec-b84e-48d7-bcc5-67d409be4fa9" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:50:46 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-7784c31a-d761-44e8-99ce-c6f7e8d69174 tempest-VolumesTransfersV357Test-1377964454 None] Lock "cinder-quobyte-86e208ec-b84e-48d7-bcc5-67d409be4fa9" acquired by "delete_volume" :: waited 0.019s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:50:46 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff4f0a8-b76e-4645-9074-3bfa5182646c]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:50:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7784c31a-d761-44e8-99ce-c6f7e8d69174 tempest-VolumesTransfersV357Test-1377964454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-86e208ec-b84e-48d7-bcc5-67d409be4fa9 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:47 devstack sudo[97076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-86e208ec-b84e-48d7-bcc5-67d409be4fa9
Nov 06 11:50:47 devstack sudo[97076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:47 devstack sudo[97076]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7784c31a-d761-44e8-99ce-c6f7e8d69174 tempest-VolumesTransfersV357Test-1377964454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-86e208ec-b84e-48d7-bcc5-67d409be4fa9" returned: 0 in 0.496s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7784c31a-d761-44e8-99ce-c6f7e8d69174 tempest-VolumesTransfersV357Test-1377964454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-86e208ec-b84e-48d7-bcc5-67d409be4fa9 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:47 devstack sudo[97082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-86e208ec-b84e-48d7-bcc5-67d409be4fa9
Nov 06 11:50:47 devstack sudo[97082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:47 devstack sudo[97082]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7784c31a-d761-44e8-99ce-c6f7e8d69174 tempest-VolumesTransfersV357Test-1377964454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-86e208ec-b84e-48d7-bcc5-67d409be4fa9" returned: 0 in 0.309s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:47 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-7784c31a-d761-44e8-99ce-c6f7e8d69174 tempest-VolumesTransfersV357Test-1377964454 None] Lock "cinder-quobyte-86e208ec-b84e-48d7-bcc5-67d409be4fa9" released by "delete_volume" :: held 0.864s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:50:47 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-7784c31a-d761-44e8-99ce-c6f7e8d69174 tempest-VolumesTransfersV357Test-1377964454 None] Created reservations ['105c83c9-d1a8-4f5a-8f49-51f0defe3b3a', '0862b929-d450-46ca-8c6e-c8e771afb72d', 'bd7e0fe3-04cc-4dea-b24f-382a8f9e9367', 'eeda3239-6ff8-43bc-b1d5-cb15e07208c0'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:50:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-7784c31a-d761-44e8-99ce-c6f7e8d69174 tempest-VolumesTransfersV357Test-1377964454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:50:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-7784c31a-d761-44e8-99ce-c6f7e8d69174 tempest-VolumesTransfersV357Test-1377964454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:50:47 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-7784c31a-d761-44e8-99ce-c6f7e8d69174 tempest-VolumesTransfersV357Test-1377964454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:50:47 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-7784c31a-d761-44e8-99ce-c6f7e8d69174 tempest-VolumesTransfersV357Test-1377964454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:50:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-7784c31a-d761-44e8-99ce-c6f7e8d69174 tempest-VolumesTransfersV357Test-1377964454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:50:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7784c31a-d761-44e8-99ce-c6f7e8d69174 tempest-VolumesTransfersV357Test-1377964454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:47 devstack sudo[97085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:50:47 devstack sudo[97085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:48 devstack sudo[97085]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7784c31a-d761-44e8-99ce-c6f7e8d69174 tempest-VolumesTransfersV357Test-1377964454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.266s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:48 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-7784c31a-d761-44e8-99ce-c6f7e8d69174 tempest-VolumesTransfersV357Test-1377964454 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:50:48 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-7784c31a-d761-44e8-99ce-c6f7e8d69174 tempest-VolumesTransfersV357Test-1377964454 None] Deleted volume successfully.
Nov 06 11:50:48 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-7784c31a-d761-44e8-99ce-c6f7e8d69174 tempest-VolumesTransfersV357Test-1377964454 None] Lock "cinder-86e208ec-b84e-48d7-bcc5-67d409be4fa9-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:50:48 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ba11373-33a6-4ab1-b59d-332af1d2a9f3 tempest-VolumesTransfersV357Test-277983063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:50:48 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2ba11373-33a6-4ab1-b59d-332af1d2a9f3 tempest-VolumesTransfersV357Test-277983063 None] Flow 'volume_create_manager' (d82fc455-3895-4b55-8b4a-d0536d1a7145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:50:48 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2ba11373-33a6-4ab1-b59d-332af1d2a9f3 tempest-VolumesTransfersV357Test-277983063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a52c3a82-e320-46f7-9b8e-3c8f134220fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:50:48 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2ba11373-33a6-4ab1-b59d-332af1d2a9f3 tempest-VolumesTransfersV357Test-277983063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a52c3a82-e320-46f7-9b8e-3c8f134220fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-996442989',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a56fe41-10e5-4f44-8ad8-c5ca6bb49ecf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4044ee54f26b4dc68e2bcab7999d62cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:50:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:50:49Z,use_quota=True,user_id='84aa291fdbe647fea0b62bb4e6d40dfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:50:48 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2ba11373-33a6-4ab1-b59d-332af1d2a9f3 tempest-VolumesTransfersV357Test-277983063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fcd0ea1-aaf2-44e8-9386-f37f0ffe0990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:50:48 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2ba11373-33a6-4ab1-b59d-332af1d2a9f3 tempest-VolumesTransfersV357Test-277983063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fcd0ea1-aaf2-44e8-9386-f37f0ffe0990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:50:48 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2ba11373-33a6-4ab1-b59d-332af1d2a9f3 tempest-VolumesTransfersV357Test-277983063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ef4584b-4a31-4aa3-96a2-96b4c7604587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:50:48 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2ba11373-33a6-4ab1-b59d-332af1d2a9f3 tempest-VolumesTransfersV357Test-277983063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ef4584b-4a31-4aa3-96a2-96b4c7604587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a56fe41-10e5-4f44-8ad8-c5ca6bb49ecf', 'volume_name': 'volume-5a56fe41-10e5-4f44-8ad8-c5ca6bb49ecf', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:50:48 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2ba11373-33a6-4ab1-b59d-332af1d2a9f3 tempest-VolumesTransfersV357Test-277983063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffef7efb-cf58-4a89-9057-4c95aa0941f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:50:48 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2ba11373-33a6-4ab1-b59d-332af1d2a9f3 tempest-VolumesTransfersV357Test-277983063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffef7efb-cf58-4a89-9057-4c95aa0941f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:50:48 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2ba11373-33a6-4ab1-b59d-332af1d2a9f3 tempest-VolumesTransfersV357Test-277983063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c31b0e36-3ba1-41a3-9cfd-56046df56361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:50:48 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-2ba11373-33a6-4ab1-b59d-332af1d2a9f3 tempest-VolumesTransfersV357Test-277983063 None] Volume 5a56fe41-10e5-4f44-8ad8-c5ca6bb49ecf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a56fe41-10e5-4f44-8ad8-c5ca6bb49ecf', 'volume_size': 1}
Nov 06 11:50:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-2ba11373-33a6-4ab1-b59d-332af1d2a9f3 tempest-VolumesTransfersV357Test-277983063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:50:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-2ba11373-33a6-4ab1-b59d-332af1d2a9f3 tempest-VolumesTransfersV357Test-277983063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:50:48 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-2ba11373-33a6-4ab1-b59d-332af1d2a9f3 tempest-VolumesTransfersV357Test-277983063 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-996442989',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a56fe41-10e5-4f44-8ad8-c5ca6bb49ecf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4044ee54f26b4dc68e2bcab7999d62cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:50:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:50:49Z,use_quota=True,user_id='84aa291fdbe647fea0b62bb4e6d40dfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:50:48 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-2ba11373-33a6-4ab1-b59d-332af1d2a9f3 tempest-VolumesTransfersV357Test-277983063 None] Creating volume 5a56fe41-10e5-4f44-8ad8-c5ca6bb49ecf {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:50:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-2ba11373-33a6-4ab1-b59d-332af1d2a9f3 tempest-VolumesTransfersV357Test-277983063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:50:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-2ba11373-33a6-4ab1-b59d-332af1d2a9f3 tempest-VolumesTransfersV357Test-277983063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:50:48 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-2ba11373-33a6-4ab1-b59d-332af1d2a9f3 tempest-VolumesTransfersV357Test-277983063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:50:48 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-2ba11373-33a6-4ab1-b59d-332af1d2a9f3 tempest-VolumesTransfersV357Test-277983063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:50:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-2ba11373-33a6-4ab1-b59d-332af1d2a9f3 tempest-VolumesTransfersV357Test-277983063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:50:48 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-2ba11373-33a6-4ab1-b59d-332af1d2a9f3 tempest-VolumesTransfersV357Test-277983063 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:50:48 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-2ba11373-33a6-4ab1-b59d-332af1d2a9f3 tempest-VolumesTransfersV357Test-277983063 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:50:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2ba11373-33a6-4ab1-b59d-332af1d2a9f3 tempest-VolumesTransfersV357Test-277983063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5a56fe41-10e5-4f44-8ad8-c5ca6bb49ecf 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:48 devstack sudo[97096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5a56fe41-10e5-4f44-8ad8-c5ca6bb49ecf 1073741824
Nov 06 11:50:48 devstack sudo[97096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:49 devstack sudo[97096]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2ba11373-33a6-4ab1-b59d-332af1d2a9f3 tempest-VolumesTransfersV357Test-277983063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5a56fe41-10e5-4f44-8ad8-c5ca6bb49ecf 1073741824" returned: 0 in 0.512s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2ba11373-33a6-4ab1-b59d-332af1d2a9f3 tempest-VolumesTransfersV357Test-277983063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5a56fe41-10e5-4f44-8ad8-c5ca6bb49ecf {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:49 devstack sudo[97105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5a56fe41-10e5-4f44-8ad8-c5ca6bb49ecf
Nov 06 11:50:49 devstack sudo[97105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:49 devstack sudo[97105]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2ba11373-33a6-4ab1-b59d-332af1d2a9f3 tempest-VolumesTransfersV357Test-277983063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5a56fe41-10e5-4f44-8ad8-c5ca6bb49ecf" returned: 0 in 0.284s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:49 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-2ba11373-33a6-4ab1-b59d-332af1d2a9f3 tempest-VolumesTransfersV357Test-277983063 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:50:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-2ba11373-33a6-4ab1-b59d-332af1d2a9f3 tempest-VolumesTransfersV357Test-277983063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:50:49 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2ba11373-33a6-4ab1-b59d-332af1d2a9f3 tempest-VolumesTransfersV357Test-277983063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c31b0e36-3ba1-41a3-9cfd-56046df56361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a56fe41-10e5-4f44-8ad8-c5ca6bb49ecf', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:50:49 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2ba11373-33a6-4ab1-b59d-332af1d2a9f3 tempest-VolumesTransfersV357Test-277983063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8876c85-5ac8-4bc9-ad25-d33c26cb2b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:50:49 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-2ba11373-33a6-4ab1-b59d-332af1d2a9f3 tempest-VolumesTransfersV357Test-277983063 None] Volume volume-5a56fe41-10e5-4f44-8ad8-c5ca6bb49ecf (5a56fe41-10e5-4f44-8ad8-c5ca6bb49ecf): created successfully
Nov 06 11:50:49 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2ba11373-33a6-4ab1-b59d-332af1d2a9f3 tempest-VolumesTransfersV357Test-277983063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8876c85-5ac8-4bc9-ad25-d33c26cb2b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:50:49 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2ba11373-33a6-4ab1-b59d-332af1d2a9f3 tempest-VolumesTransfersV357Test-277983063 None] Flow 'volume_create_manager' (d82fc455-3895-4b55-8b4a-d0536d1a7145) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:50:49 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-2ba11373-33a6-4ab1-b59d-332af1d2a9f3 tempest-VolumesTransfersV357Test-277983063 None] Created volume successfully.
Nov 06 11:50:51 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-145bfb93-0d2b-4fae-b15d-0ec8df3cd8b7 tempest-VolumesTransfersV357Test-1377964454 None] Acquiring lock "cinder-5a56fe41-10e5-4f44-8ad8-c5ca6bb49ecf-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:50:51 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-145bfb93-0d2b-4fae-b15d-0ec8df3cd8b7 tempest-VolumesTransfersV357Test-1377964454 None] Lock "cinder-5a56fe41-10e5-4f44-8ad8-c5ca6bb49ecf-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:50:51 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-145bfb93-0d2b-4fae-b15d-0ec8df3cd8b7 tempest-VolumesTransfersV357Test-1377964454 None] Acquiring lock "cinder-quobyte-5a56fe41-10e5-4f44-8ad8-c5ca6bb49ecf" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:50:51 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-145bfb93-0d2b-4fae-b15d-0ec8df3cd8b7 tempest-VolumesTransfersV357Test-1377964454 None] Lock "cinder-quobyte-5a56fe41-10e5-4f44-8ad8-c5ca6bb49ecf" acquired by "delete_volume" :: waited 0.024s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:50:51 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b13a436-fbf9-41eb-bc13-b3c919188f08]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:50:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-145bfb93-0d2b-4fae-b15d-0ec8df3cd8b7 tempest-VolumesTransfersV357Test-1377964454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5a56fe41-10e5-4f44-8ad8-c5ca6bb49ecf {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:51 devstack sudo[97120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5a56fe41-10e5-4f44-8ad8-c5ca6bb49ecf
Nov 06 11:50:51 devstack sudo[97120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:52 devstack sudo[97120]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-145bfb93-0d2b-4fae-b15d-0ec8df3cd8b7 tempest-VolumesTransfersV357Test-1377964454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5a56fe41-10e5-4f44-8ad8-c5ca6bb49ecf" returned: 0 in 0.618s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-145bfb93-0d2b-4fae-b15d-0ec8df3cd8b7 tempest-VolumesTransfersV357Test-1377964454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5a56fe41-10e5-4f44-8ad8-c5ca6bb49ecf {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:52 devstack sudo[97135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5a56fe41-10e5-4f44-8ad8-c5ca6bb49ecf
Nov 06 11:50:52 devstack sudo[97135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:52 devstack sudo[97135]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-145bfb93-0d2b-4fae-b15d-0ec8df3cd8b7 tempest-VolumesTransfersV357Test-1377964454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5a56fe41-10e5-4f44-8ad8-c5ca6bb49ecf" returned: 0 in 0.395s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:52 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-145bfb93-0d2b-4fae-b15d-0ec8df3cd8b7 tempest-VolumesTransfersV357Test-1377964454 None] Lock "cinder-quobyte-5a56fe41-10e5-4f44-8ad8-c5ca6bb49ecf" released by "delete_volume" :: held 1.116s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:50:52 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-145bfb93-0d2b-4fae-b15d-0ec8df3cd8b7 tempest-VolumesTransfersV357Test-1377964454 None] Created reservations ['511064ba-93a2-44ea-ae85-935d53ceeb27', 'f3a7d2bf-f63c-460d-a0e3-1e739c1236f1', 'e0bc1142-7f07-46ca-85db-0a7ba72754fa', '9c5f5187-9685-49ce-a0ac-bb92dd3b3abb'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:50:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-145bfb93-0d2b-4fae-b15d-0ec8df3cd8b7 tempest-VolumesTransfersV357Test-1377964454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:50:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-145bfb93-0d2b-4fae-b15d-0ec8df3cd8b7 tempest-VolumesTransfersV357Test-1377964454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:50:52 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-145bfb93-0d2b-4fae-b15d-0ec8df3cd8b7 tempest-VolumesTransfersV357Test-1377964454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:50:52 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-145bfb93-0d2b-4fae-b15d-0ec8df3cd8b7 tempest-VolumesTransfersV357Test-1377964454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:50:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-145bfb93-0d2b-4fae-b15d-0ec8df3cd8b7 tempest-VolumesTransfersV357Test-1377964454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:50:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-145bfb93-0d2b-4fae-b15d-0ec8df3cd8b7 tempest-VolumesTransfersV357Test-1377964454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:52 devstack sudo[97138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:50:52 devstack sudo[97138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:52 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b083af6-8911-42f5-96b7-c398a79452e5 tempest-AttachVolumeTestJSON-784394024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:50:52 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8b083af6-8911-42f5-96b7-c398a79452e5 tempest-AttachVolumeTestJSON-784394024 None] Flow 'volume_create_manager' (9e026d47-9a36-48ce-b4cd-d3b4d858e73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:50:52 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8b083af6-8911-42f5-96b7-c398a79452e5 tempest-AttachVolumeTestJSON-784394024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0fb28ec-50be-4560-9ce1-a32fe35ca42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:50:52 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8b083af6-8911-42f5-96b7-c398a79452e5 tempest-AttachVolumeTestJSON-784394024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0fb28ec-50be-4560-9ce1-a32fe35ca42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:50:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-404468123',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc75275c-8d0c-4d95-a63e-f8d874ccdd64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c8c96fbf20e4dbe93f206aae0052c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:50:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:50:53Z,use_quota=True,user_id='a68744c6220f4aa58b94e599665d1df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:50:52 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8b083af6-8911-42f5-96b7-c398a79452e5 tempest-AttachVolumeTestJSON-784394024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a59b4f3d-c65b-4928-bb84-70d402007b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:50:52 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8b083af6-8911-42f5-96b7-c398a79452e5 tempest-AttachVolumeTestJSON-784394024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a59b4f3d-c65b-4928-bb84-70d402007b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:50:52 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8b083af6-8911-42f5-96b7-c398a79452e5 tempest-AttachVolumeTestJSON-784394024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8df29928-ac0b-40ea-b1f3-a76f9be8345a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:50:52 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8b083af6-8911-42f5-96b7-c398a79452e5 tempest-AttachVolumeTestJSON-784394024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8df29928-ac0b-40ea-b1f3-a76f9be8345a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc75275c-8d0c-4d95-a63e-f8d874ccdd64', 'volume_name': 'volume-fc75275c-8d0c-4d95-a63e-f8d874ccdd64', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:50:52 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8b083af6-8911-42f5-96b7-c398a79452e5 tempest-AttachVolumeTestJSON-784394024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0686331-9cae-4f71-bef3-77b6d2aeae1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:50:52 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8b083af6-8911-42f5-96b7-c398a79452e5 tempest-AttachVolumeTestJSON-784394024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0686331-9cae-4f71-bef3-77b6d2aeae1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:50:52 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8b083af6-8911-42f5-96b7-c398a79452e5 tempest-AttachVolumeTestJSON-784394024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2cf3b8b-b9e7-4590-acf3-ce252e39fc46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:50:52 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-8b083af6-8911-42f5-96b7-c398a79452e5 tempest-AttachVolumeTestJSON-784394024 None] Volume fc75275c-8d0c-4d95-a63e-f8d874ccdd64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc75275c-8d0c-4d95-a63e-f8d874ccdd64', 'volume_size': 1}
Nov 06 11:50:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-8b083af6-8911-42f5-96b7-c398a79452e5 tempest-AttachVolumeTestJSON-784394024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:50:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-8b083af6-8911-42f5-96b7-c398a79452e5 tempest-AttachVolumeTestJSON-784394024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:50:52 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-8b083af6-8911-42f5-96b7-c398a79452e5 tempest-AttachVolumeTestJSON-784394024 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:50:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-404468123',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc75275c-8d0c-4d95-a63e-f8d874ccdd64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c8c96fbf20e4dbe93f206aae0052c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:50:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:50:53Z,use_quota=True,user_id='a68744c6220f4aa58b94e599665d1df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:50:52 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-8b083af6-8911-42f5-96b7-c398a79452e5 tempest-AttachVolumeTestJSON-784394024 None] Creating volume fc75275c-8d0c-4d95-a63e-f8d874ccdd64 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:50:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-8b083af6-8911-42f5-96b7-c398a79452e5 tempest-AttachVolumeTestJSON-784394024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:50:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-8b083af6-8911-42f5-96b7-c398a79452e5 tempest-AttachVolumeTestJSON-784394024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:50:52 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-8b083af6-8911-42f5-96b7-c398a79452e5 tempest-AttachVolumeTestJSON-784394024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:50:52 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-8b083af6-8911-42f5-96b7-c398a79452e5 tempest-AttachVolumeTestJSON-784394024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:50:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-8b083af6-8911-42f5-96b7-c398a79452e5 tempest-AttachVolumeTestJSON-784394024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:50:52 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-8b083af6-8911-42f5-96b7-c398a79452e5 tempest-AttachVolumeTestJSON-784394024 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:50:52 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-8b083af6-8911-42f5-96b7-c398a79452e5 tempest-AttachVolumeTestJSON-784394024 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:50:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-8b083af6-8911-42f5-96b7-c398a79452e5 tempest-AttachVolumeTestJSON-784394024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fc75275c-8d0c-4d95-a63e-f8d874ccdd64 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:52 devstack sudo[97140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fc75275c-8d0c-4d95-a63e-f8d874ccdd64 1073741824
Nov 06 11:50:52 devstack sudo[97140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:53 devstack sudo[97138]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-145bfb93-0d2b-4fae-b15d-0ec8df3cd8b7 tempest-VolumesTransfersV357Test-1377964454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.375s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:53 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-145bfb93-0d2b-4fae-b15d-0ec8df3cd8b7 tempest-VolumesTransfersV357Test-1377964454 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:50:53 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-145bfb93-0d2b-4fae-b15d-0ec8df3cd8b7 tempest-VolumesTransfersV357Test-1377964454 None] Deleted volume successfully.
Nov 06 11:50:53 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-145bfb93-0d2b-4fae-b15d-0ec8df3cd8b7 tempest-VolumesTransfersV357Test-1377964454 None] Lock "cinder-5a56fe41-10e5-4f44-8ad8-c5ca6bb49ecf-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:50:53 devstack sudo[97140]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-8b083af6-8911-42f5-96b7-c398a79452e5 tempest-AttachVolumeTestJSON-784394024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fc75275c-8d0c-4d95-a63e-f8d874ccdd64 1073741824" returned: 0 in 0.563s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-8b083af6-8911-42f5-96b7-c398a79452e5 tempest-AttachVolumeTestJSON-784394024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fc75275c-8d0c-4d95-a63e-f8d874ccdd64 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:50:53 devstack sudo[97147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fc75275c-8d0c-4d95-a63e-f8d874ccdd64
Nov 06 11:50:53 devstack sudo[97147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:50:53 devstack sudo[97147]: pam_unix(sudo:session): session closed for user root
Nov 06 11:50:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-8b083af6-8911-42f5-96b7-c398a79452e5 tempest-AttachVolumeTestJSON-784394024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fc75275c-8d0c-4d95-a63e-f8d874ccdd64" returned: 0 in 0.464s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:50:53 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-8b083af6-8911-42f5-96b7-c398a79452e5 tempest-AttachVolumeTestJSON-784394024 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:50:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-8b083af6-8911-42f5-96b7-c398a79452e5 tempest-AttachVolumeTestJSON-784394024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:50:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8b083af6-8911-42f5-96b7-c398a79452e5 tempest-AttachVolumeTestJSON-784394024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2cf3b8b-b9e7-4590-acf3-ce252e39fc46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc75275c-8d0c-4d95-a63e-f8d874ccdd64', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:50:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8b083af6-8911-42f5-96b7-c398a79452e5 tempest-AttachVolumeTestJSON-784394024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c53948f9-cd8f-425d-9bce-e3e4690521a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:50:53 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-8b083af6-8911-42f5-96b7-c398a79452e5 tempest-AttachVolumeTestJSON-784394024 None] Volume volume-fc75275c-8d0c-4d95-a63e-f8d874ccdd64 (fc75275c-8d0c-4d95-a63e-f8d874ccdd64): created successfully
Nov 06 11:50:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8b083af6-8911-42f5-96b7-c398a79452e5 tempest-AttachVolumeTestJSON-784394024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c53948f9-cd8f-425d-9bce-e3e4690521a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:50:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8b083af6-8911-42f5-96b7-c398a79452e5 tempest-AttachVolumeTestJSON-784394024 None] Flow 'volume_create_manager' (9e026d47-9a36-48ce-b4cd-d3b4d858e73d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:50:53 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-8b083af6-8911-42f5-96b7-c398a79452e5 tempest-AttachVolumeTestJSON-784394024 None] Created volume successfully.
Nov 06 11:50:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-4d47799f-284d-4351-b8f6-13597c6db5a0 req-e04922fc-dce7-4698-8ac9-d2c3d883b637 tempest-AttachVolumeTestJSON-784394024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:50:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-4d47799f-284d-4351-b8f6-13597c6db5a0 req-e04922fc-dce7-4698-8ac9-d2c3d883b637 tempest-AttachVolumeTestJSON-784394024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:50:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-4d47799f-284d-4351-b8f6-13597c6db5a0 req-e04922fc-dce7-4698-8ac9-d2c3d883b637 tempest-AttachVolumeTestJSON-784394024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:50:56 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-4d47799f-284d-4351-b8f6-13597c6db5a0 req-e04922fc-dce7-4698-8ac9-d2c3d883b637 tempest-AttachVolumeTestJSON-784394024 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50', 'name': 'volume-fc75275c-8d0c-4d95-a63e-f8d874ccdd64', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '427c35b6-86ad-44df-abb2-6d6a542368f6', 'enforce_multipath': True} {{(pid=87165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 11:50:57 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-4d47799f-284d-4351-b8f6-13597c6db5a0 req-e04922fc-dce7-4698-8ac9-d2c3d883b637 tempest-AttachVolumeTestJSON-784394024 None] attachment_update completed successfully.
Nov 06 11:51:00 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-af2c11ac-0dd0-4cd2-9b0b-37971bf310f6 tempest-VolumesActionsTest-1030226880 None] Acquiring lock "cinder-78f5be1d-0fc7-4c47-95da-3df83f2d9d38" by "attach_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:51:00 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-af2c11ac-0dd0-4cd2-9b0b-37971bf310f6 tempest-VolumesActionsTest-1030226880 None] Lock "cinder-78f5be1d-0fc7-4c47-95da-3df83f2d9d38" acquired by "attach_volume" :: waited 0.048s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:51:00 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-af2c11ac-0dd0-4cd2-9b0b-37971bf310f6 tempest-VolumesActionsTest-1030226880 None] Attaching volume 78f5be1d-0fc7-4c47-95da-3df83f2d9d38 to instance 0dfaf368-143d-4e55-9e9b-d630356fd52f at mountpoint /dev/vdb on host None.
Nov 06 11:51:00 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-af2c11ac-0dd0-4cd2-9b0b-37971bf310f6 tempest-VolumesActionsTest-1030226880 None] Attach volume completed successfully.
Nov 06 11:51:00 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-af2c11ac-0dd0-4cd2-9b0b-37971bf310f6 tempest-VolumesActionsTest-1030226880 None] Lock "cinder-78f5be1d-0fc7-4c47-95da-3df83f2d9d38" released by "attach_volume" :: held 0.137s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:51:00 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-fa4bd888-33a9-4a79-96c4-253c2205bcb5 tempest-VolumesActionsTest-1030226880 None] Acquiring lock "cinder-78f5be1d-0fc7-4c47-95da-3df83f2d9d38-detach_volume" by "detach_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:51:00 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-fa4bd888-33a9-4a79-96c4-253c2205bcb5 tempest-VolumesActionsTest-1030226880 None] Lock "cinder-78f5be1d-0fc7-4c47-95da-3df83f2d9d38-detach_volume" acquired by "detach_volume" :: waited 0.042s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:51:00 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-fa4bd888-33a9-4a79-96c4-253c2205bcb5 tempest-VolumesActionsTest-1030226880 None] Detaching volume 78f5be1d-0fc7-4c47-95da-3df83f2d9d38 from instance 0dfaf368-143d-4e55-9e9b-d630356fd52f.
Nov 06 11:51:01 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-fa4bd888-33a9-4a79-96c4-253c2205bcb5 tempest-VolumesActionsTest-1030226880 None] Detach volume completed successfully.
Nov 06 11:51:01 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-fa4bd888-33a9-4a79-96c4-253c2205bcb5 tempest-VolumesActionsTest-1030226880 None] Lock "cinder-78f5be1d-0fc7-4c47-95da-3df83f2d9d38-detach_volume" released by "detach_volume" :: held 0.116s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:51:09 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-244b4d22-2a1c-4017-884a-d675d9bdf45e tempest-VolumesActionsTest-1030226880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:51:09 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-244b4d22-2a1c-4017-884a-d675d9bdf45e tempest-VolumesActionsTest-1030226880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:51:09 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb8a914-24d0-43b1-8d24-22f3116f574c]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:51:09 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-244b4d22-2a1c-4017-884a-d675d9bdf45e tempest-VolumesActionsTest-1030226880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-78f5be1d-0fc7-4c47-95da-3df83f2d9d38 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:51:09 devstack sudo[98231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-78f5be1d-0fc7-4c47-95da-3df83f2d9d38
Nov 06 11:51:09 devstack sudo[98231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:51:10 devstack sudo[98231]: pam_unix(sudo:session): session closed for user root
Nov 06 11:51:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-244b4d22-2a1c-4017-884a-d675d9bdf45e tempest-VolumesActionsTest-1030226880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-78f5be1d-0fc7-4c47-95da-3df83f2d9d38" returned: 0 in 0.796s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:51:10 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6dd7e7c-3868-4f8a-9d2b-08eaddd56b03]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:51:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-244b4d22-2a1c-4017-884a-d675d9bdf45e tempest-VolumesActionsTest-1030226880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-78f5be1d-0fc7-4c47-95da-3df83f2d9d38 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:51:10 devstack sudo[98257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-78f5be1d-0fc7-4c47-95da-3df83f2d9d38
Nov 06 11:51:10 devstack sudo[98257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:51:10 devstack sudo[98257]: pam_unix(sudo:session): session closed for user root
Nov 06 11:51:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-244b4d22-2a1c-4017-884a-d675d9bdf45e tempest-VolumesActionsTest-1030226880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-78f5be1d-0fc7-4c47-95da-3df83f2d9d38" returned: 0 in 0.727s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:51:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-244b4d22-2a1c-4017-884a-d675d9bdf45e tempest-VolumesActionsTest-1030226880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-78f5be1d-0fc7-4c47-95da-3df83f2d9d38 /opt/stack/data/cinder/conversion/78f5be1d-0fc7-4c47-95da-3df83f2d9d38.temp_image.93d40ade-9bf0-412c-8519-f8beb2c09c53vkiu3wzi.img {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:51:10 devstack sudo[98265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-78f5be1d-0fc7-4c47-95da-3df83f2d9d38 /opt/stack/data/cinder/conversion/78f5be1d-0fc7-4c47-95da-3df83f2d9d38.temp_image.93d40ade-9bf0-412c-8519-f8beb2c09c53vkiu3wzi.img
Nov 06 11:51:10 devstack sudo[98265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:51:11 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:SELECT=34,cinder:UPDATE=28,cinder:INSERT=8,cinder:DELETE=3 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 11:51:16 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d78726b-a2bf-494c-a8aa-124917ef3e88 tempest-VolumesSnapshotListTestJSON-834098657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:51:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6d78726b-a2bf-494c-a8aa-124917ef3e88 tempest-VolumesSnapshotListTestJSON-834098657 None] Flow 'volume_create_manager' (31ccb77b-c751-465c-8b36-9afbca1c9a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:51:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6d78726b-a2bf-494c-a8aa-124917ef3e88 tempest-VolumesSnapshotListTestJSON-834098657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c795d411-f10c-4589-9959-6e93bd0ea333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:51:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6d78726b-a2bf-494c-a8aa-124917ef3e88 tempest-VolumesSnapshotListTestJSON-834098657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c795d411-f10c-4589-9959-6e93bd0ea333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:51:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-588526888',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8abaf450-c861-4c17-b76a-5cf313fce8f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6489422f4da473aaae20cb97f9f6f8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:51:16Z,use_quota=True,user_id='6fb34f4188c949aa9e5b5e72a8a57fd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:51:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6d78726b-a2bf-494c-a8aa-124917ef3e88 tempest-VolumesSnapshotListTestJSON-834098657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f0fe9eb-f328-48c0-a217-a761b70ef107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:51:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6d78726b-a2bf-494c-a8aa-124917ef3e88 tempest-VolumesSnapshotListTestJSON-834098657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f0fe9eb-f328-48c0-a217-a761b70ef107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:51:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6d78726b-a2bf-494c-a8aa-124917ef3e88 tempest-VolumesSnapshotListTestJSON-834098657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa9d19b1-3323-4dbb-ae90-3d84e2515392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:51:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6d78726b-a2bf-494c-a8aa-124917ef3e88 tempest-VolumesSnapshotListTestJSON-834098657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa9d19b1-3323-4dbb-ae90-3d84e2515392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8abaf450-c861-4c17-b76a-5cf313fce8f1', 'volume_name': 'volume-8abaf450-c861-4c17-b76a-5cf313fce8f1', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:51:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6d78726b-a2bf-494c-a8aa-124917ef3e88 tempest-VolumesSnapshotListTestJSON-834098657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bc5dbdf-7e05-4d49-8a40-97e2596b319e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:51:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6d78726b-a2bf-494c-a8aa-124917ef3e88 tempest-VolumesSnapshotListTestJSON-834098657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bc5dbdf-7e05-4d49-8a40-97e2596b319e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:51:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6d78726b-a2bf-494c-a8aa-124917ef3e88 tempest-VolumesSnapshotListTestJSON-834098657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2238bbf1-25b7-4192-a568-15b40161bb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:51:16 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-6d78726b-a2bf-494c-a8aa-124917ef3e88 tempest-VolumesSnapshotListTestJSON-834098657 None] Volume 8abaf450-c861-4c17-b76a-5cf313fce8f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8abaf450-c861-4c17-b76a-5cf313fce8f1', 'volume_size': 1}
Nov 06 11:51:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6d78726b-a2bf-494c-a8aa-124917ef3e88 tempest-VolumesSnapshotListTestJSON-834098657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:51:17 devstack cinder-volume[87165]: DEBUG oslo_service.periodic_task [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 11:51:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:51:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:51:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:51:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:51:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:51:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:51:17 devstack sudo[98283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:51:17 devstack sudo[98283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:51:17 devstack sudo[98283]: pam_unix(sudo:session): session closed for user root
Nov 06 11:51:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.535s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:51:17 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:51:17 devstack cinder-volume[87165]: DEBUG oslo_service.periodic_task [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running periodic task VolumeManager._thread_info {{(pid=87165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 11:51:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] thread count: 29 {{(pid=87165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 11:51:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] thread info: [<_MainThread(MainThread, started 127732956901504)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127732842693056)>, <Thread(Thread-3 (stat_writer), started daemon 127732841891136)>, <Thread(Rabbit-heartbeat, started daemon 127732842515648)>, <Thread(Thread-5 (_runner), started daemon 127732840534464)>, <Thread(Thread-7 (_runner), started daemon 127732840636032)>, <Thread(fd_logger, started daemon 127732838664256)>, <Thread(privsep_reader, started daemon 127732838673408)>, <Thread(tpool_thread_0, started daemon 127732829828800)>, <Thread(tpool_thread_1, started daemon 127732821436096)>, <Thread(tpool_thread_2, started daemon 127732813043392)>, <Thread(tpool_thread_3, started daemon 127732804650688)>, <Thread(tpool_thread_4, started daemon 127732796257984)>, <Thread(tpool_thread_5, started daemon 127732787865280)>, <Thread(tpool_thread_6, started daemon 127732779456192)>, <Thread(tpool_thread_7, started daemon 127732771047104)>, <Thread(tpool_thread_8, started daemon 127732762638016)>, <Thread(tpool_thread_9, started daemon 127732754228928)>, <Thread(tpool_thread_10, started daemon 127732745819840)>, <Thread(tpool_thread_11, started daemon 127732737410752)>, <Thread(tpool_thread_12, started daemon 127732729001664)>, <Thread(tpool_thread_13, started daemon 127732720592576)>, <Thread(tpool_thread_14, started daemon 127732712183488)>, <Thread(tpool_thread_15, started daemon 127732703774400)>, <Thread(tpool_thread_16, started daemon 127732695365312)>, <Thread(tpool_thread_17, started daemon 127732686956224)>, <Thread(tpool_thread_18, started daemon 127732678547136)>, <Thread(tpool_thread_19, started daemon 127732670138048)>, <Thread(Rabbit-heartbeat, started daemon 127732832631296)>] {{(pid=87165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 11:51:20 devstack sudo[98265]: pam_unix(sudo:session): session closed for user root
Nov 06 11:51:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-244b4d22-2a1c-4017-884a-d675d9bdf45e tempest-VolumesActionsTest-1030226880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-78f5be1d-0fc7-4c47-95da-3df83f2d9d38 /opt/stack/data/cinder/conversion/78f5be1d-0fc7-4c47-95da-3df83f2d9d38.temp_image.93d40ade-9bf0-412c-8519-f8beb2c09c53vkiu3wzi.img" returned: 0 in 9.902s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:51:20 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5932e8fe-5944-4820-837b-117086c7dcdf]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:51:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-244b4d22-2a1c-4017-884a-d675d9bdf45e tempest-VolumesActionsTest-1030226880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-78f5be1d-0fc7-4c47-95da-3df83f2d9d38 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:51:20 devstack sudo[98286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-78f5be1d-0fc7-4c47-95da-3df83f2d9d38
Nov 06 11:51:20 devstack sudo[98286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:51:21 devstack sudo[98286]: pam_unix(sudo:session): session closed for user root
Nov 06 11:51:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-244b4d22-2a1c-4017-884a-d675d9bdf45e tempest-VolumesActionsTest-1030226880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-78f5be1d-0fc7-4c47-95da-3df83f2d9d38" returned: 0 in 0.908s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:51:21 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-244b4d22-2a1c-4017-884a-d675d9bdf45e tempest-VolumesActionsTest-1030226880 None] Image conversion details: src /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-78f5be1d-0fc7-4c47-95da-3df83f2d9d38, size 1024.00 MB, duration 9.90 sec, destination /opt/stack/data/cinder/conversion/78f5be1d-0fc7-4c47-95da-3df83f2d9d38.temp_image.93d40ade-9bf0-412c-8519-f8beb2c09c53vkiu3wzi.img {{(pid=87165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 11:51:21 devstack cinder-volume[87165]: INFO cinder.image.image_utils [None req-244b4d22-2a1c-4017-884a-d675d9bdf45e tempest-VolumesActionsTest-1030226880 None] Converted 1024.00 MB image at 103.39 MB/s
Nov 06 11:51:21 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-244b4d22-2a1c-4017-884a-d675d9bdf45e tempest-VolumesActionsTest-1030226880 None] 93d40ade-9bf0-412c-8519-f8beb2c09c53 was raw, no need to convert to raw {{(pid=87165) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Nov 06 11:51:27 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-f32261e9-e6fe-45b5-96e6-e4cfb48c3415 tempest-TestMinimumBasicScenario-1496090552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:51:27 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f32261e9-e6fe-45b5-96e6-e4cfb48c3415 tempest-TestMinimumBasicScenario-1496090552 None] Flow 'volume_create_manager' (e4887cf2-f013-440d-9cfb-3987e3597f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:51:27 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f32261e9-e6fe-45b5-96e6-e4cfb48c3415 tempest-TestMinimumBasicScenario-1496090552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e2e843b-03fe-422b-ad3d-a35f12cc10c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:51:27 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f32261e9-e6fe-45b5-96e6-e4cfb48c3415 tempest-TestMinimumBasicScenario-1496090552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e2e843b-03fe-422b-ad3d-a35f12cc10c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:51:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1819581904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94ab5008-21a5-4cdc-82e5-092d5293904c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1260f57a5a234dd19b3ca12f3807c69e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:51:28Z,use_quota=True,user_id='468415b4cb464e30b3addf4e30f2b4ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:51:27 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f32261e9-e6fe-45b5-96e6-e4cfb48c3415 tempest-TestMinimumBasicScenario-1496090552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd27c715-d1aa-4e7f-be0d-a215f3b36b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:51:27 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f32261e9-e6fe-45b5-96e6-e4cfb48c3415 tempest-TestMinimumBasicScenario-1496090552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd27c715-d1aa-4e7f-be0d-a215f3b36b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:51:27 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f32261e9-e6fe-45b5-96e6-e4cfb48c3415 tempest-TestMinimumBasicScenario-1496090552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b8c5661-33d3-40a5-ae08-4e2c1be3034d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:51:27 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f32261e9-e6fe-45b5-96e6-e4cfb48c3415 tempest-TestMinimumBasicScenario-1496090552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b8c5661-33d3-40a5-ae08-4e2c1be3034d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94ab5008-21a5-4cdc-82e5-092d5293904c', 'volume_name': 'volume-94ab5008-21a5-4cdc-82e5-092d5293904c', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:51:27 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f32261e9-e6fe-45b5-96e6-e4cfb48c3415 tempest-TestMinimumBasicScenario-1496090552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b7b2565-72bc-4d94-8ff5-384f59091982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:51:27 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f32261e9-e6fe-45b5-96e6-e4cfb48c3415 tempest-TestMinimumBasicScenario-1496090552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b7b2565-72bc-4d94-8ff5-384f59091982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:51:27 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f32261e9-e6fe-45b5-96e6-e4cfb48c3415 tempest-TestMinimumBasicScenario-1496090552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99dfd1c3-157b-4b01-b121-751e4a3066b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:51:27 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-f32261e9-e6fe-45b5-96e6-e4cfb48c3415 tempest-TestMinimumBasicScenario-1496090552 None] Volume 94ab5008-21a5-4cdc-82e5-092d5293904c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94ab5008-21a5-4cdc-82e5-092d5293904c', 'volume_size': 1}
Nov 06 11:51:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f32261e9-e6fe-45b5-96e6-e4cfb48c3415 tempest-TestMinimumBasicScenario-1496090552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:51:32 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-ce220334-b0ca-45a9-92f7-946ba2a3c69b req-51b560a3-a1f9-4c7a-b9ac-162654a3a986 tempest-AttachVolumeTestJSON-784394024 None] Terminate volume connection completed successfully.
Nov 06 11:51:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-ce220334-b0ca-45a9-92f7-946ba2a3c69b req-51b560a3-a1f9-4c7a-b9ac-162654a3a986 tempest-AttachVolumeTestJSON-784394024 None] Deleting attachment 427c35b6-86ad-44df-abb2-6d6a542368f6. {{(pid=87165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 11:51:42 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 11:51:42 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:SELECT=41,cinder:INSERT=7,cinder:UPDATE=37,cinder:DELETE=2 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 11:51:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-244b4d22-2a1c-4017-884a-d675d9bdf45e tempest-VolumesActionsTest-1030226880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 37.517s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:51:46 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-244b4d22-2a1c-4017-884a-d675d9bdf45e tempest-VolumesActionsTest-1030226880 None] Uploaded volume to glance image-id: 93d40ade-9bf0-412c-8519-f8beb2c09c53. {{(pid=87165) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 06 11:51:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6d78726b-a2bf-494c-a8aa-124917ef3e88 tempest-VolumesSnapshotListTestJSON-834098657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 30.467s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:51:46 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-6d78726b-a2bf-494c-a8aa-124917ef3e88 tempest-VolumesSnapshotListTestJSON-834098657 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:51:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-588526888',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8abaf450-c861-4c17-b76a-5cf313fce8f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6489422f4da473aaae20cb97f9f6f8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:51:16Z,use_quota=True,user_id='6fb34f4188c949aa9e5b5e72a8a57fd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:51:46 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-6d78726b-a2bf-494c-a8aa-124917ef3e88 tempest-VolumesSnapshotListTestJSON-834098657 None] Creating volume 8abaf450-c861-4c17-b76a-5cf313fce8f1 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:51:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6d78726b-a2bf-494c-a8aa-124917ef3e88 tempest-VolumesSnapshotListTestJSON-834098657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:51:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6d78726b-a2bf-494c-a8aa-124917ef3e88 tempest-VolumesSnapshotListTestJSON-834098657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:51:46 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-6d78726b-a2bf-494c-a8aa-124917ef3e88 tempest-VolumesSnapshotListTestJSON-834098657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:51:46 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-6d78726b-a2bf-494c-a8aa-124917ef3e88 tempest-VolumesSnapshotListTestJSON-834098657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:51:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6d78726b-a2bf-494c-a8aa-124917ef3e88 tempest-VolumesSnapshotListTestJSON-834098657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:51:46 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-6d78726b-a2bf-494c-a8aa-124917ef3e88 tempest-VolumesSnapshotListTestJSON-834098657 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:51:46 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-6d78726b-a2bf-494c-a8aa-124917ef3e88 tempest-VolumesSnapshotListTestJSON-834098657 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:51:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6d78726b-a2bf-494c-a8aa-124917ef3e88 tempest-VolumesSnapshotListTestJSON-834098657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:51:46 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-244b4d22-2a1c-4017-884a-d675d9bdf45e tempest-VolumesActionsTest-1030226880 None] Copy volume to image completed successfully.
Nov 06 11:51:46 devstack sudo[98569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1 1073741824
Nov 06 11:51:46 devstack sudo[98569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:51:47 devstack sudo[98569]: pam_unix(sudo:session): session closed for user root
Nov 06 11:51:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6d78726b-a2bf-494c-a8aa-124917ef3e88 tempest-VolumesSnapshotListTestJSON-834098657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1 1073741824" returned: 0 in 0.486s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:51:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6d78726b-a2bf-494c-a8aa-124917ef3e88 tempest-VolumesSnapshotListTestJSON-834098657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:51:47 devstack sudo[98575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1
Nov 06 11:51:47 devstack sudo[98575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:51:47 devstack sudo[98575]: pam_unix(sudo:session): session closed for user root
Nov 06 11:51:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6d78726b-a2bf-494c-a8aa-124917ef3e88 tempest-VolumesSnapshotListTestJSON-834098657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1" returned: 0 in 0.254s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:51:47 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-6d78726b-a2bf-494c-a8aa-124917ef3e88 tempest-VolumesSnapshotListTestJSON-834098657 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:51:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6d78726b-a2bf-494c-a8aa-124917ef3e88 tempest-VolumesSnapshotListTestJSON-834098657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:51:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f32261e9-e6fe-45b5-96e6-e4cfb48c3415 tempest-TestMinimumBasicScenario-1496090552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.811s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:51:47 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-f32261e9-e6fe-45b5-96e6-e4cfb48c3415 tempest-TestMinimumBasicScenario-1496090552 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:51:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1819581904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94ab5008-21a5-4cdc-82e5-092d5293904c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1260f57a5a234dd19b3ca12f3807c69e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:51:28Z,use_quota=True,user_id='468415b4cb464e30b3addf4e30f2b4ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:51:47 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-f32261e9-e6fe-45b5-96e6-e4cfb48c3415 tempest-TestMinimumBasicScenario-1496090552 None] Creating volume 94ab5008-21a5-4cdc-82e5-092d5293904c {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:51:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f32261e9-e6fe-45b5-96e6-e4cfb48c3415 tempest-TestMinimumBasicScenario-1496090552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:51:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f32261e9-e6fe-45b5-96e6-e4cfb48c3415 tempest-TestMinimumBasicScenario-1496090552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:51:47 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-f32261e9-e6fe-45b5-96e6-e4cfb48c3415 tempest-TestMinimumBasicScenario-1496090552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:51:47 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-f32261e9-e6fe-45b5-96e6-e4cfb48c3415 tempest-TestMinimumBasicScenario-1496090552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:51:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f32261e9-e6fe-45b5-96e6-e4cfb48c3415 tempest-TestMinimumBasicScenario-1496090552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:51:47 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-f32261e9-e6fe-45b5-96e6-e4cfb48c3415 tempest-TestMinimumBasicScenario-1496090552 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:51:47 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-f32261e9-e6fe-45b5-96e6-e4cfb48c3415 tempest-TestMinimumBasicScenario-1496090552 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:51:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f32261e9-e6fe-45b5-96e6-e4cfb48c3415 tempest-TestMinimumBasicScenario-1496090552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-94ab5008-21a5-4cdc-82e5-092d5293904c 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:51:47 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6d78726b-a2bf-494c-a8aa-124917ef3e88 tempest-VolumesSnapshotListTestJSON-834098657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2238bbf1-25b7-4192-a568-15b40161bb1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8abaf450-c861-4c17-b76a-5cf313fce8f1', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:51:47 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6d78726b-a2bf-494c-a8aa-124917ef3e88 tempest-VolumesSnapshotListTestJSON-834098657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43970004-2701-48d2-b9d9-6d6d331870dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:51:47 devstack sudo[98578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-94ab5008-21a5-4cdc-82e5-092d5293904c 1073741824
Nov 06 11:51:47 devstack sudo[98578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:51:47 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-6d78726b-a2bf-494c-a8aa-124917ef3e88 tempest-VolumesSnapshotListTestJSON-834098657 None] Volume volume-8abaf450-c861-4c17-b76a-5cf313fce8f1 (8abaf450-c861-4c17-b76a-5cf313fce8f1): created successfully
Nov 06 11:51:47 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6d78726b-a2bf-494c-a8aa-124917ef3e88 tempest-VolumesSnapshotListTestJSON-834098657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43970004-2701-48d2-b9d9-6d6d331870dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:51:47 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6d78726b-a2bf-494c-a8aa-124917ef3e88 tempest-VolumesSnapshotListTestJSON-834098657 None] Flow 'volume_create_manager' (31ccb77b-c751-465c-8b36-9afbca1c9a4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:51:47 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-6d78726b-a2bf-494c-a8aa-124917ef3e88 tempest-VolumesSnapshotListTestJSON-834098657 None] Created volume successfully.
Nov 06 11:51:48 devstack sudo[98578]: pam_unix(sudo:session): session closed for user root
Nov 06 11:51:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f32261e9-e6fe-45b5-96e6-e4cfb48c3415 tempest-TestMinimumBasicScenario-1496090552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-94ab5008-21a5-4cdc-82e5-092d5293904c 1073741824" returned: 0 in 0.544s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:51:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f32261e9-e6fe-45b5-96e6-e4cfb48c3415 tempest-TestMinimumBasicScenario-1496090552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-94ab5008-21a5-4cdc-82e5-092d5293904c {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:51:48 devstack sudo[98584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-94ab5008-21a5-4cdc-82e5-092d5293904c
Nov 06 11:51:48 devstack sudo[98584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:51:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6f08ad86-3375-45e1-b0ff-f90479f45288 tempest-VolumesActionsTest-1030226880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:51:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f1d0350f-8693-4eba-b7bc-3210d8b11caf tempest-VolumesSnapshotListTestJSON-834098657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:51:49 devstack sudo[98584]: pam_unix(sudo:session): session closed for user root
Nov 06 11:51:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f32261e9-e6fe-45b5-96e6-e4cfb48c3415 tempest-TestMinimumBasicScenario-1496090552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-94ab5008-21a5-4cdc-82e5-092d5293904c" returned: 0 in 0.313s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:51:49 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-f32261e9-e6fe-45b5-96e6-e4cfb48c3415 tempest-TestMinimumBasicScenario-1496090552 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:51:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f32261e9-e6fe-45b5-96e6-e4cfb48c3415 tempest-TestMinimumBasicScenario-1496090552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:51:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6f08ad86-3375-45e1-b0ff-f90479f45288 tempest-VolumesActionsTest-1030226880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.237s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:51:49 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f32261e9-e6fe-45b5-96e6-e4cfb48c3415 tempest-TestMinimumBasicScenario-1496090552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99dfd1c3-157b-4b01-b121-751e4a3066b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94ab5008-21a5-4cdc-82e5-092d5293904c', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:51:49 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f32261e9-e6fe-45b5-96e6-e4cfb48c3415 tempest-TestMinimumBasicScenario-1496090552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a7caa9-528c-4f1a-94a3-84391c77a6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:51:49 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a236a15e-688a-4a58-81dc-db0f6647d701]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:51:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6f08ad86-3375-45e1-b0ff-f90479f45288 tempest-VolumesActionsTest-1030226880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-78f5be1d-0fc7-4c47-95da-3df83f2d9d38 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:51:49 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-f32261e9-e6fe-45b5-96e6-e4cfb48c3415 tempest-TestMinimumBasicScenario-1496090552 None] Volume volume-94ab5008-21a5-4cdc-82e5-092d5293904c (94ab5008-21a5-4cdc-82e5-092d5293904c): created successfully
Nov 06 11:51:49 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f32261e9-e6fe-45b5-96e6-e4cfb48c3415 tempest-TestMinimumBasicScenario-1496090552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a7caa9-528c-4f1a-94a3-84391c77a6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:51:49 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f32261e9-e6fe-45b5-96e6-e4cfb48c3415 tempest-TestMinimumBasicScenario-1496090552 None] Flow 'volume_create_manager' (e4887cf2-f013-440d-9cfb-3987e3597f93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:51:49 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-f32261e9-e6fe-45b5-96e6-e4cfb48c3415 tempest-TestMinimumBasicScenario-1496090552 None] Created volume successfully.
Nov 06 11:51:49 devstack sudo[98587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-78f5be1d-0fc7-4c47-95da-3df83f2d9d38
Nov 06 11:51:49 devstack sudo[98587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:51:49 devstack sudo[98587]: pam_unix(sudo:session): session closed for user root
Nov 06 11:51:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6f08ad86-3375-45e1-b0ff-f90479f45288 tempest-VolumesActionsTest-1030226880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-78f5be1d-0fc7-4c47-95da-3df83f2d9d38" returned: 0 in 0.422s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:51:49 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0e8f93-eb49-4e55-b7b8-734ab5171b1c]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:51:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6f08ad86-3375-45e1-b0ff-f90479f45288 tempest-VolumesActionsTest-1030226880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-78f5be1d-0fc7-4c47-95da-3df83f2d9d38 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:51:49 devstack sudo[98592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-78f5be1d-0fc7-4c47-95da-3df83f2d9d38
Nov 06 11:51:49 devstack sudo[98592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:51:49 devstack sudo[98592]: pam_unix(sudo:session): session closed for user root
Nov 06 11:51:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6f08ad86-3375-45e1-b0ff-f90479f45288 tempest-VolumesActionsTest-1030226880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-78f5be1d-0fc7-4c47-95da-3df83f2d9d38" returned: 0 in 0.432s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:51:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6f08ad86-3375-45e1-b0ff-f90479f45288 tempest-VolumesActionsTest-1030226880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-78f5be1d-0fc7-4c47-95da-3df83f2d9d38 /opt/stack/data/cinder/conversion/78f5be1d-0fc7-4c47-95da-3df83f2d9d38.temp_image.fef07b86-7886-4ffb-a76b-0b6f744366c3pvbswby1.img {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:51:50 devstack sudo[98597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-78f5be1d-0fc7-4c47-95da-3df83f2d9d38 /opt/stack/data/cinder/conversion/78f5be1d-0fc7-4c47-95da-3df83f2d9d38.temp_image.fef07b86-7886-4ffb-a76b-0b6f744366c3pvbswby1.img
Nov 06 11:51:50 devstack sudo[98597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:51:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-385934eb-030f-4c20-b512-0b87e35035b8 req-d0c2c116-cd2c-436a-9da0-6ae62d23b9a3 tempest-TestMinimumBasicScenario-1496090552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:51:57 devstack sudo[98597]: pam_unix(sudo:session): session closed for user root
Nov 06 11:51:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6f08ad86-3375-45e1-b0ff-f90479f45288 tempest-VolumesActionsTest-1030226880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-78f5be1d-0fc7-4c47-95da-3df83f2d9d38 /opt/stack/data/cinder/conversion/78f5be1d-0fc7-4c47-95da-3df83f2d9d38.temp_image.fef07b86-7886-4ffb-a76b-0b6f744366c3pvbswby1.img" returned: 0 in 7.056s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:51:57 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[86cb1960-accb-424e-a7f0-1bcbaefb832b]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:51:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6f08ad86-3375-45e1-b0ff-f90479f45288 tempest-VolumesActionsTest-1030226880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-78f5be1d-0fc7-4c47-95da-3df83f2d9d38 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:51:57 devstack sudo[98647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-78f5be1d-0fc7-4c47-95da-3df83f2d9d38
Nov 06 11:51:57 devstack sudo[98647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:51:57 devstack sudo[98647]: pam_unix(sudo:session): session closed for user root
Nov 06 11:51:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6f08ad86-3375-45e1-b0ff-f90479f45288 tempest-VolumesActionsTest-1030226880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-78f5be1d-0fc7-4c47-95da-3df83f2d9d38" returned: 0 in 0.512s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:51:57 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-6f08ad86-3375-45e1-b0ff-f90479f45288 tempest-VolumesActionsTest-1030226880 None] Image conversion details: src /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-78f5be1d-0fc7-4c47-95da-3df83f2d9d38, size 1024.00 MB, duration 7.06 sec, destination /opt/stack/data/cinder/conversion/78f5be1d-0fc7-4c47-95da-3df83f2d9d38.temp_image.fef07b86-7886-4ffb-a76b-0b6f744366c3pvbswby1.img {{(pid=87165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 11:51:57 devstack cinder-volume[87165]: INFO cinder.image.image_utils [None req-6f08ad86-3375-45e1-b0ff-f90479f45288 tempest-VolumesActionsTest-1030226880 None] Converted 1024.00 MB image at 145.10 MB/s
Nov 06 11:51:57 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-6f08ad86-3375-45e1-b0ff-f90479f45288 tempest-VolumesActionsTest-1030226880 None] fef07b86-7886-4ffb-a76b-0b6f744366c3 was raw, converting to qcow2 {{(pid=87165) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}}
Nov 06 11:51:57 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9820504b-5e35-440d-ac55-1f7d401932b6]: (4, 'raw') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:51:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6f08ad86-3375-45e1-b0ff-f90479f45288 tempest-VolumesActionsTest-1030226880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/78f5be1d-0fc7-4c47-95da-3df83f2d9d38.temp_image.fef07b86-7886-4ffb-a76b-0b6f744366c3pvbswby1.img {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:51:57 devstack sudo[98652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/78f5be1d-0fc7-4c47-95da-3df83f2d9d38.temp_image.fef07b86-7886-4ffb-a76b-0b6f744366c3pvbswby1.img
Nov 06 11:51:57 devstack sudo[98652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:51:57 devstack sudo[98652]: pam_unix(sudo:session): session closed for user root
Nov 06 11:51:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6f08ad86-3375-45e1-b0ff-f90479f45288 tempest-VolumesActionsTest-1030226880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/78f5be1d-0fc7-4c47-95da-3df83f2d9d38.temp_image.fef07b86-7886-4ffb-a76b-0b6f744366c3pvbswby1.img" returned: 0 in 0.314s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:51:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6f08ad86-3375-45e1-b0ff-f90479f45288 tempest-VolumesActionsTest-1030226880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/78f5be1d-0fc7-4c47-95da-3df83f2d9d38.temp_image.fef07b86-7886-4ffb-a76b-0b6f744366c3pvbswby1.img {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:51:58 devstack sudo[98656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/78f5be1d-0fc7-4c47-95da-3df83f2d9d38.temp_image.fef07b86-7886-4ffb-a76b-0b6f744366c3pvbswby1.img
Nov 06 11:51:58 devstack sudo[98656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:51:58 devstack sudo[98656]: pam_unix(sudo:session): session closed for user root
Nov 06 11:51:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6f08ad86-3375-45e1-b0ff-f90479f45288 tempest-VolumesActionsTest-1030226880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/78f5be1d-0fc7-4c47-95da-3df83f2d9d38.temp_image.fef07b86-7886-4ffb-a76b-0b6f744366c3pvbswby1.img" returned: 1 in 0.318s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:51:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6f08ad86-3375-45e1-b0ff-f90479f45288 tempest-VolumesActionsTest-1030226880 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/78f5be1d-0fc7-4c47-95da-3df83f2d9d38.temp_image.fef07b86-7886-4ffb-a76b-0b6f744366c3pvbswby1.img' failed. Not Retrying. {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 11:51:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6f08ad86-3375-45e1-b0ff-f90479f45288 tempest-VolumesActionsTest-1030226880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/78f5be1d-0fc7-4c47-95da-3df83f2d9d38.temp_image.fef07b86-7886-4ffb-a76b-0b6f744366c3pvbswby1.img /opt/stack/data/cinder/conversion/vol_upload_pyqj_pau {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:51:58 devstack sudo[98661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/78f5be1d-0fc7-4c47-95da-3df83f2d9d38.temp_image.fef07b86-7886-4ffb-a76b-0b6f744366c3pvbswby1.img /opt/stack/data/cinder/conversion/vol_upload_pyqj_pau
Nov 06 11:51:58 devstack sudo[98661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:51:58 devstack sudo[98661]: pam_unix(sudo:session): session closed for user root
Nov 06 11:51:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6f08ad86-3375-45e1-b0ff-f90479f45288 tempest-VolumesActionsTest-1030226880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/78f5be1d-0fc7-4c47-95da-3df83f2d9d38.temp_image.fef07b86-7886-4ffb-a76b-0b6f744366c3pvbswby1.img /opt/stack/data/cinder/conversion/vol_upload_pyqj_pau" returned: 0 in 0.261s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:51:58 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-6f08ad86-3375-45e1-b0ff-f90479f45288 tempest-VolumesActionsTest-1030226880 None] Image conversion details: src /opt/stack/data/cinder/conversion/78f5be1d-0fc7-4c47-95da-3df83f2d9d38.temp_image.fef07b86-7886-4ffb-a76b-0b6f744366c3pvbswby1.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_pyqj_pau {{(pid=87165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 11:51:58 devstack cinder-volume[87165]: INFO cinder.image.image_utils [None req-6f08ad86-3375-45e1-b0ff-f90479f45288 tempest-VolumesActionsTest-1030226880 None] Converted 1024.00 MB image at 1024.00 MB/s
Nov 06 11:51:58 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e374920-9f14-4a5e-b74d-14d2a7cda12c]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:51:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6f08ad86-3375-45e1-b0ff-f90479f45288 tempest-VolumesActionsTest-1030226880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_pyqj_pau {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:51:58 devstack sudo[98666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_pyqj_pau
Nov 06 11:51:58 devstack sudo[98666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:51:58 devstack sudo[98666]: pam_unix(sudo:session): session closed for user root
Nov 06 11:51:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6f08ad86-3375-45e1-b0ff-f90479f45288 tempest-VolumesActionsTest-1030226880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_pyqj_pau" returned: 0 in 0.325s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6f08ad86-3375-45e1-b0ff-f90479f45288 tempest-VolumesActionsTest-1030226880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.162s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:52:00 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6f08ad86-3375-45e1-b0ff-f90479f45288 tempest-VolumesActionsTest-1030226880 None] Uploaded volume to glance image-id: fef07b86-7886-4ffb-a76b-0b6f744366c3. {{(pid=87165) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 06 11:52:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f1d0350f-8693-4eba-b7bc-3210d8b11caf tempest-VolumesSnapshotListTestJSON-834098657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.212s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:52:00 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-f1d0350f-8693-4eba-b7bc-3210d8b11caf tempest-VolumesSnapshotListTestJSON-834098657 None] Creating offline snapshot f8b8528f-2842-4b11-bcbb-eac6df56e13e of volume 8abaf450-c861-4c17-b76a-5cf313fce8f1 {{(pid=87165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 11:52:00 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-6f08ad86-3375-45e1-b0ff-f90479f45288 tempest-VolumesActionsTest-1030226880 None] Copy volume to image completed successfully.
Nov 06 11:52:00 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eeb2634-0c76-4b2c-b9b9-6abef980bb12]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:52:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f1d0350f-8693-4eba-b7bc-3210d8b11caf tempest-VolumesSnapshotListTestJSON-834098657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:00 devstack sudo[98671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1
Nov 06 11:52:00 devstack sudo[98671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:00 devstack sudo[98671]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f1d0350f-8693-4eba-b7bc-3210d8b11caf tempest-VolumesSnapshotListTestJSON-834098657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1" returned: 0 in 0.455s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f1d0350f-8693-4eba-b7bc-3210d8b11caf tempest-VolumesSnapshotListTestJSON-834098657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.f8b8528f-2842-4b11-bcbb-eac6df56e13e 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:00 devstack sudo[98676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.f8b8528f-2842-4b11-bcbb-eac6df56e13e 1G
Nov 06 11:52:00 devstack sudo[98676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:01 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-cbc02391-68e2-421f-a6ef-1df8f739e8ad tempest-VolumesActionsTest-1030226880 None] Acquiring lock "cinder-78f5be1d-0fc7-4c47-95da-3df83f2d9d38-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:52:01 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-cbc02391-68e2-421f-a6ef-1df8f739e8ad tempest-VolumesActionsTest-1030226880 None] Lock "cinder-78f5be1d-0fc7-4c47-95da-3df83f2d9d38-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:52:01 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-cbc02391-68e2-421f-a6ef-1df8f739e8ad tempest-VolumesActionsTest-1030226880 None] Acquiring lock "cinder-quobyte-78f5be1d-0fc7-4c47-95da-3df83f2d9d38" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:52:01 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-cbc02391-68e2-421f-a6ef-1df8f739e8ad tempest-VolumesActionsTest-1030226880 None] Lock "cinder-quobyte-78f5be1d-0fc7-4c47-95da-3df83f2d9d38" acquired by "delete_volume" :: waited 0.018s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:52:01 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f7bed0-aab1-4c6b-b57d-96c529c7d20a]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:52:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cbc02391-68e2-421f-a6ef-1df8f739e8ad tempest-VolumesActionsTest-1030226880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-78f5be1d-0fc7-4c47-95da-3df83f2d9d38 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:01 devstack sudo[98676]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f1d0350f-8693-4eba-b7bc-3210d8b11caf tempest-VolumesSnapshotListTestJSON-834098657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.f8b8528f-2842-4b11-bcbb-eac6df56e13e 1G" returned: 0 in 0.478s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f1d0350f-8693-4eba-b7bc-3210d8b11caf tempest-VolumesSnapshotListTestJSON-834098657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8abaf450-c861-4c17-b76a-5cf313fce8f1 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.f8b8528f-2842-4b11-bcbb-eac6df56e13e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:01 devstack sudo[98683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8abaf450-c861-4c17-b76a-5cf313fce8f1 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.f8b8528f-2842-4b11-bcbb-eac6df56e13e
Nov 06 11:52:01 devstack sudo[98683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:01 devstack sudo[98682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-78f5be1d-0fc7-4c47-95da-3df83f2d9d38
Nov 06 11:52:01 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:01 devstack sudo[98683]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f1d0350f-8693-4eba-b7bc-3210d8b11caf tempest-VolumesSnapshotListTestJSON-834098657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8abaf450-c861-4c17-b76a-5cf313fce8f1 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.f8b8528f-2842-4b11-bcbb-eac6df56e13e" returned: 0 in 0.286s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:01 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-f1d0350f-8693-4eba-b7bc-3210d8b11caf tempest-VolumesSnapshotListTestJSON-834098657 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.f8b8528f-2842-4b11-bcbb-eac6df56e13e is being set with open permissions: ugo+rw
Nov 06 11:52:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f1d0350f-8693-4eba-b7bc-3210d8b11caf tempest-VolumesSnapshotListTestJSON-834098657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.f8b8528f-2842-4b11-bcbb-eac6df56e13e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:01 devstack sudo[98691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.f8b8528f-2842-4b11-bcbb-eac6df56e13e
Nov 06 11:52:01 devstack sudo[98691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:01 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cbc02391-68e2-421f-a6ef-1df8f739e8ad tempest-VolumesActionsTest-1030226880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-78f5be1d-0fc7-4c47-95da-3df83f2d9d38" returned: 0 in 0.416s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cbc02391-68e2-421f-a6ef-1df8f739e8ad tempest-VolumesActionsTest-1030226880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-78f5be1d-0fc7-4c47-95da-3df83f2d9d38 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:01 devstack sudo[98694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-78f5be1d-0fc7-4c47-95da-3df83f2d9d38
Nov 06 11:52:01 devstack sudo[98694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:01 devstack sudo[98691]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f1d0350f-8693-4eba-b7bc-3210d8b11caf tempest-VolumesSnapshotListTestJSON-834098657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.f8b8528f-2842-4b11-bcbb-eac6df56e13e" returned: 0 in 0.250s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f1d0350f-8693-4eba-b7bc-3210d8b11caf tempest-VolumesSnapshotListTestJSON-834098657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:01 devstack sudo[98697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.info
Nov 06 11:52:01 devstack sudo[98697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:01 devstack sudo[98694]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cbc02391-68e2-421f-a6ef-1df8f739e8ad tempest-VolumesActionsTest-1030226880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-78f5be1d-0fc7-4c47-95da-3df83f2d9d38" returned: 0 in 0.279s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:01 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-cbc02391-68e2-421f-a6ef-1df8f739e8ad tempest-VolumesActionsTest-1030226880 None] Lock "cinder-quobyte-78f5be1d-0fc7-4c47-95da-3df83f2d9d38" released by "delete_volume" :: held 0.740s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:52:01 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-cbc02391-68e2-421f-a6ef-1df8f739e8ad tempest-VolumesActionsTest-1030226880 None] Created reservations ['8f90a377-2637-4556-b3b9-cf6b472a4e0a', 'ef7c2a40-fe4a-4519-92bb-b37b9234b4e9', 'f5365369-07c2-4071-bc97-f25bb56f3301', '37ba3c89-f1cf-4f82-b815-e4b83b31feef'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:52:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-cbc02391-68e2-421f-a6ef-1df8f739e8ad tempest-VolumesActionsTest-1030226880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:52:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-cbc02391-68e2-421f-a6ef-1df8f739e8ad tempest-VolumesActionsTest-1030226880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:52:02 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-cbc02391-68e2-421f-a6ef-1df8f739e8ad tempest-VolumesActionsTest-1030226880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:52:02 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-cbc02391-68e2-421f-a6ef-1df8f739e8ad tempest-VolumesActionsTest-1030226880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:52:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-cbc02391-68e2-421f-a6ef-1df8f739e8ad tempest-VolumesActionsTest-1030226880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:52:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cbc02391-68e2-421f-a6ef-1df8f739e8ad tempest-VolumesActionsTest-1030226880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:02 devstack sudo[98701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:52:02 devstack sudo[98701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:02 devstack sudo[98697]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f1d0350f-8693-4eba-b7bc-3210d8b11caf tempest-VolumesSnapshotListTestJSON-834098657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.info" returned: 0 in 0.278s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:02 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-f1d0350f-8693-4eba-b7bc-3210d8b11caf tempest-VolumesSnapshotListTestJSON-834098657 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.info is being set with open permissions: ugo+rw
Nov 06 11:52:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f1d0350f-8693-4eba-b7bc-3210d8b11caf tempest-VolumesSnapshotListTestJSON-834098657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:02 devstack sudo[98703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.info
Nov 06 11:52:02 devstack sudo[98703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:02 devstack sudo[98701]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cbc02391-68e2-421f-a6ef-1df8f739e8ad tempest-VolumesActionsTest-1030226880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.293s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:02 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-cbc02391-68e2-421f-a6ef-1df8f739e8ad tempest-VolumesActionsTest-1030226880 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:52:02 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-cbc02391-68e2-421f-a6ef-1df8f739e8ad tempest-VolumesActionsTest-1030226880 None] Deleted volume successfully.
Nov 06 11:52:02 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-cbc02391-68e2-421f-a6ef-1df8f739e8ad tempest-VolumesActionsTest-1030226880 None] Lock "cinder-78f5be1d-0fc7-4c47-95da-3df83f2d9d38-delete_volume" released by "delete_volume" :: held 1.268s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:52:02 devstack sudo[98703]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f1d0350f-8693-4eba-b7bc-3210d8b11caf tempest-VolumesSnapshotListTestJSON-834098657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.info" returned: 0 in 0.298s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f1d0350f-8693-4eba-b7bc-3210d8b11caf tempest-VolumesSnapshotListTestJSON-834098657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.198s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:52:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-385934eb-030f-4c20-b512-0b87e35035b8 req-d0c2c116-cd2c-436a-9da0-6ae62d23b9a3 tempest-TestMinimumBasicScenario-1496090552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.040s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:52:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-385934eb-030f-4c20-b512-0b87e35035b8 req-d0c2c116-cd2c-436a-9da0-6ae62d23b9a3 tempest-TestMinimumBasicScenario-1496090552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:52:02 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-f1d0350f-8693-4eba-b7bc-3210d8b11caf tempest-VolumesSnapshotListTestJSON-834098657 None] Create snapshot completed successfully
Nov 06 11:52:02 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-385934eb-030f-4c20-b512-0b87e35035b8 req-d0c2c116-cd2c-436a-9da0-6ae62d23b9a3 tempest-TestMinimumBasicScenario-1496090552 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50', 'name': 'volume-94ab5008-21a5-4cdc-82e5-092d5293904c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0011110b-fa8a-4268-aed4-3fe3813cf07f', 'enforce_multipath': True} {{(pid=87165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 11:52:02 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-385934eb-030f-4c20-b512-0b87e35035b8 req-d0c2c116-cd2c-436a-9da0-6ae62d23b9a3 tempest-TestMinimumBasicScenario-1496090552 None] attachment_update completed successfully.
Nov 06 11:52:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-889e2658-2cd1-4fe3-aab2-865e0c5a354b tempest-VolumesSnapshotListTestJSON-834098657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:52:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-889e2658-2cd1-4fe3-aab2-865e0c5a354b tempest-VolumesSnapshotListTestJSON-834098657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:52:03 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-889e2658-2cd1-4fe3-aab2-865e0c5a354b tempest-VolumesSnapshotListTestJSON-834098657 None] Creating offline snapshot 84a57d5d-5338-47fd-a15e-344761aac9ab of volume 8abaf450-c861-4c17-b76a-5cf313fce8f1 {{(pid=87165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 11:52:03 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37f20bd-0412-45dc-a1e6-fce31f94f3ad]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:52:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-889e2658-2cd1-4fe3-aab2-865e0c5a354b tempest-VolumesSnapshotListTestJSON-834098657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.f8b8528f-2842-4b11-bcbb-eac6df56e13e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:03 devstack sudo[99160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.f8b8528f-2842-4b11-bcbb-eac6df56e13e
Nov 06 11:52:03 devstack sudo[99160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:04 devstack sudo[99160]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-889e2658-2cd1-4fe3-aab2-865e0c5a354b tempest-VolumesSnapshotListTestJSON-834098657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.f8b8528f-2842-4b11-bcbb-eac6df56e13e" returned: 0 in 0.890s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:04 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-889e2658-2cd1-4fe3-aab2-865e0c5a354b tempest-VolumesSnapshotListTestJSON-834098657 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8abaf450-c861-4c17-b76a-5cf313fce8f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:52:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-889e2658-2cd1-4fe3-aab2-865e0c5a354b tempest-VolumesSnapshotListTestJSON-834098657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.f8b8528f-2842-4b11-bcbb-eac6df56e13e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.84a57d5d-5338-47fd-a15e-344761aac9ab 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:04 devstack sudo[99185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.f8b8528f-2842-4b11-bcbb-eac6df56e13e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.84a57d5d-5338-47fd-a15e-344761aac9ab 1G
Nov 06 11:52:04 devstack sudo[99185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:04 devstack sudo[99185]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-889e2658-2cd1-4fe3-aab2-865e0c5a354b tempest-VolumesSnapshotListTestJSON-834098657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.f8b8528f-2842-4b11-bcbb-eac6df56e13e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.84a57d5d-5338-47fd-a15e-344761aac9ab 1G" returned: 0 in 0.573s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-889e2658-2cd1-4fe3-aab2-865e0c5a354b tempest-VolumesSnapshotListTestJSON-834098657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.f8b8528f-2842-4b11-bcbb-eac6df56e13e -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.84a57d5d-5338-47fd-a15e-344761aac9ab {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:04 devstack sudo[99194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.f8b8528f-2842-4b11-bcbb-eac6df56e13e -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.84a57d5d-5338-47fd-a15e-344761aac9ab
Nov 06 11:52:04 devstack sudo[99194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:05 devstack sudo[99194]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-889e2658-2cd1-4fe3-aab2-865e0c5a354b tempest-VolumesSnapshotListTestJSON-834098657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.f8b8528f-2842-4b11-bcbb-eac6df56e13e -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.84a57d5d-5338-47fd-a15e-344761aac9ab" returned: 0 in 0.417s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:05 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-889e2658-2cd1-4fe3-aab2-865e0c5a354b tempest-VolumesSnapshotListTestJSON-834098657 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.84a57d5d-5338-47fd-a15e-344761aac9ab is being set with open permissions: ugo+rw
Nov 06 11:52:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-889e2658-2cd1-4fe3-aab2-865e0c5a354b tempest-VolumesSnapshotListTestJSON-834098657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.84a57d5d-5338-47fd-a15e-344761aac9ab {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:05 devstack sudo[99199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.84a57d5d-5338-47fd-a15e-344761aac9ab
Nov 06 11:52:05 devstack sudo[99199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:05 devstack sudo[99199]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-889e2658-2cd1-4fe3-aab2-865e0c5a354b tempest-VolumesSnapshotListTestJSON-834098657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.84a57d5d-5338-47fd-a15e-344761aac9ab" returned: 0 in 0.266s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-889e2658-2cd1-4fe3-aab2-865e0c5a354b tempest-VolumesSnapshotListTestJSON-834098657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.367s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:52:05 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-889e2658-2cd1-4fe3-aab2-865e0c5a354b tempest-VolumesSnapshotListTestJSON-834098657 None] Create snapshot completed successfully
Nov 06 11:52:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4387ee7f-e6c4-4b64-a126-19aeb6aada0c tempest-VolumesSnapshotListTestJSON-834098657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:52:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4387ee7f-e6c4-4b64-a126-19aeb6aada0c tempest-VolumesSnapshotListTestJSON-834098657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:52:06 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-4387ee7f-e6c4-4b64-a126-19aeb6aada0c tempest-VolumesSnapshotListTestJSON-834098657 None] Creating offline snapshot 8a026403-50e4-4ab6-9894-5860e37a2a95 of volume 8abaf450-c861-4c17-b76a-5cf313fce8f1 {{(pid=87165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 11:52:06 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af0e8a2-d686-4542-bb3c-bbee9993fcd8]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:52:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4387ee7f-e6c4-4b64-a126-19aeb6aada0c tempest-VolumesSnapshotListTestJSON-834098657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.84a57d5d-5338-47fd-a15e-344761aac9ab {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:06 devstack sudo[99205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.84a57d5d-5338-47fd-a15e-344761aac9ab
Nov 06 11:52:06 devstack sudo[99205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:07 devstack sudo[99205]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4387ee7f-e6c4-4b64-a126-19aeb6aada0c tempest-VolumesSnapshotListTestJSON-834098657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.84a57d5d-5338-47fd-a15e-344761aac9ab" returned: 0 in 0.603s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:07 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-4387ee7f-e6c4-4b64-a126-19aeb6aada0c tempest-VolumesSnapshotListTestJSON-834098657 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8abaf450-c861-4c17-b76a-5cf313fce8f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:52:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4387ee7f-e6c4-4b64-a126-19aeb6aada0c tempest-VolumesSnapshotListTestJSON-834098657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.84a57d5d-5338-47fd-a15e-344761aac9ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.8a026403-50e4-4ab6-9894-5860e37a2a95 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:07 devstack sudo[99216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.84a57d5d-5338-47fd-a15e-344761aac9ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.8a026403-50e4-4ab6-9894-5860e37a2a95 1G
Nov 06 11:52:07 devstack sudo[99216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:07 devstack sudo[99216]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4387ee7f-e6c4-4b64-a126-19aeb6aada0c tempest-VolumesSnapshotListTestJSON-834098657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.84a57d5d-5338-47fd-a15e-344761aac9ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.8a026403-50e4-4ab6-9894-5860e37a2a95 1G" returned: 0 in 0.610s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4387ee7f-e6c4-4b64-a126-19aeb6aada0c tempest-VolumesSnapshotListTestJSON-834098657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.84a57d5d-5338-47fd-a15e-344761aac9ab -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.8a026403-50e4-4ab6-9894-5860e37a2a95 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:07 devstack sudo[99222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.84a57d5d-5338-47fd-a15e-344761aac9ab -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.8a026403-50e4-4ab6-9894-5860e37a2a95
Nov 06 11:52:07 devstack sudo[99222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:08 devstack sudo[99222]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4387ee7f-e6c4-4b64-a126-19aeb6aada0c tempest-VolumesSnapshotListTestJSON-834098657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.84a57d5d-5338-47fd-a15e-344761aac9ab -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.8a026403-50e4-4ab6-9894-5860e37a2a95" returned: 0 in 0.361s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:08 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-4387ee7f-e6c4-4b64-a126-19aeb6aada0c tempest-VolumesSnapshotListTestJSON-834098657 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.8a026403-50e4-4ab6-9894-5860e37a2a95 is being set with open permissions: ugo+rw
Nov 06 11:52:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4387ee7f-e6c4-4b64-a126-19aeb6aada0c tempest-VolumesSnapshotListTestJSON-834098657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.8a026403-50e4-4ab6-9894-5860e37a2a95 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:08 devstack sudo[99228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.8a026403-50e4-4ab6-9894-5860e37a2a95
Nov 06 11:52:08 devstack sudo[99228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:08 devstack sudo[99228]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4387ee7f-e6c4-4b64-a126-19aeb6aada0c tempest-VolumesSnapshotListTestJSON-834098657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.8a026403-50e4-4ab6-9894-5860e37a2a95" returned: 0 in 0.311s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4387ee7f-e6c4-4b64-a126-19aeb6aada0c tempest-VolumesSnapshotListTestJSON-834098657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.067s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:52:08 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-4387ee7f-e6c4-4b64-a126-19aeb6aada0c tempest-VolumesSnapshotListTestJSON-834098657 None] Create snapshot completed successfully
Nov 06 11:52:11 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e0f9d884-3298-4c57-b43c-dfac9d55e57d tempest-VolumesSnapshotListTestJSON-834098657 None] Acquiring lock "cinder-8a026403-50e4-4ab6-9894-5860e37a2a95-delete_snapshot" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:52:11 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e0f9d884-3298-4c57-b43c-dfac9d55e57d tempest-VolumesSnapshotListTestJSON-834098657 None] Lock "cinder-8a026403-50e4-4ab6-9894-5860e37a2a95-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:52:11 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e0f9d884-3298-4c57-b43c-dfac9d55e57d tempest-VolumesSnapshotListTestJSON-834098657 None] Acquiring lock "cinder-quobyte-8abaf450-c861-4c17-b76a-5cf313fce8f1" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:52:11 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e0f9d884-3298-4c57-b43c-dfac9d55e57d tempest-VolumesSnapshotListTestJSON-834098657 None] Lock "cinder-quobyte-8abaf450-c861-4c17-b76a-5cf313fce8f1" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:52:11 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e0f9d884-3298-4c57-b43c-dfac9d55e57d tempest-VolumesSnapshotListTestJSON-834098657 None] Acquiring lock "cinder-quobyte-8a026403-50e4-4ab6-9894-5860e37a2a95" by "_delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:52:11 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e0f9d884-3298-4c57-b43c-dfac9d55e57d tempest-VolumesSnapshotListTestJSON-834098657 None] Lock "cinder-quobyte-8a026403-50e4-4ab6-9894-5860e37a2a95" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:52:11 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-e0f9d884-3298-4c57-b43c-dfac9d55e57d tempest-VolumesSnapshotListTestJSON-834098657 None] Deleting offline snapshot 8a026403-50e4-4ab6-9894-5860e37a2a95 of volume 8abaf450-c861-4c17-b76a-5cf313fce8f1 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 11:52:11 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-e0f9d884-3298-4c57-b43c-dfac9d55e57d tempest-VolumesSnapshotListTestJSON-834098657 None] snapshot_file for this snap is: volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.8a026403-50e4-4ab6-9894-5860e37a2a95 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 11:52:11 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9c45a4-9b5e-4040-9885-eb7730ad3c11]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:52:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e0f9d884-3298-4c57-b43c-dfac9d55e57d tempest-VolumesSnapshotListTestJSON-834098657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.8a026403-50e4-4ab6-9894-5860e37a2a95 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:11 devstack sudo[99235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.8a026403-50e4-4ab6-9894-5860e37a2a95
Nov 06 11:52:11 devstack sudo[99235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:11 devstack sudo[99235]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e0f9d884-3298-4c57-b43c-dfac9d55e57d tempest-VolumesSnapshotListTestJSON-834098657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.8a026403-50e4-4ab6-9894-5860e37a2a95" returned: 0 in 0.422s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:11 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-e0f9d884-3298-4c57-b43c-dfac9d55e57d tempest-VolumesSnapshotListTestJSON-834098657 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8abaf450-c861-4c17-b76a-5cf313fce8f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:52:11 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b24230-0f38-432f-b175-f19f010e0113]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:52:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e0f9d884-3298-4c57-b43c-dfac9d55e57d tempest-VolumesSnapshotListTestJSON-834098657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.84a57d5d-5338-47fd-a15e-344761aac9ab {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:11 devstack sudo[99241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.84a57d5d-5338-47fd-a15e-344761aac9ab
Nov 06 11:52:11 devstack sudo[99241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:12 devstack sudo[99241]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e0f9d884-3298-4c57-b43c-dfac9d55e57d tempest-VolumesSnapshotListTestJSON-834098657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.84a57d5d-5338-47fd-a15e-344761aac9ab" returned: 0 in 0.497s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:12 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-e0f9d884-3298-4c57-b43c-dfac9d55e57d tempest-VolumesSnapshotListTestJSON-834098657 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8abaf450-c861-4c17-b76a-5cf313fce8f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:52:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e0f9d884-3298-4c57-b43c-dfac9d55e57d tempest-VolumesSnapshotListTestJSON-834098657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.8a026403-50e4-4ab6-9894-5860e37a2a95 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:12 devstack sudo[99246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.8a026403-50e4-4ab6-9894-5860e37a2a95
Nov 06 11:52:12 devstack sudo[99246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:12 devstack sudo[99246]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e0f9d884-3298-4c57-b43c-dfac9d55e57d tempest-VolumesSnapshotListTestJSON-834098657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.8a026403-50e4-4ab6-9894-5860e37a2a95" returned: 0 in 0.613s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e0f9d884-3298-4c57-b43c-dfac9d55e57d tempest-VolumesSnapshotListTestJSON-834098657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.8a026403-50e4-4ab6-9894-5860e37a2a95 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:12 devstack sudo[99252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.8a026403-50e4-4ab6-9894-5860e37a2a95
Nov 06 11:52:12 devstack sudo[99252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:13 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a6f3ee9-cbed-4d96-8abc-f055e475aa26 tempest-VolumesCloneNegativeTest-1013345877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:52:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3a6f3ee9-cbed-4d96-8abc-f055e475aa26 tempest-VolumesCloneNegativeTest-1013345877 None] Flow 'volume_create_manager' (33f74c8c-f976-40dd-8d72-2498ec72b20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:52:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3a6f3ee9-cbed-4d96-8abc-f055e475aa26 tempest-VolumesCloneNegativeTest-1013345877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a2bb815-37af-448c-926a-c0a0a8352d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3a6f3ee9-cbed-4d96-8abc-f055e475aa26 tempest-VolumesCloneNegativeTest-1013345877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a2bb815-37af-448c-926a-c0a0a8352d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1258755584',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fa13b15-74fe-4234-8004-7518b28badd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='055a87d598b0473abdf061c12e66246f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:52:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:52:13Z,use_quota=True,user_id='bbdd0787902f427c9bcda4083a912a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3a6f3ee9-cbed-4d96-8abc-f055e475aa26 tempest-VolumesCloneNegativeTest-1013345877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (770c23dc-4bba-46f8-b5eb-5e34f9d8bed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3a6f3ee9-cbed-4d96-8abc-f055e475aa26 tempest-VolumesCloneNegativeTest-1013345877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (770c23dc-4bba-46f8-b5eb-5e34f9d8bed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3a6f3ee9-cbed-4d96-8abc-f055e475aa26 tempest-VolumesCloneNegativeTest-1013345877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc88bf34-16d1-4cbf-825a-e951e04c574b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3a6f3ee9-cbed-4d96-8abc-f055e475aa26 tempest-VolumesCloneNegativeTest-1013345877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc88bf34-16d1-4cbf-825a-e951e04c574b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fa13b15-74fe-4234-8004-7518b28badd9', 'volume_name': 'volume-8fa13b15-74fe-4234-8004-7518b28badd9', 'volume_size': 2}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3a6f3ee9-cbed-4d96-8abc-f055e475aa26 tempest-VolumesCloneNegativeTest-1013345877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9906340-a51f-415e-889a-f547e63df7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3a6f3ee9-cbed-4d96-8abc-f055e475aa26 tempest-VolumesCloneNegativeTest-1013345877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9906340-a51f-415e-889a-f547e63df7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3a6f3ee9-cbed-4d96-8abc-f055e475aa26 tempest-VolumesCloneNegativeTest-1013345877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82edf59b-73b8-41c2-aca0-15cfb3e11c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:13 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-3a6f3ee9-cbed-4d96-8abc-f055e475aa26 tempest-VolumesCloneNegativeTest-1013345877 None] Volume 8fa13b15-74fe-4234-8004-7518b28badd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fa13b15-74fe-4234-8004-7518b28badd9', 'volume_size': 2}
Nov 06 11:52:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3a6f3ee9-cbed-4d96-8abc-f055e475aa26 tempest-VolumesCloneNegativeTest-1013345877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:52:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3a6f3ee9-cbed-4d96-8abc-f055e475aa26 tempest-VolumesCloneNegativeTest-1013345877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:52:13 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-3a6f3ee9-cbed-4d96-8abc-f055e475aa26 tempest-VolumesCloneNegativeTest-1013345877 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1258755584',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fa13b15-74fe-4234-8004-7518b28badd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='055a87d598b0473abdf061c12e66246f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:52:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:52:13Z,use_quota=True,user_id='bbdd0787902f427c9bcda4083a912a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:52:13 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-3a6f3ee9-cbed-4d96-8abc-f055e475aa26 tempest-VolumesCloneNegativeTest-1013345877 None] Creating volume 8fa13b15-74fe-4234-8004-7518b28badd9 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:52:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3a6f3ee9-cbed-4d96-8abc-f055e475aa26 tempest-VolumesCloneNegativeTest-1013345877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:52:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3a6f3ee9-cbed-4d96-8abc-f055e475aa26 tempest-VolumesCloneNegativeTest-1013345877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:52:13 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-3a6f3ee9-cbed-4d96-8abc-f055e475aa26 tempest-VolumesCloneNegativeTest-1013345877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:52:13 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-3a6f3ee9-cbed-4d96-8abc-f055e475aa26 tempest-VolumesCloneNegativeTest-1013345877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:52:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3a6f3ee9-cbed-4d96-8abc-f055e475aa26 tempest-VolumesCloneNegativeTest-1013345877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:52:13 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-3a6f3ee9-cbed-4d96-8abc-f055e475aa26 tempest-VolumesCloneNegativeTest-1013345877 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:52:13 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-3a6f3ee9-cbed-4d96-8abc-f055e475aa26 tempest-VolumesCloneNegativeTest-1013345877 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:52:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3a6f3ee9-cbed-4d96-8abc-f055e475aa26 tempest-VolumesCloneNegativeTest-1013345877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8fa13b15-74fe-4234-8004-7518b28badd9 2147483648 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:13 devstack sudo[99252]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e0f9d884-3298-4c57-b43c-dfac9d55e57d tempest-VolumesSnapshotListTestJSON-834098657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.8a026403-50e4-4ab6-9894-5860e37a2a95" returned: 0 in 0.367s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:13 devstack sudo[99255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8fa13b15-74fe-4234-8004-7518b28badd9 2147483648
Nov 06 11:52:13 devstack sudo[99255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:13 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e0f9d884-3298-4c57-b43c-dfac9d55e57d tempest-VolumesSnapshotListTestJSON-834098657 None] Lock "cinder-quobyte-8a026403-50e4-4ab6-9894-5860e37a2a95" released by "_delete_snapshot" :: held 2.063s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:52:13 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e0f9d884-3298-4c57-b43c-dfac9d55e57d tempest-VolumesSnapshotListTestJSON-834098657 None] Lock "cinder-quobyte-8abaf450-c861-4c17-b76a-5cf313fce8f1" released by "delete_snapshot" :: held 2.094s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:52:13 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-e0f9d884-3298-4c57-b43c-dfac9d55e57d tempest-VolumesSnapshotListTestJSON-834098657 None] Created reservations ['9560b899-52c7-4d5f-a3c2-ddf7893e21d9', '00c1df31-ead4-4b2d-b9b0-da3a4db4570d', 'd815398f-dfa8-4ed0-9da8-7b3cb92d19cf', 'edf67d7d-f38d-40ee-94ea-d67bff34b623'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:52:13 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-e0f9d884-3298-4c57-b43c-dfac9d55e57d tempest-VolumesSnapshotListTestJSON-834098657 None] Delete snapshot completed successfully.
Nov 06 11:52:13 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e0f9d884-3298-4c57-b43c-dfac9d55e57d tempest-VolumesSnapshotListTestJSON-834098657 None] Lock "cinder-8a026403-50e4-4ab6-9894-5860e37a2a95-delete_snapshot" released by "delete_snapshot" :: held 2.310s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:52:13 devstack sudo[99255]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3a6f3ee9-cbed-4d96-8abc-f055e475aa26 tempest-VolumesCloneNegativeTest-1013345877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8fa13b15-74fe-4234-8004-7518b28badd9 2147483648" returned: 0 in 0.635s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3a6f3ee9-cbed-4d96-8abc-f055e475aa26 tempest-VolumesCloneNegativeTest-1013345877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8fa13b15-74fe-4234-8004-7518b28badd9 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:13 devstack sudo[99264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8fa13b15-74fe-4234-8004-7518b28badd9
Nov 06 11:52:13 devstack sudo[99264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:14 devstack sudo[99264]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3a6f3ee9-cbed-4d96-8abc-f055e475aa26 tempest-VolumesCloneNegativeTest-1013345877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8fa13b15-74fe-4234-8004-7518b28badd9" returned: 0 in 0.313s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:14 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-3a6f3ee9-cbed-4d96-8abc-f055e475aa26 tempest-VolumesCloneNegativeTest-1013345877 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:52:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3a6f3ee9-cbed-4d96-8abc-f055e475aa26 tempest-VolumesCloneNegativeTest-1013345877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:52:14 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3a6f3ee9-cbed-4d96-8abc-f055e475aa26 tempest-VolumesCloneNegativeTest-1013345877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82edf59b-73b8-41c2-aca0-15cfb3e11c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fa13b15-74fe-4234-8004-7518b28badd9', 'volume_size': 2}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:14 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3a6f3ee9-cbed-4d96-8abc-f055e475aa26 tempest-VolumesCloneNegativeTest-1013345877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcee926f-c402-4342-a981-915a5b270f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:14 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-3a6f3ee9-cbed-4d96-8abc-f055e475aa26 tempest-VolumesCloneNegativeTest-1013345877 None] Volume volume-8fa13b15-74fe-4234-8004-7518b28badd9 (8fa13b15-74fe-4234-8004-7518b28badd9): created successfully
Nov 06 11:52:14 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3a6f3ee9-cbed-4d96-8abc-f055e475aa26 tempest-VolumesCloneNegativeTest-1013345877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcee926f-c402-4342-a981-915a5b270f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:14 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3a6f3ee9-cbed-4d96-8abc-f055e475aa26 tempest-VolumesCloneNegativeTest-1013345877 None] Flow 'volume_create_manager' (33f74c8c-f976-40dd-8d72-2498ec72b20a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:52:14 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-3a6f3ee9-cbed-4d96-8abc-f055e475aa26 tempest-VolumesCloneNegativeTest-1013345877 None] Created volume successfully.
Nov 06 11:52:14 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-dc796437-2ee1-4d4a-9214-13b4c3f3356d tempest-VolumesSnapshotListTestJSON-834098657 None] Acquiring lock "cinder-84a57d5d-5338-47fd-a15e-344761aac9ab-delete_snapshot" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:52:14 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-dc796437-2ee1-4d4a-9214-13b4c3f3356d tempest-VolumesSnapshotListTestJSON-834098657 None] Lock "cinder-84a57d5d-5338-47fd-a15e-344761aac9ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:52:14 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-dc796437-2ee1-4d4a-9214-13b4c3f3356d tempest-VolumesSnapshotListTestJSON-834098657 None] Acquiring lock "cinder-quobyte-8abaf450-c861-4c17-b76a-5cf313fce8f1" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:52:14 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-dc796437-2ee1-4d4a-9214-13b4c3f3356d tempest-VolumesSnapshotListTestJSON-834098657 None] Lock "cinder-quobyte-8abaf450-c861-4c17-b76a-5cf313fce8f1" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:52:14 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-dc796437-2ee1-4d4a-9214-13b4c3f3356d tempest-VolumesSnapshotListTestJSON-834098657 None] Acquiring lock "cinder-quobyte-84a57d5d-5338-47fd-a15e-344761aac9ab" by "_delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:52:14 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-dc796437-2ee1-4d4a-9214-13b4c3f3356d tempest-VolumesSnapshotListTestJSON-834098657 None] Lock "cinder-quobyte-84a57d5d-5338-47fd-a15e-344761aac9ab" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:52:14 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-dc796437-2ee1-4d4a-9214-13b4c3f3356d tempest-VolumesSnapshotListTestJSON-834098657 None] Deleting offline snapshot 84a57d5d-5338-47fd-a15e-344761aac9ab of volume 8abaf450-c861-4c17-b76a-5cf313fce8f1 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 11:52:14 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-dc796437-2ee1-4d4a-9214-13b4c3f3356d tempest-VolumesSnapshotListTestJSON-834098657 None] snapshot_file for this snap is: volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.84a57d5d-5338-47fd-a15e-344761aac9ab {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 11:52:14 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[05495239-e2c8-4877-8c65-823fc3e23a16]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:52:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-dc796437-2ee1-4d4a-9214-13b4c3f3356d tempest-VolumesSnapshotListTestJSON-834098657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.84a57d5d-5338-47fd-a15e-344761aac9ab {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:14 devstack sudo[99271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.84a57d5d-5338-47fd-a15e-344761aac9ab
Nov 06 11:52:14 devstack sudo[99271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:15 devstack sudo[99271]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-dc796437-2ee1-4d4a-9214-13b4c3f3356d tempest-VolumesSnapshotListTestJSON-834098657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.84a57d5d-5338-47fd-a15e-344761aac9ab" returned: 0 in 0.609s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:15 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-dc796437-2ee1-4d4a-9214-13b4c3f3356d tempest-VolumesSnapshotListTestJSON-834098657 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8abaf450-c861-4c17-b76a-5cf313fce8f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:52:15 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f123a8d3-2db7-40b2-a938-6e156be7f912]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:52:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-dc796437-2ee1-4d4a-9214-13b4c3f3356d tempest-VolumesSnapshotListTestJSON-834098657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.f8b8528f-2842-4b11-bcbb-eac6df56e13e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:15 devstack sudo[99276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.f8b8528f-2842-4b11-bcbb-eac6df56e13e
Nov 06 11:52:15 devstack sudo[99276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:15 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ce74f717-331c-487c-b0a8-c11ddd6894c1 tempest-VolumesCloneNegativeTest-1013345877 None] Acquiring lock "cinder-8fa13b15-74fe-4234-8004-7518b28badd9-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:52:15 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ce74f717-331c-487c-b0a8-c11ddd6894c1 tempest-VolumesCloneNegativeTest-1013345877 None] Lock "cinder-8fa13b15-74fe-4234-8004-7518b28badd9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:52:15 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ce74f717-331c-487c-b0a8-c11ddd6894c1 tempest-VolumesCloneNegativeTest-1013345877 None] Acquiring lock "cinder-quobyte-8fa13b15-74fe-4234-8004-7518b28badd9" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:52:15 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ce74f717-331c-487c-b0a8-c11ddd6894c1 tempest-VolumesCloneNegativeTest-1013345877 None] Lock "cinder-quobyte-8fa13b15-74fe-4234-8004-7518b28badd9" acquired by "delete_volume" :: waited 0.019s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:52:15 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f26fcec-48b2-4cc5-ad01-25cc67e30efd]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:52:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ce74f717-331c-487c-b0a8-c11ddd6894c1 tempest-VolumesCloneNegativeTest-1013345877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8fa13b15-74fe-4234-8004-7518b28badd9 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:15 devstack sudo[99276]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:15 devstack sudo[99281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8fa13b15-74fe-4234-8004-7518b28badd9
Nov 06 11:52:15 devstack sudo[99281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-dc796437-2ee1-4d4a-9214-13b4c3f3356d tempest-VolumesSnapshotListTestJSON-834098657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.f8b8528f-2842-4b11-bcbb-eac6df56e13e" returned: 0 in 0.567s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:15 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-dc796437-2ee1-4d4a-9214-13b4c3f3356d tempest-VolumesSnapshotListTestJSON-834098657 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8abaf450-c861-4c17-b76a-5cf313fce8f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:52:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-dc796437-2ee1-4d4a-9214-13b4c3f3356d tempest-VolumesSnapshotListTestJSON-834098657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.84a57d5d-5338-47fd-a15e-344761aac9ab {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:15 devstack sudo[99287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.84a57d5d-5338-47fd-a15e-344761aac9ab
Nov 06 11:52:15 devstack sudo[99287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:16 devstack sudo[99281]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ce74f717-331c-487c-b0a8-c11ddd6894c1 tempest-VolumesCloneNegativeTest-1013345877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8fa13b15-74fe-4234-8004-7518b28badd9" returned: 0 in 0.690s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ce74f717-331c-487c-b0a8-c11ddd6894c1 tempest-VolumesCloneNegativeTest-1013345877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8fa13b15-74fe-4234-8004-7518b28badd9 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:16 devstack sudo[99304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8fa13b15-74fe-4234-8004-7518b28badd9
Nov 06 11:52:16 devstack sudo[99304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:16 devstack sudo[99287]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-dc796437-2ee1-4d4a-9214-13b4c3f3356d tempest-VolumesSnapshotListTestJSON-834098657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.84a57d5d-5338-47fd-a15e-344761aac9ab" returned: 0 in 0.715s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-dc796437-2ee1-4d4a-9214-13b4c3f3356d tempest-VolumesSnapshotListTestJSON-834098657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.84a57d5d-5338-47fd-a15e-344761aac9ab {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:16 devstack sudo[99308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.84a57d5d-5338-47fd-a15e-344761aac9ab
Nov 06 11:52:16 devstack sudo[99308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:16 devstack sudo[99304]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ce74f717-331c-487c-b0a8-c11ddd6894c1 tempest-VolumesCloneNegativeTest-1013345877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8fa13b15-74fe-4234-8004-7518b28badd9" returned: 0 in 0.407s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:16 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ce74f717-331c-487c-b0a8-c11ddd6894c1 tempest-VolumesCloneNegativeTest-1013345877 None] Lock "cinder-quobyte-8fa13b15-74fe-4234-8004-7518b28badd9" released by "delete_volume" :: held 1.175s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:52:16 devstack sudo[99308]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-dc796437-2ee1-4d4a-9214-13b4c3f3356d tempest-VolumesSnapshotListTestJSON-834098657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.84a57d5d-5338-47fd-a15e-344761aac9ab" returned: 0 in 0.283s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:16 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-dc796437-2ee1-4d4a-9214-13b4c3f3356d tempest-VolumesSnapshotListTestJSON-834098657 None] Lock "cinder-quobyte-84a57d5d-5338-47fd-a15e-344761aac9ab" released by "_delete_snapshot" :: held 2.338s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:52:16 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-ce74f717-331c-487c-b0a8-c11ddd6894c1 tempest-VolumesCloneNegativeTest-1013345877 None] Created reservations ['4d857948-bed1-4784-b35e-f2b547a244c3', '145c797d-bc9e-40bf-922b-de0e34e89ec7', '8d9b6bd4-d956-4602-812b-f6ef158513b6', 'ce7ab476-4370-4bdd-b33c-71404622b1fb'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:52:16 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-dc796437-2ee1-4d4a-9214-13b4c3f3356d tempest-VolumesSnapshotListTestJSON-834098657 None] Lock "cinder-quobyte-8abaf450-c861-4c17-b76a-5cf313fce8f1" released by "delete_snapshot" :: held 2.383s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:52:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ce74f717-331c-487c-b0a8-c11ddd6894c1 tempest-VolumesCloneNegativeTest-1013345877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:52:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ce74f717-331c-487c-b0a8-c11ddd6894c1 tempest-VolumesCloneNegativeTest-1013345877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:52:16 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ce74f717-331c-487c-b0a8-c11ddd6894c1 tempest-VolumesCloneNegativeTest-1013345877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:52:16 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ce74f717-331c-487c-b0a8-c11ddd6894c1 tempest-VolumesCloneNegativeTest-1013345877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:52:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ce74f717-331c-487c-b0a8-c11ddd6894c1 tempest-VolumesCloneNegativeTest-1013345877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:52:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ce74f717-331c-487c-b0a8-c11ddd6894c1 tempest-VolumesCloneNegativeTest-1013345877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:16 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-dc796437-2ee1-4d4a-9214-13b4c3f3356d tempest-VolumesSnapshotListTestJSON-834098657 None] Created reservations ['3650a39a-4d02-44e7-acb8-c440826fecbe', '934368c9-fd4d-4714-94ab-007bd3713757', 'f1a2b286-6f25-4a9d-aacb-256b66152524', '52a39b2d-d72e-466b-a3c3-8738c28b2d2d'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:52:16 devstack sudo[99312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:52:16 devstack sudo[99312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:17 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-dc796437-2ee1-4d4a-9214-13b4c3f3356d tempest-VolumesSnapshotListTestJSON-834098657 None] Delete snapshot completed successfully.
Nov 06 11:52:17 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-dc796437-2ee1-4d4a-9214-13b4c3f3356d tempest-VolumesSnapshotListTestJSON-834098657 None] Lock "cinder-84a57d5d-5338-47fd-a15e-344761aac9ab-delete_snapshot" released by "delete_snapshot" :: held 2.607s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:52:17 devstack cinder-volume[87165]: DEBUG oslo_service.periodic_task [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 11:52:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:52:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:52:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:52:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:52:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:52:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:17 devstack sudo[99314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:52:17 devstack sudo[99314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:17 devstack sudo[99312]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ce74f717-331c-487c-b0a8-c11ddd6894c1 tempest-VolumesCloneNegativeTest-1013345877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.291s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:17 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-ce74f717-331c-487c-b0a8-c11ddd6894c1 tempest-VolumesCloneNegativeTest-1013345877 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:52:17 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-ce74f717-331c-487c-b0a8-c11ddd6894c1 tempest-VolumesCloneNegativeTest-1013345877 None] Deleted volume successfully.
Nov 06 11:52:17 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ce74f717-331c-487c-b0a8-c11ddd6894c1 tempest-VolumesCloneNegativeTest-1013345877 None] Lock "cinder-8fa13b15-74fe-4234-8004-7518b28badd9-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:52:17 devstack sudo[99314]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.277s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:17 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:52:17 devstack cinder-volume[87165]: DEBUG oslo_service.periodic_task [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running periodic task VolumeManager._thread_info {{(pid=87165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 11:52:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] thread count: 29 {{(pid=87165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 11:52:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] thread info: [<_MainThread(MainThread, started 127732956901504)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127732842693056)>, <Thread(Thread-3 (stat_writer), started daemon 127732841891136)>, <Thread(Rabbit-heartbeat, started daemon 127732842515648)>, <Thread(Thread-5 (_runner), started daemon 127732840534464)>, <Thread(Thread-7 (_runner), started daemon 127732840636032)>, <Thread(fd_logger, started daemon 127732838664256)>, <Thread(privsep_reader, started daemon 127732838673408)>, <Thread(tpool_thread_0, started daemon 127732829828800)>, <Thread(tpool_thread_1, started daemon 127732821436096)>, <Thread(tpool_thread_2, started daemon 127732813043392)>, <Thread(tpool_thread_3, started daemon 127732804650688)>, <Thread(tpool_thread_4, started daemon 127732796257984)>, <Thread(tpool_thread_5, started daemon 127732787865280)>, <Thread(tpool_thread_6, started daemon 127732779456192)>, <Thread(tpool_thread_7, started daemon 127732771047104)>, <Thread(tpool_thread_8, started daemon 127732762638016)>, <Thread(tpool_thread_9, started daemon 127732754228928)>, <Thread(tpool_thread_10, started daemon 127732745819840)>, <Thread(tpool_thread_11, started daemon 127732737410752)>, <Thread(tpool_thread_12, started daemon 127732729001664)>, <Thread(tpool_thread_13, started daemon 127732720592576)>, <Thread(tpool_thread_14, started daemon 127732712183488)>, <Thread(tpool_thread_15, started daemon 127732703774400)>, <Thread(tpool_thread_16, started daemon 127732695365312)>, <Thread(tpool_thread_17, started daemon 127732686956224)>, <Thread(tpool_thread_18, started daemon 127732678547136)>, <Thread(tpool_thread_19, started daemon 127732670138048)>, <Thread(Rabbit-heartbeat, started daemon 127732832631296)>] {{(pid=87165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 11:52:17 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-49bce843-f868-41f6-85da-39b60fe53134 tempest-VolumesSnapshotListTestJSON-834098657 None] Acquiring lock "cinder-f8b8528f-2842-4b11-bcbb-eac6df56e13e-delete_snapshot" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:52:17 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-49bce843-f868-41f6-85da-39b60fe53134 tempest-VolumesSnapshotListTestJSON-834098657 None] Lock "cinder-f8b8528f-2842-4b11-bcbb-eac6df56e13e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:52:17 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-49bce843-f868-41f6-85da-39b60fe53134 tempest-VolumesSnapshotListTestJSON-834098657 None] Acquiring lock "cinder-quobyte-8abaf450-c861-4c17-b76a-5cf313fce8f1" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:52:17 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-49bce843-f868-41f6-85da-39b60fe53134 tempest-VolumesSnapshotListTestJSON-834098657 None] Lock "cinder-quobyte-8abaf450-c861-4c17-b76a-5cf313fce8f1" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:52:17 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-49bce843-f868-41f6-85da-39b60fe53134 tempest-VolumesSnapshotListTestJSON-834098657 None] Acquiring lock "cinder-quobyte-f8b8528f-2842-4b11-bcbb-eac6df56e13e" by "_delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:52:17 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-49bce843-f868-41f6-85da-39b60fe53134 tempest-VolumesSnapshotListTestJSON-834098657 None] Lock "cinder-quobyte-f8b8528f-2842-4b11-bcbb-eac6df56e13e" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:52:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-49bce843-f868-41f6-85da-39b60fe53134 tempest-VolumesSnapshotListTestJSON-834098657 None] Deleting offline snapshot f8b8528f-2842-4b11-bcbb-eac6df56e13e of volume 8abaf450-c861-4c17-b76a-5cf313fce8f1 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 11:52:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-49bce843-f868-41f6-85da-39b60fe53134 tempest-VolumesSnapshotListTestJSON-834098657 None] snapshot_file for this snap is: volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.f8b8528f-2842-4b11-bcbb-eac6df56e13e {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 11:52:17 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[23235f77-eb39-433a-8ab2-0d64ebcaddfb]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:52:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-49bce843-f868-41f6-85da-39b60fe53134 tempest-VolumesSnapshotListTestJSON-834098657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.f8b8528f-2842-4b11-bcbb-eac6df56e13e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:17 devstack sudo[99319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.f8b8528f-2842-4b11-bcbb-eac6df56e13e
Nov 06 11:52:17 devstack sudo[99319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:18 devstack sudo[99319]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-49bce843-f868-41f6-85da-39b60fe53134 tempest-VolumesSnapshotListTestJSON-834098657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.f8b8528f-2842-4b11-bcbb-eac6df56e13e" returned: 0 in 0.440s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:18 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-49bce843-f868-41f6-85da-39b60fe53134 tempest-VolumesSnapshotListTestJSON-834098657 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8abaf450-c861-4c17-b76a-5cf313fce8f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:52:18 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8a0fa1-0bdc-47da-8fa3-d0508aed89a0]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:52:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-49bce843-f868-41f6-85da-39b60fe53134 tempest-VolumesSnapshotListTestJSON-834098657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:18 devstack sudo[99337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1
Nov 06 11:52:18 devstack sudo[99337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:19 devstack sudo[99337]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-49bce843-f868-41f6-85da-39b60fe53134 tempest-VolumesSnapshotListTestJSON-834098657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1" returned: 0 in 0.964s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-49bce843-f868-41f6-85da-39b60fe53134 tempest-VolumesSnapshotListTestJSON-834098657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.f8b8528f-2842-4b11-bcbb-eac6df56e13e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:19 devstack sudo[99405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.f8b8528f-2842-4b11-bcbb-eac6df56e13e
Nov 06 11:52:19 devstack sudo[99405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:20 devstack sudo[99405]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-49bce843-f868-41f6-85da-39b60fe53134 tempest-VolumesSnapshotListTestJSON-834098657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.f8b8528f-2842-4b11-bcbb-eac6df56e13e" returned: 0 in 0.695s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-49bce843-f868-41f6-85da-39b60fe53134 tempest-VolumesSnapshotListTestJSON-834098657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.f8b8528f-2842-4b11-bcbb-eac6df56e13e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:20 devstack sudo[99430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.f8b8528f-2842-4b11-bcbb-eac6df56e13e
Nov 06 11:52:20 devstack sudo[99430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:20 devstack sudo[99430]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-49bce843-f868-41f6-85da-39b60fe53134 tempest-VolumesSnapshotListTestJSON-834098657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1.f8b8528f-2842-4b11-bcbb-eac6df56e13e" returned: 0 in 0.451s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:20 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-49bce843-f868-41f6-85da-39b60fe53134 tempest-VolumesSnapshotListTestJSON-834098657 None] Lock "cinder-quobyte-f8b8528f-2842-4b11-bcbb-eac6df56e13e" released by "_delete_snapshot" :: held 2.943s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:52:20 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-49bce843-f868-41f6-85da-39b60fe53134 tempest-VolumesSnapshotListTestJSON-834098657 None] Lock "cinder-quobyte-8abaf450-c861-4c17-b76a-5cf313fce8f1" released by "delete_snapshot" :: held 2.984s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:52:20 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-49bce843-f868-41f6-85da-39b60fe53134 tempest-VolumesSnapshotListTestJSON-834098657 None] Created reservations ['59482650-f257-41f6-a991-91f4945e355a', '813bab04-672f-4a69-9b2b-3b5160b06ec3', '026c37e5-3514-45f1-8b92-b7d97c53e70b', '9e055002-655a-429e-922e-b1179e0030fb'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:52:21 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-49bce843-f868-41f6-85da-39b60fe53134 tempest-VolumesSnapshotListTestJSON-834098657 None] Delete snapshot completed successfully.
Nov 06 11:52:21 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-49bce843-f868-41f6-85da-39b60fe53134 tempest-VolumesSnapshotListTestJSON-834098657 None] Lock "cinder-f8b8528f-2842-4b11-bcbb-eac6df56e13e-delete_snapshot" released by "delete_snapshot" :: held 3.322s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:52:22 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ff53ca30-a39f-4b14-ae6c-1bbb41990aab tempest-VolumesSnapshotListTestJSON-834098657 None] Acquiring lock "cinder-8abaf450-c861-4c17-b76a-5cf313fce8f1-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:52:22 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ff53ca30-a39f-4b14-ae6c-1bbb41990aab tempest-VolumesSnapshotListTestJSON-834098657 None] Lock "cinder-8abaf450-c861-4c17-b76a-5cf313fce8f1-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:52:22 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ff53ca30-a39f-4b14-ae6c-1bbb41990aab tempest-VolumesSnapshotListTestJSON-834098657 None] Acquiring lock "cinder-quobyte-8abaf450-c861-4c17-b76a-5cf313fce8f1" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:52:22 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ff53ca30-a39f-4b14-ae6c-1bbb41990aab tempest-VolumesSnapshotListTestJSON-834098657 None] Lock "cinder-quobyte-8abaf450-c861-4c17-b76a-5cf313fce8f1" acquired by "delete_volume" :: waited 0.023s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:52:22 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7a16ad-4eb7-4744-b3b4-22ccacb62126]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:52:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ff53ca30-a39f-4b14-ae6c-1bbb41990aab tempest-VolumesSnapshotListTestJSON-834098657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:22 devstack sudo[99438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1
Nov 06 11:52:22 devstack sudo[99438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:23 devstack sudo[99438]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ff53ca30-a39f-4b14-ae6c-1bbb41990aab tempest-VolumesSnapshotListTestJSON-834098657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1" returned: 0 in 0.762s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ff53ca30-a39f-4b14-ae6c-1bbb41990aab tempest-VolumesSnapshotListTestJSON-834098657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:23 devstack sudo[99467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1
Nov 06 11:52:23 devstack sudo[99467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:23 devstack sudo[99467]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ff53ca30-a39f-4b14-ae6c-1bbb41990aab tempest-VolumesSnapshotListTestJSON-834098657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8abaf450-c861-4c17-b76a-5cf313fce8f1" returned: 0 in 0.538s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:23 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ff53ca30-a39f-4b14-ae6c-1bbb41990aab tempest-VolumesSnapshotListTestJSON-834098657 None] Lock "cinder-quobyte-8abaf450-c861-4c17-b76a-5cf313fce8f1" released by "delete_volume" :: held 1.456s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:52:23 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-ff53ca30-a39f-4b14-ae6c-1bbb41990aab tempest-VolumesSnapshotListTestJSON-834098657 None] Created reservations ['57dc7383-be98-49b7-b2da-d4e548ddc00a', '98ee4799-0088-4544-a832-1bb4fac58e25', '499e5c2f-1c58-43b5-ba72-f297b7099837', 'fb1bad00-6466-4604-8d6a-89cc696a7e81'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:52:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ff53ca30-a39f-4b14-ae6c-1bbb41990aab tempest-VolumesSnapshotListTestJSON-834098657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:52:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ff53ca30-a39f-4b14-ae6c-1bbb41990aab tempest-VolumesSnapshotListTestJSON-834098657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:52:24 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ff53ca30-a39f-4b14-ae6c-1bbb41990aab tempest-VolumesSnapshotListTestJSON-834098657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:52:24 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ff53ca30-a39f-4b14-ae6c-1bbb41990aab tempest-VolumesSnapshotListTestJSON-834098657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:52:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ff53ca30-a39f-4b14-ae6c-1bbb41990aab tempest-VolumesSnapshotListTestJSON-834098657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:52:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ff53ca30-a39f-4b14-ae6c-1bbb41990aab tempest-VolumesSnapshotListTestJSON-834098657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:24 devstack sudo[99471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:52:24 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:24 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ff53ca30-a39f-4b14-ae6c-1bbb41990aab tempest-VolumesSnapshotListTestJSON-834098657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.448s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:24 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-ff53ca30-a39f-4b14-ae6c-1bbb41990aab tempest-VolumesSnapshotListTestJSON-834098657 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:52:24 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-ff53ca30-a39f-4b14-ae6c-1bbb41990aab tempest-VolumesSnapshotListTestJSON-834098657 None] Deleted volume successfully.
Nov 06 11:52:24 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ff53ca30-a39f-4b14-ae6c-1bbb41990aab tempest-VolumesSnapshotListTestJSON-834098657 None] Lock "cinder-8abaf450-c861-4c17-b76a-5cf313fce8f1-delete_volume" released by "delete_volume" :: held 2.349s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:52:25 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-ace47756-e7f1-4577-a4d8-45a03a9bf22a tempest-VolumesGetTest-1808283213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:52:25 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ace47756-e7f1-4577-a4d8-45a03a9bf22a tempest-VolumesGetTest-1808283213 None] Flow 'volume_create_manager' (f176540e-9bf8-4e1e-ad3d-94535eded339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:52:25 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ace47756-e7f1-4577-a4d8-45a03a9bf22a tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00ca6f1e-1393-433a-a4b6-b597f84ac43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:25 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ace47756-e7f1-4577-a4d8-45a03a9bf22a tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00ca6f1e-1393-433a-a4b6-b597f84ac43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:52:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1463523510',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d6a9dd-48a8-4edb-b43e-abaedbb0368d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b5e75b8c20d74e969666dcfe5a136c77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:52:25Z,use_quota=True,user_id='e6366d137d5243fd83eef9883759cc58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:25 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ace47756-e7f1-4577-a4d8-45a03a9bf22a tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ab7037e-5e04-4446-a118-61c012db5e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:25 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ace47756-e7f1-4577-a4d8-45a03a9bf22a tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ab7037e-5e04-4446-a118-61c012db5e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:25 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ace47756-e7f1-4577-a4d8-45a03a9bf22a tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c74b291-638c-463f-ac6f-5dc909ca67cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:25 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ace47756-e7f1-4577-a4d8-45a03a9bf22a tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c74b291-638c-463f-ac6f-5dc909ca67cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05d6a9dd-48a8-4edb-b43e-abaedbb0368d', 'volume_name': 'volume-05d6a9dd-48a8-4edb-b43e-abaedbb0368d', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:25 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ace47756-e7f1-4577-a4d8-45a03a9bf22a tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (677d6c2f-855c-4099-a9f2-b85cd80d96d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:25 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ace47756-e7f1-4577-a4d8-45a03a9bf22a tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (677d6c2f-855c-4099-a9f2-b85cd80d96d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:25 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ace47756-e7f1-4577-a4d8-45a03a9bf22a tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b604b69-1103-44ae-88f4-eb96c41ebd42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:25 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-ace47756-e7f1-4577-a4d8-45a03a9bf22a tempest-VolumesGetTest-1808283213 None] Volume 05d6a9dd-48a8-4edb-b43e-abaedbb0368d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05d6a9dd-48a8-4edb-b43e-abaedbb0368d', 'volume_size': 1}
Nov 06 11:52:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ace47756-e7f1-4577-a4d8-45a03a9bf22a tempest-VolumesGetTest-1808283213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:52:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ace47756-e7f1-4577-a4d8-45a03a9bf22a tempest-VolumesGetTest-1808283213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:52:25 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ace47756-e7f1-4577-a4d8-45a03a9bf22a tempest-VolumesGetTest-1808283213 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:52:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1463523510',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d6a9dd-48a8-4edb-b43e-abaedbb0368d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b5e75b8c20d74e969666dcfe5a136c77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:52:25Z,use_quota=True,user_id='e6366d137d5243fd83eef9883759cc58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:52:25 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-ace47756-e7f1-4577-a4d8-45a03a9bf22a tempest-VolumesGetTest-1808283213 None] Creating volume 05d6a9dd-48a8-4edb-b43e-abaedbb0368d {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:52:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ace47756-e7f1-4577-a4d8-45a03a9bf22a tempest-VolumesGetTest-1808283213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:52:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ace47756-e7f1-4577-a4d8-45a03a9bf22a tempest-VolumesGetTest-1808283213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:52:25 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ace47756-e7f1-4577-a4d8-45a03a9bf22a tempest-VolumesGetTest-1808283213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:52:25 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ace47756-e7f1-4577-a4d8-45a03a9bf22a tempest-VolumesGetTest-1808283213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:52:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ace47756-e7f1-4577-a4d8-45a03a9bf22a tempest-VolumesGetTest-1808283213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:52:25 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ace47756-e7f1-4577-a4d8-45a03a9bf22a tempest-VolumesGetTest-1808283213 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:52:25 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-ace47756-e7f1-4577-a4d8-45a03a9bf22a tempest-VolumesGetTest-1808283213 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:52:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ace47756-e7f1-4577-a4d8-45a03a9bf22a tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-05d6a9dd-48a8-4edb-b43e-abaedbb0368d 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:25 devstack sudo[99476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-05d6a9dd-48a8-4edb-b43e-abaedbb0368d 1073741824
Nov 06 11:52:25 devstack sudo[99476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:25 devstack sudo[99476]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ace47756-e7f1-4577-a4d8-45a03a9bf22a tempest-VolumesGetTest-1808283213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-05d6a9dd-48a8-4edb-b43e-abaedbb0368d 1073741824" returned: 0 in 0.695s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ace47756-e7f1-4577-a4d8-45a03a9bf22a tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-05d6a9dd-48a8-4edb-b43e-abaedbb0368d {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:26 devstack sudo[99482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-05d6a9dd-48a8-4edb-b43e-abaedbb0368d
Nov 06 11:52:26 devstack sudo[99482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:26 devstack sudo[99482]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ace47756-e7f1-4577-a4d8-45a03a9bf22a tempest-VolumesGetTest-1808283213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-05d6a9dd-48a8-4edb-b43e-abaedbb0368d" returned: 0 in 0.393s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:26 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ace47756-e7f1-4577-a4d8-45a03a9bf22a tempest-VolumesGetTest-1808283213 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:52:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ace47756-e7f1-4577-a4d8-45a03a9bf22a tempest-VolumesGetTest-1808283213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:52:26 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ace47756-e7f1-4577-a4d8-45a03a9bf22a tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b604b69-1103-44ae-88f4-eb96c41ebd42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05d6a9dd-48a8-4edb-b43e-abaedbb0368d', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:26 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ace47756-e7f1-4577-a4d8-45a03a9bf22a tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc4cdd98-add7-41f3-a62f-3b7baaea3f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:26 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-ace47756-e7f1-4577-a4d8-45a03a9bf22a tempest-VolumesGetTest-1808283213 None] Volume volume-05d6a9dd-48a8-4edb-b43e-abaedbb0368d (05d6a9dd-48a8-4edb-b43e-abaedbb0368d): created successfully
Nov 06 11:52:26 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ace47756-e7f1-4577-a4d8-45a03a9bf22a tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc4cdd98-add7-41f3-a62f-3b7baaea3f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:26 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ace47756-e7f1-4577-a4d8-45a03a9bf22a tempest-VolumesGetTest-1808283213 None] Flow 'volume_create_manager' (f176540e-9bf8-4e1e-ad3d-94535eded339) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:52:26 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-ace47756-e7f1-4577-a4d8-45a03a9bf22a tempest-VolumesGetTest-1808283213 None] Created volume successfully.
Nov 06 11:52:28 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac12d9d6-8986-4dd7-a1d8-a29be9d132b0 tempest-VolumesGetTest-1808283213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:52:28 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ac12d9d6-8986-4dd7-a1d8-a29be9d132b0 tempest-VolumesGetTest-1808283213 None] Flow 'volume_create_manager' (5da8db23-67c7-4d9f-aabf-68eb5c3862b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:52:28 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ac12d9d6-8986-4dd7-a1d8-a29be9d132b0 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f7243c-b6b5-4077-aff1-68576e473500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:28 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ac12d9d6-8986-4dd7-a1d8-a29be9d132b0 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f7243c-b6b5-4077-aff1-68576e473500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:52:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2051311529',display_name='tempest-VolumesGetTest-Volume-1260135946',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19778efa-493e-4dfa-beb1-5aab48755df0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5e75b8c20d74e969666dcfe5a136c77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:52:28Z,use_quota=True,user_id='e6366d137d5243fd83eef9883759cc58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:28 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ac12d9d6-8986-4dd7-a1d8-a29be9d132b0 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee434eed-757e-453a-9fb1-03c7f0943208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:28 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ac12d9d6-8986-4dd7-a1d8-a29be9d132b0 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee434eed-757e-453a-9fb1-03c7f0943208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:28 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ac12d9d6-8986-4dd7-a1d8-a29be9d132b0 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (411558f5-3fc4-49c9-9f62-45bbf40692f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:28 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ac12d9d6-8986-4dd7-a1d8-a29be9d132b0 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (411558f5-3fc4-49c9-9f62-45bbf40692f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19778efa-493e-4dfa-beb1-5aab48755df0', 'volume_name': 'volume-19778efa-493e-4dfa-beb1-5aab48755df0', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:28 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ac12d9d6-8986-4dd7-a1d8-a29be9d132b0 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d468dbd-3321-4c05-be11-fb14e4b91947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:28 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ac12d9d6-8986-4dd7-a1d8-a29be9d132b0 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d468dbd-3321-4c05-be11-fb14e4b91947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:28 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ac12d9d6-8986-4dd7-a1d8-a29be9d132b0 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e29b6219-3383-407d-ad66-c6e2e2916367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:28 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-ac12d9d6-8986-4dd7-a1d8-a29be9d132b0 tempest-VolumesGetTest-1808283213 None] Volume 19778efa-493e-4dfa-beb1-5aab48755df0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19778efa-493e-4dfa-beb1-5aab48755df0', 'volume_size': 1}
Nov 06 11:52:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ac12d9d6-8986-4dd7-a1d8-a29be9d132b0 tempest-VolumesGetTest-1808283213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:52:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ac12d9d6-8986-4dd7-a1d8-a29be9d132b0 tempest-VolumesGetTest-1808283213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:52:28 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ac12d9d6-8986-4dd7-a1d8-a29be9d132b0 tempest-VolumesGetTest-1808283213 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:52:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2051311529',display_name='tempest-VolumesGetTest-Volume-1260135946',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19778efa-493e-4dfa-beb1-5aab48755df0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5e75b8c20d74e969666dcfe5a136c77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:52:28Z,use_quota=True,user_id='e6366d137d5243fd83eef9883759cc58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:52:28 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-ac12d9d6-8986-4dd7-a1d8-a29be9d132b0 tempest-VolumesGetTest-1808283213 None] Creating volume 19778efa-493e-4dfa-beb1-5aab48755df0 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:52:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ac12d9d6-8986-4dd7-a1d8-a29be9d132b0 tempest-VolumesGetTest-1808283213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:52:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ac12d9d6-8986-4dd7-a1d8-a29be9d132b0 tempest-VolumesGetTest-1808283213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:52:28 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ac12d9d6-8986-4dd7-a1d8-a29be9d132b0 tempest-VolumesGetTest-1808283213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:52:28 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ac12d9d6-8986-4dd7-a1d8-a29be9d132b0 tempest-VolumesGetTest-1808283213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:52:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ac12d9d6-8986-4dd7-a1d8-a29be9d132b0 tempest-VolumesGetTest-1808283213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:52:28 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ac12d9d6-8986-4dd7-a1d8-a29be9d132b0 tempest-VolumesGetTest-1808283213 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:52:28 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-ac12d9d6-8986-4dd7-a1d8-a29be9d132b0 tempest-VolumesGetTest-1808283213 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:52:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ac12d9d6-8986-4dd7-a1d8-a29be9d132b0 tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-19778efa-493e-4dfa-beb1-5aab48755df0 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:28 devstack sudo[99485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-19778efa-493e-4dfa-beb1-5aab48755df0 1073741824
Nov 06 11:52:28 devstack sudo[99485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:29 devstack sudo[99485]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ac12d9d6-8986-4dd7-a1d8-a29be9d132b0 tempest-VolumesGetTest-1808283213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-19778efa-493e-4dfa-beb1-5aab48755df0 1073741824" returned: 0 in 0.614s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ac12d9d6-8986-4dd7-a1d8-a29be9d132b0 tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-19778efa-493e-4dfa-beb1-5aab48755df0 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:29 devstack sudo[99491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-19778efa-493e-4dfa-beb1-5aab48755df0
Nov 06 11:52:29 devstack sudo[99491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:29 devstack sudo[99491]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ac12d9d6-8986-4dd7-a1d8-a29be9d132b0 tempest-VolumesGetTest-1808283213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-19778efa-493e-4dfa-beb1-5aab48755df0" returned: 0 in 0.367s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:29 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ac12d9d6-8986-4dd7-a1d8-a29be9d132b0 tempest-VolumesGetTest-1808283213 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:52:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ac12d9d6-8986-4dd7-a1d8-a29be9d132b0 tempest-VolumesGetTest-1808283213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:52:29 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ac12d9d6-8986-4dd7-a1d8-a29be9d132b0 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e29b6219-3383-407d-ad66-c6e2e2916367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19778efa-493e-4dfa-beb1-5aab48755df0', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:29 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ac12d9d6-8986-4dd7-a1d8-a29be9d132b0 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc275bec-feb4-41d1-a5e7-37f1c3464176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:29 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-ac12d9d6-8986-4dd7-a1d8-a29be9d132b0 tempest-VolumesGetTest-1808283213 None] Volume volume-19778efa-493e-4dfa-beb1-5aab48755df0 (19778efa-493e-4dfa-beb1-5aab48755df0): created successfully
Nov 06 11:52:29 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ac12d9d6-8986-4dd7-a1d8-a29be9d132b0 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc275bec-feb4-41d1-a5e7-37f1c3464176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:29 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ac12d9d6-8986-4dd7-a1d8-a29be9d132b0 tempest-VolumesGetTest-1808283213 None] Flow 'volume_create_manager' (5da8db23-67c7-4d9f-aabf-68eb5c3862b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:52:29 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-ac12d9d6-8986-4dd7-a1d8-a29be9d132b0 tempest-VolumesGetTest-1808283213 None] Created volume successfully.
Nov 06 11:52:30 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9fa55e4-defa-44ca-9c9c-db4c520f2156 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:52:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b9fa55e4-defa-44ca-9c9c-db4c520f2156 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Flow 'volume_create_manager' (bd717895-f597-4d29-8ffd-a46b7ea77875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:52:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b9fa55e4-defa-44ca-9c9c-db4c520f2156 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f57d0e03-a6fb-4358-9dbc-a4e075b204f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b9fa55e4-defa-44ca-9c9c-db4c520f2156 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f57d0e03-a6fb-4358-9dbc-a4e075b204f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1901408813',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bee1741a-62cf-495e-920b-80282e895d96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88f324fb5f874e72b4abed98b65517a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:52:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:52:30Z,use_quota=True,user_id='17db557b7a2d41de96adafba4beb88b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b9fa55e4-defa-44ca-9c9c-db4c520f2156 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b823dfb5-41cf-4034-a080-d8d79beb72a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b9fa55e4-defa-44ca-9c9c-db4c520f2156 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b823dfb5-41cf-4034-a080-d8d79beb72a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b9fa55e4-defa-44ca-9c9c-db4c520f2156 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e59bea62-e533-4992-b1db-6da0955d8140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b9fa55e4-defa-44ca-9c9c-db4c520f2156 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e59bea62-e533-4992-b1db-6da0955d8140) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bee1741a-62cf-495e-920b-80282e895d96', 'volume_name': 'volume-bee1741a-62cf-495e-920b-80282e895d96', 'volume_size': 2}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b9fa55e4-defa-44ca-9c9c-db4c520f2156 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14ca39e0-cd86-4169-a118-3049e5a14ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b9fa55e4-defa-44ca-9c9c-db4c520f2156 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14ca39e0-cd86-4169-a118-3049e5a14ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b9fa55e4-defa-44ca-9c9c-db4c520f2156 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8be7e39-e646-4183-b47f-524493d7a131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:30 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-b9fa55e4-defa-44ca-9c9c-db4c520f2156 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Volume bee1741a-62cf-495e-920b-80282e895d96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bee1741a-62cf-495e-920b-80282e895d96', 'volume_size': 2}
Nov 06 11:52:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b9fa55e4-defa-44ca-9c9c-db4c520f2156 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:52:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b9fa55e4-defa-44ca-9c9c-db4c520f2156 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:52:30 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b9fa55e4-defa-44ca-9c9c-db4c520f2156 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1901408813',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bee1741a-62cf-495e-920b-80282e895d96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88f324fb5f874e72b4abed98b65517a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:52:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:52:30Z,use_quota=True,user_id='17db557b7a2d41de96adafba4beb88b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:52:30 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-b9fa55e4-defa-44ca-9c9c-db4c520f2156 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Creating volume bee1741a-62cf-495e-920b-80282e895d96 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:52:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b9fa55e4-defa-44ca-9c9c-db4c520f2156 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:52:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b9fa55e4-defa-44ca-9c9c-db4c520f2156 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:52:30 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b9fa55e4-defa-44ca-9c9c-db4c520f2156 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:52:30 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b9fa55e4-defa-44ca-9c9c-db4c520f2156 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:52:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b9fa55e4-defa-44ca-9c9c-db4c520f2156 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:52:30 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b9fa55e4-defa-44ca-9c9c-db4c520f2156 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:52:30 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-b9fa55e4-defa-44ca-9c9c-db4c520f2156 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:52:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b9fa55e4-defa-44ca-9c9c-db4c520f2156 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bee1741a-62cf-495e-920b-80282e895d96 2147483648 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:30 devstack sudo[99494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bee1741a-62cf-495e-920b-80282e895d96 2147483648
Nov 06 11:52:30 devstack sudo[99494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:30 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-790d0402-436a-4647-b0b2-bad87ddd4cec tempest-VolumesGetTest-1808283213 None] Acquiring lock "cinder-19778efa-493e-4dfa-beb1-5aab48755df0-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:52:30 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-790d0402-436a-4647-b0b2-bad87ddd4cec tempest-VolumesGetTest-1808283213 None] Lock "cinder-19778efa-493e-4dfa-beb1-5aab48755df0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:52:30 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-790d0402-436a-4647-b0b2-bad87ddd4cec tempest-VolumesGetTest-1808283213 None] Acquiring lock "cinder-quobyte-19778efa-493e-4dfa-beb1-5aab48755df0" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:52:30 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-790d0402-436a-4647-b0b2-bad87ddd4cec tempest-VolumesGetTest-1808283213 None] Lock "cinder-quobyte-19778efa-493e-4dfa-beb1-5aab48755df0" acquired by "delete_volume" :: waited 0.019s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:52:30 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5aa9878-5db9-4ad5-85b5-d954751b9194]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:52:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-790d0402-436a-4647-b0b2-bad87ddd4cec tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-19778efa-493e-4dfa-beb1-5aab48755df0 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:31 devstack sudo[99494]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b9fa55e4-defa-44ca-9c9c-db4c520f2156 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bee1741a-62cf-495e-920b-80282e895d96 2147483648" returned: 0 in 0.712s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:31 devstack sudo[99499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-19778efa-493e-4dfa-beb1-5aab48755df0
Nov 06 11:52:31 devstack sudo[99499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b9fa55e4-defa-44ca-9c9c-db4c520f2156 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bee1741a-62cf-495e-920b-80282e895d96 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:31 devstack sudo[99501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bee1741a-62cf-495e-920b-80282e895d96
Nov 06 11:52:31 devstack sudo[99501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:31 devstack sudo[99499]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-790d0402-436a-4647-b0b2-bad87ddd4cec tempest-VolumesGetTest-1808283213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-19778efa-493e-4dfa-beb1-5aab48755df0" returned: 0 in 0.493s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-790d0402-436a-4647-b0b2-bad87ddd4cec tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-19778efa-493e-4dfa-beb1-5aab48755df0 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:31 devstack sudo[99507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-19778efa-493e-4dfa-beb1-5aab48755df0
Nov 06 11:52:31 devstack sudo[99507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:31 devstack sudo[99501]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b9fa55e4-defa-44ca-9c9c-db4c520f2156 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bee1741a-62cf-495e-920b-80282e895d96" returned: 0 in 0.387s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:31 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b9fa55e4-defa-44ca-9c9c-db4c520f2156 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:52:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b9fa55e4-defa-44ca-9c9c-db4c520f2156 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:52:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b9fa55e4-defa-44ca-9c9c-db4c520f2156 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8be7e39-e646-4183-b47f-524493d7a131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bee1741a-62cf-495e-920b-80282e895d96', 'volume_size': 2}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b9fa55e4-defa-44ca-9c9c-db4c520f2156 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bff187d4-ca5b-496c-9a98-84eac92ad520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:31 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-b9fa55e4-defa-44ca-9c9c-db4c520f2156 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Volume volume-bee1741a-62cf-495e-920b-80282e895d96 (bee1741a-62cf-495e-920b-80282e895d96): created successfully
Nov 06 11:52:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b9fa55e4-defa-44ca-9c9c-db4c520f2156 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bff187d4-ca5b-496c-9a98-84eac92ad520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b9fa55e4-defa-44ca-9c9c-db4c520f2156 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Flow 'volume_create_manager' (bd717895-f597-4d29-8ffd-a46b7ea77875) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:52:31 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-b9fa55e4-defa-44ca-9c9c-db4c520f2156 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Created volume successfully.
Nov 06 11:52:31 devstack sudo[99507]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-790d0402-436a-4647-b0b2-bad87ddd4cec tempest-VolumesGetTest-1808283213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-19778efa-493e-4dfa-beb1-5aab48755df0" returned: 0 in 0.306s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:31 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-790d0402-436a-4647-b0b2-bad87ddd4cec tempest-VolumesGetTest-1808283213 None] Lock "cinder-quobyte-19778efa-493e-4dfa-beb1-5aab48755df0" released by "delete_volume" :: held 0.853s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:52:31 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-790d0402-436a-4647-b0b2-bad87ddd4cec tempest-VolumesGetTest-1808283213 None] Created reservations ['83d8859e-3b4f-40ca-902a-955a3e4b7896', '88606bc0-718e-41b8-b3d6-d0d269ce8433', '8d7ce338-8ed1-4ff2-81b8-5c7685cd94b9', '94b16d3c-c6d5-4f58-8f4f-bff07268cbb1'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:52:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-790d0402-436a-4647-b0b2-bad87ddd4cec tempest-VolumesGetTest-1808283213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:52:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-790d0402-436a-4647-b0b2-bad87ddd4cec tempest-VolumesGetTest-1808283213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:52:31 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-790d0402-436a-4647-b0b2-bad87ddd4cec tempest-VolumesGetTest-1808283213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:52:31 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-790d0402-436a-4647-b0b2-bad87ddd4cec tempest-VolumesGetTest-1808283213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:52:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-790d0402-436a-4647-b0b2-bad87ddd4cec tempest-VolumesGetTest-1808283213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:52:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-790d0402-436a-4647-b0b2-bad87ddd4cec tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:31 devstack sudo[99511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:52:31 devstack sudo[99511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:32 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-283112bd-1db1-4eb2-820d-0ce6f9512c4e tempest-VolumesGetTest-1808283213 None] Acquiring lock "cinder-05d6a9dd-48a8-4edb-b43e-abaedbb0368d-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:52:32 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-283112bd-1db1-4eb2-820d-0ce6f9512c4e tempest-VolumesGetTest-1808283213 None] Lock "cinder-05d6a9dd-48a8-4edb-b43e-abaedbb0368d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:52:32 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-283112bd-1db1-4eb2-820d-0ce6f9512c4e tempest-VolumesGetTest-1808283213 None] Acquiring lock "cinder-quobyte-05d6a9dd-48a8-4edb-b43e-abaedbb0368d" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:52:32 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-283112bd-1db1-4eb2-820d-0ce6f9512c4e tempest-VolumesGetTest-1808283213 None] Lock "cinder-quobyte-05d6a9dd-48a8-4edb-b43e-abaedbb0368d" acquired by "delete_volume" :: waited 0.036s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:52:32 devstack sudo[99511]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-790d0402-436a-4647-b0b2-bad87ddd4cec tempest-VolumesGetTest-1808283213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.453s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:32 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-790d0402-436a-4647-b0b2-bad87ddd4cec tempest-VolumesGetTest-1808283213 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:52:32 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-790d0402-436a-4647-b0b2-bad87ddd4cec tempest-VolumesGetTest-1808283213 None] Deleted volume successfully.
Nov 06 11:52:32 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9f1048-1222-46a1-ba24-6245649b1d1f]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:52:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-283112bd-1db1-4eb2-820d-0ce6f9512c4e tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-05d6a9dd-48a8-4edb-b43e-abaedbb0368d {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:32 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-790d0402-436a-4647-b0b2-bad87ddd4cec tempest-VolumesGetTest-1808283213 None] Lock "cinder-19778efa-493e-4dfa-beb1-5aab48755df0-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:52:32 devstack sudo[99514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-05d6a9dd-48a8-4edb-b43e-abaedbb0368d
Nov 06 11:52:32 devstack sudo[99514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-635440ca-a5d0-4dec-9a78-8bec97f34235 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:52:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-635440ca-a5d0-4dec-9a78-8bec97f34235 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:52:32 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-635440ca-a5d0-4dec-9a78-8bec97f34235 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Creating offline snapshot 1ed8c7c4-7fbd-4e91-b3a9-17dcf67ab156 of volume bee1741a-62cf-495e-920b-80282e895d96 {{(pid=87165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 11:52:32 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be5963d-2925-4a75-849a-5b1e0eaa0d8f]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:52:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-635440ca-a5d0-4dec-9a78-8bec97f34235 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bee1741a-62cf-495e-920b-80282e895d96 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:32 devstack sudo[99514]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-283112bd-1db1-4eb2-820d-0ce6f9512c4e tempest-VolumesGetTest-1808283213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-05d6a9dd-48a8-4edb-b43e-abaedbb0368d" returned: 0 in 0.582s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-283112bd-1db1-4eb2-820d-0ce6f9512c4e tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-05d6a9dd-48a8-4edb-b43e-abaedbb0368d {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:33 devstack sudo[99516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bee1741a-62cf-495e-920b-80282e895d96
Nov 06 11:52:33 devstack sudo[99516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:33 devstack sudo[99520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-05d6a9dd-48a8-4edb-b43e-abaedbb0368d
Nov 06 11:52:33 devstack sudo[99520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:33 devstack sudo[99520]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-283112bd-1db1-4eb2-820d-0ce6f9512c4e tempest-VolumesGetTest-1808283213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-05d6a9dd-48a8-4edb-b43e-abaedbb0368d" returned: 0 in 0.285s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:33 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-283112bd-1db1-4eb2-820d-0ce6f9512c4e tempest-VolumesGetTest-1808283213 None] Lock "cinder-quobyte-05d6a9dd-48a8-4edb-b43e-abaedbb0368d" released by "delete_volume" :: held 0.973s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:52:33 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-283112bd-1db1-4eb2-820d-0ce6f9512c4e tempest-VolumesGetTest-1808283213 None] Created reservations ['28f9add2-204f-49ff-a960-2299edeab2ea', 'de6bb227-d54c-4c72-8622-6d89468d9fde', 'a71c4000-1baf-4b35-96f8-078d682c12f5', '54d36c87-83bd-4c9c-99ca-76dc2f9f2f76'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:52:33 devstack sudo[99516]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-635440ca-a5d0-4dec-9a78-8bec97f34235 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bee1741a-62cf-495e-920b-80282e895d96" returned: 0 in 0.610s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-635440ca-a5d0-4dec-9a78-8bec97f34235 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bee1741a-62cf-495e-920b-80282e895d96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bee1741a-62cf-495e-920b-80282e895d96.1ed8c7c4-7fbd-4e91-b3a9-17dcf67ab156 2G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:33 devstack sudo[99527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bee1741a-62cf-495e-920b-80282e895d96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bee1741a-62cf-495e-920b-80282e895d96.1ed8c7c4-7fbd-4e91-b3a9-17dcf67ab156 2G
Nov 06 11:52:33 devstack sudo[99527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-283112bd-1db1-4eb2-820d-0ce6f9512c4e tempest-VolumesGetTest-1808283213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:52:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-283112bd-1db1-4eb2-820d-0ce6f9512c4e tempest-VolumesGetTest-1808283213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:52:33 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-283112bd-1db1-4eb2-820d-0ce6f9512c4e tempest-VolumesGetTest-1808283213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:52:33 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-283112bd-1db1-4eb2-820d-0ce6f9512c4e tempest-VolumesGetTest-1808283213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:52:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-283112bd-1db1-4eb2-820d-0ce6f9512c4e tempest-VolumesGetTest-1808283213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:52:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-283112bd-1db1-4eb2-820d-0ce6f9512c4e tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:33 devstack sudo[99529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:52:33 devstack sudo[99529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:33 devstack sudo[99529]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-283112bd-1db1-4eb2-820d-0ce6f9512c4e tempest-VolumesGetTest-1808283213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.422s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:33 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-283112bd-1db1-4eb2-820d-0ce6f9512c4e tempest-VolumesGetTest-1808283213 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:52:33 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-283112bd-1db1-4eb2-820d-0ce6f9512c4e tempest-VolumesGetTest-1808283213 None] Deleted volume successfully.
Nov 06 11:52:33 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-283112bd-1db1-4eb2-820d-0ce6f9512c4e tempest-VolumesGetTest-1808283213 None] Lock "cinder-05d6a9dd-48a8-4edb-b43e-abaedbb0368d-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:52:33 devstack sudo[99527]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-635440ca-a5d0-4dec-9a78-8bec97f34235 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bee1741a-62cf-495e-920b-80282e895d96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bee1741a-62cf-495e-920b-80282e895d96.1ed8c7c4-7fbd-4e91-b3a9-17dcf67ab156 2G" returned: 0 in 0.558s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-635440ca-a5d0-4dec-9a78-8bec97f34235 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bee1741a-62cf-495e-920b-80282e895d96 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bee1741a-62cf-495e-920b-80282e895d96.1ed8c7c4-7fbd-4e91-b3a9-17dcf67ab156 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:34 devstack sudo[99536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bee1741a-62cf-495e-920b-80282e895d96 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bee1741a-62cf-495e-920b-80282e895d96.1ed8c7c4-7fbd-4e91-b3a9-17dcf67ab156
Nov 06 11:52:34 devstack sudo[99536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:34 devstack sudo[99536]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-635440ca-a5d0-4dec-9a78-8bec97f34235 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bee1741a-62cf-495e-920b-80282e895d96 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bee1741a-62cf-495e-920b-80282e895d96.1ed8c7c4-7fbd-4e91-b3a9-17dcf67ab156" returned: 0 in 0.324s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:34 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-635440ca-a5d0-4dec-9a78-8bec97f34235 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bee1741a-62cf-495e-920b-80282e895d96.1ed8c7c4-7fbd-4e91-b3a9-17dcf67ab156 is being set with open permissions: ugo+rw
Nov 06 11:52:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-635440ca-a5d0-4dec-9a78-8bec97f34235 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bee1741a-62cf-495e-920b-80282e895d96.1ed8c7c4-7fbd-4e91-b3a9-17dcf67ab156 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:34 devstack sudo[99563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bee1741a-62cf-495e-920b-80282e895d96.1ed8c7c4-7fbd-4e91-b3a9-17dcf67ab156
Nov 06 11:52:34 devstack sudo[99563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:34 devstack sudo[99563]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-635440ca-a5d0-4dec-9a78-8bec97f34235 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bee1741a-62cf-495e-920b-80282e895d96.1ed8c7c4-7fbd-4e91-b3a9-17dcf67ab156" returned: 0 in 0.256s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-635440ca-a5d0-4dec-9a78-8bec97f34235 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bee1741a-62cf-495e-920b-80282e895d96.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:34 devstack sudo[99567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bee1741a-62cf-495e-920b-80282e895d96.info
Nov 06 11:52:34 devstack sudo[99567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:34 devstack sudo[99567]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-635440ca-a5d0-4dec-9a78-8bec97f34235 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bee1741a-62cf-495e-920b-80282e895d96.info" returned: 0 in 0.326s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:34 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-635440ca-a5d0-4dec-9a78-8bec97f34235 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bee1741a-62cf-495e-920b-80282e895d96.info is being set with open permissions: ugo+rw
Nov 06 11:52:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-635440ca-a5d0-4dec-9a78-8bec97f34235 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bee1741a-62cf-495e-920b-80282e895d96.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:34 devstack sudo[99570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bee1741a-62cf-495e-920b-80282e895d96.info
Nov 06 11:52:34 devstack sudo[99570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:35 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-d577f478-fc7c-440d-acc7-23809be266a0 tempest-VolumesGetTest-1808283213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:52:35 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d577f478-fc7c-440d-acc7-23809be266a0 tempest-VolumesGetTest-1808283213 None] Flow 'volume_create_manager' (1b335436-e4d9-4a15-92f9-78e3234a0324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:52:35 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d577f478-fc7c-440d-acc7-23809be266a0 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b195ee64-80c9-4f02-96e7-da6c4c7a09b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:35 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d577f478-fc7c-440d-acc7-23809be266a0 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b195ee64-80c9-4f02-96e7-da6c4c7a09b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1946854017',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f922761-7e56-494e-8ea1-e9793020e038,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5e75b8c20d74e969666dcfe5a136c77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:52:35Z,use_quota=True,user_id='e6366d137d5243fd83eef9883759cc58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:35 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d577f478-fc7c-440d-acc7-23809be266a0 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4748a055-42f6-4aa9-a4ae-fb6b17079dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:35 devstack sudo[99570]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:35 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d577f478-fc7c-440d-acc7-23809be266a0 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4748a055-42f6-4aa9-a4ae-fb6b17079dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:35 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d577f478-fc7c-440d-acc7-23809be266a0 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22d12c90-0825-44b9-96ef-fea79aa9a62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:35 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d577f478-fc7c-440d-acc7-23809be266a0 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22d12c90-0825-44b9-96ef-fea79aa9a62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f922761-7e56-494e-8ea1-e9793020e038', 'volume_name': 'volume-5f922761-7e56-494e-8ea1-e9793020e038', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:35 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d577f478-fc7c-440d-acc7-23809be266a0 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21c10ef2-226d-4bf3-9d93-bc813003601f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:35 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d577f478-fc7c-440d-acc7-23809be266a0 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21c10ef2-226d-4bf3-9d93-bc813003601f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:35 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d577f478-fc7c-440d-acc7-23809be266a0 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91d6a8ab-cbc6-4dfc-9892-74ecae6fe41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:35 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-d577f478-fc7c-440d-acc7-23809be266a0 tempest-VolumesGetTest-1808283213 None] Volume 5f922761-7e56-494e-8ea1-e9793020e038: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f922761-7e56-494e-8ea1-e9793020e038', 'volume_size': 1}
Nov 06 11:52:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d577f478-fc7c-440d-acc7-23809be266a0 tempest-VolumesGetTest-1808283213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:52:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-635440ca-a5d0-4dec-9a78-8bec97f34235 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bee1741a-62cf-495e-920b-80282e895d96.info" returned: 0 in 0.310s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-635440ca-a5d0-4dec-9a78-8bec97f34235 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.513s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:52:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d577f478-fc7c-440d-acc7-23809be266a0 tempest-VolumesGetTest-1808283213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.028s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:52:35 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-d577f478-fc7c-440d-acc7-23809be266a0 tempest-VolumesGetTest-1808283213 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1946854017',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f922761-7e56-494e-8ea1-e9793020e038,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5e75b8c20d74e969666dcfe5a136c77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:52:35Z,use_quota=True,user_id='e6366d137d5243fd83eef9883759cc58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:52:35 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-d577f478-fc7c-440d-acc7-23809be266a0 tempest-VolumesGetTest-1808283213 None] Creating volume 5f922761-7e56-494e-8ea1-e9793020e038 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:52:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d577f478-fc7c-440d-acc7-23809be266a0 tempest-VolumesGetTest-1808283213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:52:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d577f478-fc7c-440d-acc7-23809be266a0 tempest-VolumesGetTest-1808283213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:52:35 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-d577f478-fc7c-440d-acc7-23809be266a0 tempest-VolumesGetTest-1808283213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:52:35 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-d577f478-fc7c-440d-acc7-23809be266a0 tempest-VolumesGetTest-1808283213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:52:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d577f478-fc7c-440d-acc7-23809be266a0 tempest-VolumesGetTest-1808283213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:52:35 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-d577f478-fc7c-440d-acc7-23809be266a0 tempest-VolumesGetTest-1808283213 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:52:35 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-d577f478-fc7c-440d-acc7-23809be266a0 tempest-VolumesGetTest-1808283213 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:52:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d577f478-fc7c-440d-acc7-23809be266a0 tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:35 devstack sudo[99573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038 1073741824
Nov 06 11:52:35 devstack sudo[99573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:35 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-635440ca-a5d0-4dec-9a78-8bec97f34235 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Create snapshot completed successfully
Nov 06 11:52:35 devstack sudo[99573]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d577f478-fc7c-440d-acc7-23809be266a0 tempest-VolumesGetTest-1808283213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038 1073741824" returned: 0 in 0.462s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d577f478-fc7c-440d-acc7-23809be266a0 tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:35 devstack sudo[99599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038
Nov 06 11:52:35 devstack sudo[99599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:36 devstack sudo[99599]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d577f478-fc7c-440d-acc7-23809be266a0 tempest-VolumesGetTest-1808283213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038" returned: 0 in 0.266s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:36 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-d577f478-fc7c-440d-acc7-23809be266a0 tempest-VolumesGetTest-1808283213 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:52:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d577f478-fc7c-440d-acc7-23809be266a0 tempest-VolumesGetTest-1808283213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:52:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d577f478-fc7c-440d-acc7-23809be266a0 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91d6a8ab-cbc6-4dfc-9892-74ecae6fe41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f922761-7e56-494e-8ea1-e9793020e038', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d577f478-fc7c-440d-acc7-23809be266a0 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3061de7e-1ace-4dde-a7fe-9ecc1e8d8ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:36 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-d577f478-fc7c-440d-acc7-23809be266a0 tempest-VolumesGetTest-1808283213 None] Volume volume-5f922761-7e56-494e-8ea1-e9793020e038 (5f922761-7e56-494e-8ea1-e9793020e038): created successfully
Nov 06 11:52:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d577f478-fc7c-440d-acc7-23809be266a0 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3061de7e-1ace-4dde-a7fe-9ecc1e8d8ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d577f478-fc7c-440d-acc7-23809be266a0 tempest-VolumesGetTest-1808283213 None] Flow 'volume_create_manager' (1b335436-e4d9-4a15-92f9-78e3234a0324) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:52:36 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-d577f478-fc7c-440d-acc7-23809be266a0 tempest-VolumesGetTest-1808283213 None] Created volume successfully.
Nov 06 11:52:36 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-3d94399a-1f4a-42c4-95d3-f422dc3113d1 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Acquiring lock "cinder-1ed8c7c4-7fbd-4e91-b3a9-17dcf67ab156-delete_snapshot" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:52:36 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-3d94399a-1f4a-42c4-95d3-f422dc3113d1 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Lock "cinder-1ed8c7c4-7fbd-4e91-b3a9-17dcf67ab156-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:52:36 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-3d94399a-1f4a-42c4-95d3-f422dc3113d1 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Acquiring lock "cinder-quobyte-bee1741a-62cf-495e-920b-80282e895d96" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:52:36 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-3d94399a-1f4a-42c4-95d3-f422dc3113d1 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Lock "cinder-quobyte-bee1741a-62cf-495e-920b-80282e895d96" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:52:36 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-3d94399a-1f4a-42c4-95d3-f422dc3113d1 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Acquiring lock "cinder-quobyte-1ed8c7c4-7fbd-4e91-b3a9-17dcf67ab156" by "_delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:52:36 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-3d94399a-1f4a-42c4-95d3-f422dc3113d1 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Lock "cinder-quobyte-1ed8c7c4-7fbd-4e91-b3a9-17dcf67ab156" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:52:36 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-3d94399a-1f4a-42c4-95d3-f422dc3113d1 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Deleting offline snapshot 1ed8c7c4-7fbd-4e91-b3a9-17dcf67ab156 of volume bee1741a-62cf-495e-920b-80282e895d96 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 11:52:36 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-3d94399a-1f4a-42c4-95d3-f422dc3113d1 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] snapshot_file for this snap is: volume-bee1741a-62cf-495e-920b-80282e895d96.1ed8c7c4-7fbd-4e91-b3a9-17dcf67ab156 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 11:52:36 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[289f962c-7e9f-4a80-b65e-28406cac0d3b]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:52:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3d94399a-1f4a-42c4-95d3-f422dc3113d1 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bee1741a-62cf-495e-920b-80282e895d96.1ed8c7c4-7fbd-4e91-b3a9-17dcf67ab156 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:36 devstack sudo[99602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bee1741a-62cf-495e-920b-80282e895d96.1ed8c7c4-7fbd-4e91-b3a9-17dcf67ab156
Nov 06 11:52:36 devstack sudo[99602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:36 devstack sudo[99602]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3d94399a-1f4a-42c4-95d3-f422dc3113d1 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bee1741a-62cf-495e-920b-80282e895d96.1ed8c7c4-7fbd-4e91-b3a9-17dcf67ab156" returned: 0 in 0.405s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:36 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-3d94399a-1f4a-42c4-95d3-f422dc3113d1 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bee1741a-62cf-495e-920b-80282e895d96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:52:36 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae596463-c194-4431-805f-79bf9f9fed34]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:52:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3d94399a-1f4a-42c4-95d3-f422dc3113d1 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bee1741a-62cf-495e-920b-80282e895d96 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:36 devstack sudo[99607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bee1741a-62cf-495e-920b-80282e895d96
Nov 06 11:52:36 devstack sudo[99607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:37 devstack sudo[99607]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3d94399a-1f4a-42c4-95d3-f422dc3113d1 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bee1741a-62cf-495e-920b-80282e895d96" returned: 0 in 0.369s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3d94399a-1f4a-42c4-95d3-f422dc3113d1 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bee1741a-62cf-495e-920b-80282e895d96.1ed8c7c4-7fbd-4e91-b3a9-17dcf67ab156 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:37 devstack sudo[99612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bee1741a-62cf-495e-920b-80282e895d96.1ed8c7c4-7fbd-4e91-b3a9-17dcf67ab156
Nov 06 11:52:37 devstack sudo[99612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:37 devstack sudo[99612]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3d94399a-1f4a-42c4-95d3-f422dc3113d1 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bee1741a-62cf-495e-920b-80282e895d96.1ed8c7c4-7fbd-4e91-b3a9-17dcf67ab156" returned: 0 in 0.345s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3d94399a-1f4a-42c4-95d3-f422dc3113d1 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bee1741a-62cf-495e-920b-80282e895d96.1ed8c7c4-7fbd-4e91-b3a9-17dcf67ab156 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:37 devstack sudo[99618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bee1741a-62cf-495e-920b-80282e895d96.1ed8c7c4-7fbd-4e91-b3a9-17dcf67ab156
Nov 06 11:52:37 devstack sudo[99618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:37 devstack sudo[99618]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3d94399a-1f4a-42c4-95d3-f422dc3113d1 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bee1741a-62cf-495e-920b-80282e895d96.1ed8c7c4-7fbd-4e91-b3a9-17dcf67ab156" returned: 0 in 0.270s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:37 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-3d94399a-1f4a-42c4-95d3-f422dc3113d1 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Lock "cinder-quobyte-1ed8c7c4-7fbd-4e91-b3a9-17dcf67ab156" released by "_delete_snapshot" :: held 1.503s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:52:37 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-3d94399a-1f4a-42c4-95d3-f422dc3113d1 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Lock "cinder-quobyte-bee1741a-62cf-495e-920b-80282e895d96" released by "delete_snapshot" :: held 1.527s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:52:37 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:52:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Flow 'volume_create_manager' (ece03d94-c4ab-4368-92c8-03ee19bf401b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:52:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7898115-27f7-4709-960d-5e4e9ec7654e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7898115-27f7-4709-960d-5e4e9ec7654e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1839247287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6d93bc7-cddb-42c3-99e1-ee7d00485c82,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b5e75b8c20d74e969666dcfe5a136c77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=5f922761-7e56-494e-8ea1-e9793020e038,status='creating',terminated_at=None,updated_at=2026-11-06T10:52:38Z,use_quota=True,user_id='e6366d137d5243fd83eef9883759cc58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (691198a1-d8af-49c3-9d4b-e0af11ddb6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (691198a1-d8af-49c3-9d4b-e0af11ddb6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a00335a5-14b7-4579-a782-d2629b3c7a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:37 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-3d94399a-1f4a-42c4-95d3-f422dc3113d1 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Created reservations ['3af6a644-fcc4-4d1b-8b94-67a26da97f3c', '8e0b0fbf-b5b8-4675-9518-143045221de0', '6a6e1280-689a-4726-8edd-ff6e5c4feac9', '3599603a-3f61-4331-8439-1d5cd4a5a3cb'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:52:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a00335a5-14b7-4579-a782-d2629b3c7a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b6d93bc7-cddb-42c3-99e1-ee7d00485c82', 'volume_name': 'volume-b6d93bc7-cddb-42c3-99e1-ee7d00485c82', 'volume_size': 1, 'source_volid': '5f922761-7e56-494e-8ea1-e9793020e038', 'source_volstatus': 'available'}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e526d703-633c-4e16-9a2c-49cff0c97ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e526d703-633c-4e16-9a2c-49cff0c97ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0596effe-f328-4a9b-a3b6-a6c9933143f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:37 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Volume b6d93bc7-cddb-42c3-99e1-ee7d00485c82: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b6d93bc7-cddb-42c3-99e1-ee7d00485c82', 'volume_size': 1, 'source_volid': '5f922761-7e56-494e-8ea1-e9793020e038', 'source_volstatus': 'available'}
Nov 06 11:52:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:52:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:52:37 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Cloning volume 5f922761-7e56-494e-8ea1-e9793020e038 to volume b6d93bc7-cddb-42c3-99e1-ee7d00485c82
Nov 06 11:52:37 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Creating offline snapshot 7fd198ac-fdd2-44b9-9252-02f3371831f8 of volume 5f922761-7e56-494e-8ea1-e9793020e038 {{(pid=87165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 11:52:37 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b641b1-2f48-4766-a848-1b75b314ffa0]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:52:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:38 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-3d94399a-1f4a-42c4-95d3-f422dc3113d1 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Delete snapshot completed successfully.
Nov 06 11:52:38 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-3d94399a-1f4a-42c4-95d3-f422dc3113d1 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Lock "cinder-1ed8c7c4-7fbd-4e91-b3a9-17dcf67ab156-delete_snapshot" released by "delete_snapshot" :: held 1.814s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:52:38 devstack sudo[99621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038
Nov 06 11:52:38 devstack sudo[99621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:38 devstack sudo[99621]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038" returned: 0 in 0.375s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038.7fd198ac-fdd2-44b9-9252-02f3371831f8 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:38 devstack sudo[99627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038.7fd198ac-fdd2-44b9-9252-02f3371831f8 1G
Nov 06 11:52:38 devstack sudo[99627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:38 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c51f6989-e3aa-4eb2-aad2-77958b3734b9 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Acquiring lock "cinder-bee1741a-62cf-495e-920b-80282e895d96-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:52:38 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c51f6989-e3aa-4eb2-aad2-77958b3734b9 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Lock "cinder-bee1741a-62cf-495e-920b-80282e895d96-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:52:38 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c51f6989-e3aa-4eb2-aad2-77958b3734b9 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Acquiring lock "cinder-quobyte-bee1741a-62cf-495e-920b-80282e895d96" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:52:38 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c51f6989-e3aa-4eb2-aad2-77958b3734b9 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Lock "cinder-quobyte-bee1741a-62cf-495e-920b-80282e895d96" acquired by "delete_volume" :: waited 0.017s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:52:38 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4970b3fa-ca04-4460-8365-abde14c735ab]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:52:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c51f6989-e3aa-4eb2-aad2-77958b3734b9 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bee1741a-62cf-495e-920b-80282e895d96 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:38 devstack sudo[99629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bee1741a-62cf-495e-920b-80282e895d96
Nov 06 11:52:38 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:38 devstack sudo[99627]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038.7fd198ac-fdd2-44b9-9252-02f3371831f8 1G" returned: 0 in 0.507s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f922761-7e56-494e-8ea1-e9793020e038 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038.7fd198ac-fdd2-44b9-9252-02f3371831f8 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:38 devstack sudo[99639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f922761-7e56-494e-8ea1-e9793020e038 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038.7fd198ac-fdd2-44b9-9252-02f3371831f8
Nov 06 11:52:38 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:39 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c51f6989-e3aa-4eb2-aad2-77958b3734b9 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bee1741a-62cf-495e-920b-80282e895d96" returned: 0 in 0.501s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c51f6989-e3aa-4eb2-aad2-77958b3734b9 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bee1741a-62cf-495e-920b-80282e895d96 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:39 devstack sudo[99644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bee1741a-62cf-495e-920b-80282e895d96
Nov 06 11:52:39 devstack sudo[99644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:39 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f922761-7e56-494e-8ea1-e9793020e038 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038.7fd198ac-fdd2-44b9-9252-02f3371831f8" returned: 0 in 0.349s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:39 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038.7fd198ac-fdd2-44b9-9252-02f3371831f8 is being set with open permissions: ugo+rw
Nov 06 11:52:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038.7fd198ac-fdd2-44b9-9252-02f3371831f8 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:39 devstack sudo[99649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038.7fd198ac-fdd2-44b9-9252-02f3371831f8
Nov 06 11:52:39 devstack sudo[99649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:39 devstack sudo[99644]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c51f6989-e3aa-4eb2-aad2-77958b3734b9 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bee1741a-62cf-495e-920b-80282e895d96" returned: 0 in 0.259s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:39 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c51f6989-e3aa-4eb2-aad2-77958b3734b9 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Lock "cinder-quobyte-bee1741a-62cf-495e-920b-80282e895d96" released by "delete_volume" :: held 0.840s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:52:39 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-c51f6989-e3aa-4eb2-aad2-77958b3734b9 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Created reservations ['bfa8c3ce-f792-44d3-804e-32672d58937c', 'c55a73a6-9eaa-4e82-b9a5-1c6d45b0dcae', '4cf19ad0-7e47-455b-a5ee-2815dd6ae305', '06cdb8de-c471-44e4-a9c5-526145da3e3c'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:52:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c51f6989-e3aa-4eb2-aad2-77958b3734b9 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:52:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c51f6989-e3aa-4eb2-aad2-77958b3734b9 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:52:39 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-c51f6989-e3aa-4eb2-aad2-77958b3734b9 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:52:39 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-c51f6989-e3aa-4eb2-aad2-77958b3734b9 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:52:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c51f6989-e3aa-4eb2-aad2-77958b3734b9 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:52:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c51f6989-e3aa-4eb2-aad2-77958b3734b9 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:39 devstack sudo[99649]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038.7fd198ac-fdd2-44b9-9252-02f3371831f8" returned: 0 in 0.273s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:39 devstack sudo[99653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:52:39 devstack sudo[99653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:39 devstack sudo[99655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038.info
Nov 06 11:52:39 devstack sudo[99655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:39 devstack sudo[99653]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c51f6989-e3aa-4eb2-aad2-77958b3734b9 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.262s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:39 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-c51f6989-e3aa-4eb2-aad2-77958b3734b9 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:52:39 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-c51f6989-e3aa-4eb2-aad2-77958b3734b9 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Deleted volume successfully.
Nov 06 11:52:39 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c51f6989-e3aa-4eb2-aad2-77958b3734b9 tempest-VolumesSnapshotNegativeTestJSON-380295166 None] Lock "cinder-bee1741a-62cf-495e-920b-80282e895d96-delete_volume" released by "delete_volume" :: held 1.357s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:52:39 devstack sudo[99655]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038.info" returned: 0 in 0.308s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:39 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038.info is being set with open permissions: ugo+rw
Nov 06 11:52:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:39 devstack sudo[99659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038.info
Nov 06 11:52:39 devstack sudo[99659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:40 devstack sudo[99659]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038.info" returned: 0 in 0.294s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:40 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Acquiring lock "cinder-quobyte-b6d93bc7-cddb-42c3-99e1-ee7d00485c82" by "_copy_volume_from_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:52:40 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Lock "cinder-quobyte-b6d93bc7-cddb-42c3-99e1-ee7d00485c82" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:52:40 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] snapshot: 7fd198ac-fdd2-44b9-9252-02f3371831f8, volume: b6d93bc7-cddb-42c3-99e1-ee7d00485c82,  {{(pid=87165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 06 11:52:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:52:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:52:40 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:52:40 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:52:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:52:40 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ce0597-1713-4bb9-a91c-e4d745bb90ca]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:52:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038.7fd198ac-fdd2-44b9-9252-02f3371831f8 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:40 devstack sudo[99662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038.7fd198ac-fdd2-44b9-9252-02f3371831f8
Nov 06 11:52:40 devstack sudo[99662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:40 devstack sudo[99662]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038.7fd198ac-fdd2-44b9-9252-02f3371831f8" returned: 0 in 0.422s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:40 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f922761-7e56-494e-8ea1-e9793020e038(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:52:40 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0ed0ea-e036-4048-8514-4607d528c162]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:52:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:40 devstack sudo[99668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038
Nov 06 11:52:40 devstack sudo[99668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:41 devstack sudo[99668]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038" returned: 0 in 0.437s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:41 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038 {{(pid=87165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 06 11:52:41 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Creating direct copy from snapshot {{(pid=87165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 06 11:52:41 devstack cinder-volume[87165]: DEBUG cinder.utils [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Path /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b6d93bc7-cddb-42c3-99e1-ee7d00485c82 not found in is_blk_device check {{(pid=87165) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 06 11:52:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b6d93bc7-cddb-42c3-99e1-ee7d00485c82 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:41 devstack sudo[99674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b6d93bc7-cddb-42c3-99e1-ee7d00485c82
Nov 06 11:52:41 devstack sudo[99674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:46 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:SELECT=87,cinder:UPDATE=93,cinder:DELETE=10,cinder:INSERT=25 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 11:52:46 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:UPDATE=106,cinder:SELECT=89,cinder:INSERT=26,cinder:DELETE=7 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 11:52:46 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc1e762f-8d16-4c84-bb6a-aedd58ca8cd1 tempest-AttachVolumeTestJSON-784394024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:52:46 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-bc1e762f-8d16-4c84-bb6a-aedd58ca8cd1 tempest-AttachVolumeTestJSON-784394024 None] Flow 'volume_create_manager' (2151cbc8-b1b7-4a26-8910-fb33aaf98823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:52:46 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-bc1e762f-8d16-4c84-bb6a-aedd58ca8cd1 tempest-AttachVolumeTestJSON-784394024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bc6f6f5-8676-41b0-8e8a-fcf8d3d102ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:46 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-bc1e762f-8d16-4c84-bb6a-aedd58ca8cd1 tempest-AttachVolumeTestJSON-784394024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bc6f6f5-8676-41b0-8e8a-fcf8d3d102ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1860224713',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41733ab2-68a3-4297-90d9-26c8ae688cc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c8c96fbf20e4dbe93f206aae0052c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:52:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:52:46Z,use_quota=True,user_id='a68744c6220f4aa58b94e599665d1df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:46 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-bc1e762f-8d16-4c84-bb6a-aedd58ca8cd1 tempest-AttachVolumeTestJSON-784394024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de29641c-86e7-4220-9264-da8d689934b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:46 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-bc1e762f-8d16-4c84-bb6a-aedd58ca8cd1 tempest-AttachVolumeTestJSON-784394024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de29641c-86e7-4220-9264-da8d689934b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:46 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-bc1e762f-8d16-4c84-bb6a-aedd58ca8cd1 tempest-AttachVolumeTestJSON-784394024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (523870a0-8c10-40b0-92ad-6789aee404c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:46 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-bc1e762f-8d16-4c84-bb6a-aedd58ca8cd1 tempest-AttachVolumeTestJSON-784394024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (523870a0-8c10-40b0-92ad-6789aee404c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41733ab2-68a3-4297-90d9-26c8ae688cc0', 'volume_name': 'volume-41733ab2-68a3-4297-90d9-26c8ae688cc0', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:46 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-bc1e762f-8d16-4c84-bb6a-aedd58ca8cd1 tempest-AttachVolumeTestJSON-784394024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94e6a02d-9156-494d-baac-9b66cee26c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:46 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-bc1e762f-8d16-4c84-bb6a-aedd58ca8cd1 tempest-AttachVolumeTestJSON-784394024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94e6a02d-9156-494d-baac-9b66cee26c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:46 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-bc1e762f-8d16-4c84-bb6a-aedd58ca8cd1 tempest-AttachVolumeTestJSON-784394024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16e4f107-34a7-46d2-8a2a-08f3b0c89e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:46 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-bc1e762f-8d16-4c84-bb6a-aedd58ca8cd1 tempest-AttachVolumeTestJSON-784394024 None] Volume 41733ab2-68a3-4297-90d9-26c8ae688cc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41733ab2-68a3-4297-90d9-26c8ae688cc0', 'volume_size': 1}
Nov 06 11:52:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-bc1e762f-8d16-4c84-bb6a-aedd58ca8cd1 tempest-AttachVolumeTestJSON-784394024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:52:49 devstack sudo[99674]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b6d93bc7-cddb-42c3-99e1-ee7d00485c82" returned: 0 in 8.478s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:49 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Image conversion details: src /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038, size 1024.00 MB, duration 8.48 sec, destination /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b6d93bc7-cddb-42c3-99e1-ee7d00485c82 {{(pid=87165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 11:52:49 devstack cinder-volume[87165]: INFO cinder.image.image_utils [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Converted 1024.00 MB image at 120.77 MB/s
Nov 06 11:52:49 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b6d93bc7-cddb-42c3-99e1-ee7d00485c82 is being set with open permissions: ugo+rw
Nov 06 11:52:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b6d93bc7-cddb-42c3-99e1-ee7d00485c82 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:49 devstack sudo[99693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b6d93bc7-cddb-42c3-99e1-ee7d00485c82
Nov 06 11:52:49 devstack sudo[99693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:49 devstack sudo[99693]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b6d93bc7-cddb-42c3-99e1-ee7d00485c82" returned: 0 in 0.242s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:49 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Lock "cinder-quobyte-b6d93bc7-cddb-42c3-99e1-ee7d00485c82" released by "_copy_volume_from_snapshot" :: held 9.679s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:52:49 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Acquiring lock "cinder-quobyte-7fd198ac-fdd2-44b9-9252-02f3371831f8" by "_delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:52:49 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Lock "cinder-quobyte-7fd198ac-fdd2-44b9-9252-02f3371831f8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:52:49 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Deleting offline snapshot 7fd198ac-fdd2-44b9-9252-02f3371831f8 of volume 5f922761-7e56-494e-8ea1-e9793020e038 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 11:52:49 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] snapshot_file for this snap is: volume-5f922761-7e56-494e-8ea1-e9793020e038.7fd198ac-fdd2-44b9-9252-02f3371831f8 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 11:52:49 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d3be03-ad04-40db-a091-4cc980d3ae9c]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:52:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038.7fd198ac-fdd2-44b9-9252-02f3371831f8 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:50 devstack sudo[99696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038.7fd198ac-fdd2-44b9-9252-02f3371831f8
Nov 06 11:52:50 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:50 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038.7fd198ac-fdd2-44b9-9252-02f3371831f8" returned: 0 in 0.382s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:50 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f922761-7e56-494e-8ea1-e9793020e038(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:52:50 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f27728-b182-484b-8d8c-cb036b694423]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:52:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:50 devstack sudo[99702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038
Nov 06 11:52:50 devstack sudo[99702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:50 devstack sudo[99702]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038" returned: 0 in 0.640s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038.7fd198ac-fdd2-44b9-9252-02f3371831f8 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:51 devstack sudo[99707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038.7fd198ac-fdd2-44b9-9252-02f3371831f8
Nov 06 11:52:51 devstack sudo[99707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:51 devstack sudo[99707]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038.7fd198ac-fdd2-44b9-9252-02f3371831f8" returned: 0 in 0.337s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038.7fd198ac-fdd2-44b9-9252-02f3371831f8 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:51 devstack sudo[99712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038.7fd198ac-fdd2-44b9-9252-02f3371831f8
Nov 06 11:52:51 devstack sudo[99712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:51 devstack sudo[99712]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038.7fd198ac-fdd2-44b9-9252-02f3371831f8" returned: 0 in 0.256s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:51 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Lock "cinder-quobyte-7fd198ac-fdd2-44b9-9252-02f3371831f8" released by "_delete_snapshot" :: held 1.713s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:52:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.723s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:52:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-bc1e762f-8d16-4c84-bb6a-aedd58ca8cd1 tempest-AttachVolumeTestJSON-784394024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.418s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:52:51 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-bc1e762f-8d16-4c84-bb6a-aedd58ca8cd1 tempest-AttachVolumeTestJSON-784394024 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1860224713',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41733ab2-68a3-4297-90d9-26c8ae688cc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c8c96fbf20e4dbe93f206aae0052c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:52:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:52:46Z,use_quota=True,user_id='a68744c6220f4aa58b94e599665d1df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:52:51 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-bc1e762f-8d16-4c84-bb6a-aedd58ca8cd1 tempest-AttachVolumeTestJSON-784394024 None] Creating volume 41733ab2-68a3-4297-90d9-26c8ae688cc0 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:52:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-bc1e762f-8d16-4c84-bb6a-aedd58ca8cd1 tempest-AttachVolumeTestJSON-784394024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:52:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-bc1e762f-8d16-4c84-bb6a-aedd58ca8cd1 tempest-AttachVolumeTestJSON-784394024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:52:51 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-bc1e762f-8d16-4c84-bb6a-aedd58ca8cd1 tempest-AttachVolumeTestJSON-784394024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:52:51 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-bc1e762f-8d16-4c84-bb6a-aedd58ca8cd1 tempest-AttachVolumeTestJSON-784394024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:52:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-bc1e762f-8d16-4c84-bb6a-aedd58ca8cd1 tempest-AttachVolumeTestJSON-784394024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:52:51 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-bc1e762f-8d16-4c84-bb6a-aedd58ca8cd1 tempest-AttachVolumeTestJSON-784394024 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:52:51 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-bc1e762f-8d16-4c84-bb6a-aedd58ca8cd1 tempest-AttachVolumeTestJSON-784394024 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:52:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bc1e762f-8d16-4c84-bb6a-aedd58ca8cd1 tempest-AttachVolumeTestJSON-784394024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-41733ab2-68a3-4297-90d9-26c8ae688cc0 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:51 devstack sudo[99715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-41733ab2-68a3-4297-90d9-26c8ae688cc0 1073741824
Nov 06 11:52:51 devstack sudo[99715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0596effe-f328-4a9b-a3b6-a6c9933143f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6d93bc7-cddb-42c3-99e1-ee7d00485c82', 'volume_size': 1, 'source_volid': '5f922761-7e56-494e-8ea1-e9793020e038', 'source_volstatus': 'available'}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e1b64fc-528d-49e8-a645-7852f8788812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:51 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Volume volume-b6d93bc7-cddb-42c3-99e1-ee7d00485c82 (b6d93bc7-cddb-42c3-99e1-ee7d00485c82): created successfully
Nov 06 11:52:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e1b64fc-528d-49e8-a645-7852f8788812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Flow 'volume_create_manager' (ece03d94-c4ab-4368-92c8-03ee19bf401b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:52:51 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-974afc55-b7a8-465b-9cbc-08f2d01eee02 tempest-VolumesGetTest-1808283213 None] Created volume successfully.
Nov 06 11:52:52 devstack sudo[99715]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bc1e762f-8d16-4c84-bb6a-aedd58ca8cd1 tempest-AttachVolumeTestJSON-784394024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-41733ab2-68a3-4297-90d9-26c8ae688cc0 1073741824" returned: 0 in 0.464s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bc1e762f-8d16-4c84-bb6a-aedd58ca8cd1 tempest-AttachVolumeTestJSON-784394024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-41733ab2-68a3-4297-90d9-26c8ae688cc0 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:52 devstack sudo[99721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-41733ab2-68a3-4297-90d9-26c8ae688cc0
Nov 06 11:52:52 devstack sudo[99721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:52 devstack sudo[99721]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bc1e762f-8d16-4c84-bb6a-aedd58ca8cd1 tempest-AttachVolumeTestJSON-784394024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-41733ab2-68a3-4297-90d9-26c8ae688cc0" returned: 0 in 0.333s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:52 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-bc1e762f-8d16-4c84-bb6a-aedd58ca8cd1 tempest-AttachVolumeTestJSON-784394024 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:52:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-bc1e762f-8d16-4c84-bb6a-aedd58ca8cd1 tempest-AttachVolumeTestJSON-784394024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:52:52 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-bc1e762f-8d16-4c84-bb6a-aedd58ca8cd1 tempest-AttachVolumeTestJSON-784394024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16e4f107-34a7-46d2-8a2a-08f3b0c89e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41733ab2-68a3-4297-90d9-26c8ae688cc0', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:52 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-bc1e762f-8d16-4c84-bb6a-aedd58ca8cd1 tempest-AttachVolumeTestJSON-784394024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32788cf8-3455-4e58-9f69-ada7b2373b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:52 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-bc1e762f-8d16-4c84-bb6a-aedd58ca8cd1 tempest-AttachVolumeTestJSON-784394024 None] Volume volume-41733ab2-68a3-4297-90d9-26c8ae688cc0 (41733ab2-68a3-4297-90d9-26c8ae688cc0): created successfully
Nov 06 11:52:52 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-bc1e762f-8d16-4c84-bb6a-aedd58ca8cd1 tempest-AttachVolumeTestJSON-784394024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32788cf8-3455-4e58-9f69-ada7b2373b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:52 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-bc1e762f-8d16-4c84-bb6a-aedd58ca8cd1 tempest-AttachVolumeTestJSON-784394024 None] Flow 'volume_create_manager' (2151cbc8-b1b7-4a26-8910-fb33aaf98823) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:52:52 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-bc1e762f-8d16-4c84-bb6a-aedd58ca8cd1 tempest-AttachVolumeTestJSON-784394024 None] Created volume successfully.
Nov 06 11:52:53 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-72191e66-2f65-45c6-b67c-465ae4db146a tempest-VolumesGetTest-1808283213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:52:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-72191e66-2f65-45c6-b67c-465ae4db146a tempest-VolumesGetTest-1808283213 None] Flow 'volume_create_manager' (2e22e864-0899-443f-a56c-980d1819f7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:52:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-72191e66-2f65-45c6-b67c-465ae4db146a tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3922dcae-a57e-4852-9cb6-d5b1732e9906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-72191e66-2f65-45c6-b67c-465ae4db146a tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3922dcae-a57e-4852-9cb6-d5b1732e9906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:52:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1990984483',display_name='tempest-VolumesGetTest-Volume-241874656',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=679ee8cf-d068-4740-91cd-afc56c7f41f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5e75b8c20d74e969666dcfe5a136c77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:52:53Z,use_quota=True,user_id='e6366d137d5243fd83eef9883759cc58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-72191e66-2f65-45c6-b67c-465ae4db146a tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b28b87a-7dd2-414a-8c80-593856fd825f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-72191e66-2f65-45c6-b67c-465ae4db146a tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b28b87a-7dd2-414a-8c80-593856fd825f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-72191e66-2f65-45c6-b67c-465ae4db146a tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d19eb95f-fa8a-4baa-94cd-c8635dc53c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-72191e66-2f65-45c6-b67c-465ae4db146a tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d19eb95f-fa8a-4baa-94cd-c8635dc53c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '679ee8cf-d068-4740-91cd-afc56c7f41f0', 'volume_name': 'volume-679ee8cf-d068-4740-91cd-afc56c7f41f0', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-72191e66-2f65-45c6-b67c-465ae4db146a tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83cecadf-8d95-490c-b312-1957e41705e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-72191e66-2f65-45c6-b67c-465ae4db146a tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83cecadf-8d95-490c-b312-1957e41705e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-72191e66-2f65-45c6-b67c-465ae4db146a tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79b814b1-25eb-4e40-8f15-f03ddd5c70ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:53 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-72191e66-2f65-45c6-b67c-465ae4db146a tempest-VolumesGetTest-1808283213 None] Volume 679ee8cf-d068-4740-91cd-afc56c7f41f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-679ee8cf-d068-4740-91cd-afc56c7f41f0', 'volume_size': 1}
Nov 06 11:52:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-72191e66-2f65-45c6-b67c-465ae4db146a tempest-VolumesGetTest-1808283213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:52:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-72191e66-2f65-45c6-b67c-465ae4db146a tempest-VolumesGetTest-1808283213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:52:53 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-72191e66-2f65-45c6-b67c-465ae4db146a tempest-VolumesGetTest-1808283213 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:52:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1990984483',display_name='tempest-VolumesGetTest-Volume-241874656',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=679ee8cf-d068-4740-91cd-afc56c7f41f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5e75b8c20d74e969666dcfe5a136c77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:52:53Z,use_quota=True,user_id='e6366d137d5243fd83eef9883759cc58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:52:53 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-72191e66-2f65-45c6-b67c-465ae4db146a tempest-VolumesGetTest-1808283213 None] Creating volume 679ee8cf-d068-4740-91cd-afc56c7f41f0 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:52:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-72191e66-2f65-45c6-b67c-465ae4db146a tempest-VolumesGetTest-1808283213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:52:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-72191e66-2f65-45c6-b67c-465ae4db146a tempest-VolumesGetTest-1808283213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:52:53 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-72191e66-2f65-45c6-b67c-465ae4db146a tempest-VolumesGetTest-1808283213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:52:53 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-72191e66-2f65-45c6-b67c-465ae4db146a tempest-VolumesGetTest-1808283213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:52:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-72191e66-2f65-45c6-b67c-465ae4db146a tempest-VolumesGetTest-1808283213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:52:53 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-72191e66-2f65-45c6-b67c-465ae4db146a tempest-VolumesGetTest-1808283213 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:52:53 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-72191e66-2f65-45c6-b67c-465ae4db146a tempest-VolumesGetTest-1808283213 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:52:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-72191e66-2f65-45c6-b67c-465ae4db146a tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-679ee8cf-d068-4740-91cd-afc56c7f41f0 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:53 devstack sudo[99738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-679ee8cf-d068-4740-91cd-afc56c7f41f0 1073741824
Nov 06 11:52:53 devstack sudo[99738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:53 devstack sudo[99738]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-72191e66-2f65-45c6-b67c-465ae4db146a tempest-VolumesGetTest-1808283213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-679ee8cf-d068-4740-91cd-afc56c7f41f0 1073741824" returned: 0 in 0.563s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-72191e66-2f65-45c6-b67c-465ae4db146a tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-679ee8cf-d068-4740-91cd-afc56c7f41f0 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:54 devstack sudo[99747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-679ee8cf-d068-4740-91cd-afc56c7f41f0
Nov 06 11:52:54 devstack sudo[99747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:54 devstack sudo[99747]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-72191e66-2f65-45c6-b67c-465ae4db146a tempest-VolumesGetTest-1808283213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-679ee8cf-d068-4740-91cd-afc56c7f41f0" returned: 0 in 0.289s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:54 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-72191e66-2f65-45c6-b67c-465ae4db146a tempest-VolumesGetTest-1808283213 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:52:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-72191e66-2f65-45c6-b67c-465ae4db146a tempest-VolumesGetTest-1808283213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:52:54 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-72191e66-2f65-45c6-b67c-465ae4db146a tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79b814b1-25eb-4e40-8f15-f03ddd5c70ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-679ee8cf-d068-4740-91cd-afc56c7f41f0', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:54 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-72191e66-2f65-45c6-b67c-465ae4db146a tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1382e414-9c8c-466e-b0e5-43a818185ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:54 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-72191e66-2f65-45c6-b67c-465ae4db146a tempest-VolumesGetTest-1808283213 None] Volume volume-679ee8cf-d068-4740-91cd-afc56c7f41f0 (679ee8cf-d068-4740-91cd-afc56c7f41f0): created successfully
Nov 06 11:52:54 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-72191e66-2f65-45c6-b67c-465ae4db146a tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1382e414-9c8c-466e-b0e5-43a818185ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:54 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-72191e66-2f65-45c6-b67c-465ae4db146a tempest-VolumesGetTest-1808283213 None] Flow 'volume_create_manager' (2e22e864-0899-443f-a56c-980d1819f7ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:52:54 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-72191e66-2f65-45c6-b67c-465ae4db146a tempest-VolumesGetTest-1808283213 None] Created volume successfully.
Nov 06 11:52:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-ea789754-be2c-447d-9f92-e9e196d14ea8 req-1e8455fb-150c-4877-977f-6d8ae9aaf092 tempest-AttachVolumeTestJSON-784394024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:52:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-ea789754-be2c-447d-9f92-e9e196d14ea8 req-1e8455fb-150c-4877-977f-6d8ae9aaf092 tempest-AttachVolumeTestJSON-784394024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:52:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-ea789754-be2c-447d-9f92-e9e196d14ea8 req-1e8455fb-150c-4877-977f-6d8ae9aaf092 tempest-AttachVolumeTestJSON-784394024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:52:54 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-ea789754-be2c-447d-9f92-e9e196d14ea8 req-1e8455fb-150c-4877-977f-6d8ae9aaf092 tempest-AttachVolumeTestJSON-784394024 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50', 'name': 'volume-41733ab2-68a3-4297-90d9-26c8ae688cc0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9f3f7119-dd78-443f-98a9-87def5f474b2', 'enforce_multipath': True} {{(pid=87165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 11:52:54 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-ea789754-be2c-447d-9f92-e9e196d14ea8 req-1e8455fb-150c-4877-977f-6d8ae9aaf092 tempest-AttachVolumeTestJSON-784394024 None] attachment_update completed successfully.
Nov 06 11:52:55 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b981d483-fefd-413f-9633-8dbd96f31f12 tempest-VolumesGetTest-1808283213 None] Acquiring lock "cinder-679ee8cf-d068-4740-91cd-afc56c7f41f0-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:52:55 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b981d483-fefd-413f-9633-8dbd96f31f12 tempest-VolumesGetTest-1808283213 None] Lock "cinder-679ee8cf-d068-4740-91cd-afc56c7f41f0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:52:55 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b981d483-fefd-413f-9633-8dbd96f31f12 tempest-VolumesGetTest-1808283213 None] Acquiring lock "cinder-quobyte-679ee8cf-d068-4740-91cd-afc56c7f41f0" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:52:55 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b981d483-fefd-413f-9633-8dbd96f31f12 tempest-VolumesGetTest-1808283213 None] Lock "cinder-quobyte-679ee8cf-d068-4740-91cd-afc56c7f41f0" acquired by "delete_volume" :: waited 0.018s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:52:55 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c7b273-a306-4d26-bb35-a390650d133e]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:52:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b981d483-fefd-413f-9633-8dbd96f31f12 tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-679ee8cf-d068-4740-91cd-afc56c7f41f0 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:55 devstack sudo[99761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-679ee8cf-d068-4740-91cd-afc56c7f41f0
Nov 06 11:52:55 devstack sudo[99761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:56 devstack sudo[99761]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b981d483-fefd-413f-9633-8dbd96f31f12 tempest-VolumesGetTest-1808283213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-679ee8cf-d068-4740-91cd-afc56c7f41f0" returned: 0 in 0.440s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b981d483-fefd-413f-9633-8dbd96f31f12 tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-679ee8cf-d068-4740-91cd-afc56c7f41f0 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:56 devstack sudo[99766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-679ee8cf-d068-4740-91cd-afc56c7f41f0
Nov 06 11:52:56 devstack sudo[99766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:56 devstack sudo[99766]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b981d483-fefd-413f-9633-8dbd96f31f12 tempest-VolumesGetTest-1808283213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-679ee8cf-d068-4740-91cd-afc56c7f41f0" returned: 0 in 0.280s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:56 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b981d483-fefd-413f-9633-8dbd96f31f12 tempest-VolumesGetTest-1808283213 None] Lock "cinder-quobyte-679ee8cf-d068-4740-91cd-afc56c7f41f0" released by "delete_volume" :: held 0.778s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:52:56 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-b981d483-fefd-413f-9633-8dbd96f31f12 tempest-VolumesGetTest-1808283213 None] Created reservations ['5431e467-1db4-46c3-8cc3-d623afb76e90', 'c702448a-8e24-4fce-9ad0-2fb204dec813', '0737e84e-caf8-4708-a24b-b6ad4666bb33', 'cb5b146d-5ada-43ad-89bd-7a9c35c71073'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:52:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b981d483-fefd-413f-9633-8dbd96f31f12 tempest-VolumesGetTest-1808283213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:52:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b981d483-fefd-413f-9633-8dbd96f31f12 tempest-VolumesGetTest-1808283213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:52:56 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b981d483-fefd-413f-9633-8dbd96f31f12 tempest-VolumesGetTest-1808283213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:52:56 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b981d483-fefd-413f-9633-8dbd96f31f12 tempest-VolumesGetTest-1808283213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:52:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b981d483-fefd-413f-9633-8dbd96f31f12 tempest-VolumesGetTest-1808283213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:52:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b981d483-fefd-413f-9633-8dbd96f31f12 tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:56 devstack sudo[99769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:52:56 devstack sudo[99769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:56 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-1b35df35-9fa4-4cdb-a7f3-ee96c0a1a86c tempest-VolumesGetTest-1808283213 None] Acquiring lock "cinder-b6d93bc7-cddb-42c3-99e1-ee7d00485c82-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:52:56 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-1b35df35-9fa4-4cdb-a7f3-ee96c0a1a86c tempest-VolumesGetTest-1808283213 None] Lock "cinder-b6d93bc7-cddb-42c3-99e1-ee7d00485c82-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:52:56 devstack sudo[99769]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b981d483-fefd-413f-9633-8dbd96f31f12 tempest-VolumesGetTest-1808283213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.403s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:56 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-b981d483-fefd-413f-9633-8dbd96f31f12 tempest-VolumesGetTest-1808283213 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:52:57 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-b981d483-fefd-413f-9633-8dbd96f31f12 tempest-VolumesGetTest-1808283213 None] Deleted volume successfully.
Nov 06 11:52:57 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-1b35df35-9fa4-4cdb-a7f3-ee96c0a1a86c tempest-VolumesGetTest-1808283213 None] Acquiring lock "cinder-quobyte-b6d93bc7-cddb-42c3-99e1-ee7d00485c82" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:52:57 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-1b35df35-9fa4-4cdb-a7f3-ee96c0a1a86c tempest-VolumesGetTest-1808283213 None] Lock "cinder-quobyte-b6d93bc7-cddb-42c3-99e1-ee7d00485c82" acquired by "delete_volume" :: waited 0.036s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:52:57 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b981d483-fefd-413f-9633-8dbd96f31f12 tempest-VolumesGetTest-1808283213 None] Lock "cinder-679ee8cf-d068-4740-91cd-afc56c7f41f0-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:52:57 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[109c32cb-6ebe-483c-a7ea-131ce95bb0a5]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:52:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1b35df35-9fa4-4cdb-a7f3-ee96c0a1a86c tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b6d93bc7-cddb-42c3-99e1-ee7d00485c82 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:57 devstack sudo[99772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b6d93bc7-cddb-42c3-99e1-ee7d00485c82
Nov 06 11:52:57 devstack sudo[99772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:57 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce18f94b-1bfa-4210-abc8-2d83787eee97 tempest-AttachVolumeTestJSON-784394024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:52:57 devstack sudo[99772]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:57 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ce18f94b-1bfa-4210-abc8-2d83787eee97 tempest-AttachVolumeTestJSON-784394024 None] Flow 'volume_create_manager' (9f709748-c637-421c-b649-fb70034b8d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:52:57 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ce18f94b-1bfa-4210-abc8-2d83787eee97 tempest-AttachVolumeTestJSON-784394024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89511ac1-b7b6-4c2f-b5ce-444391c54845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1b35df35-9fa4-4cdb-a7f3-ee96c0a1a86c tempest-VolumesGetTest-1808283213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b6d93bc7-cddb-42c3-99e1-ee7d00485c82" returned: 0 in 0.558s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1b35df35-9fa4-4cdb-a7f3-ee96c0a1a86c tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b6d93bc7-cddb-42c3-99e1-ee7d00485c82 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:57 devstack sudo[99777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b6d93bc7-cddb-42c3-99e1-ee7d00485c82
Nov 06 11:52:57 devstack sudo[99777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:57 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ce18f94b-1bfa-4210-abc8-2d83787eee97 tempest-AttachVolumeTestJSON-784394024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89511ac1-b7b6-4c2f-b5ce-444391c54845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-87932055',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e70bb95-2ff7-41cb-8fd9-414de9a1d8d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c8c96fbf20e4dbe93f206aae0052c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:52:58Z,use_quota=True,user_id='a68744c6220f4aa58b94e599665d1df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:57 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ce18f94b-1bfa-4210-abc8-2d83787eee97 tempest-AttachVolumeTestJSON-784394024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (738b2bf2-f89e-433d-b9ed-141df71c6c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:57 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ce18f94b-1bfa-4210-abc8-2d83787eee97 tempest-AttachVolumeTestJSON-784394024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (738b2bf2-f89e-433d-b9ed-141df71c6c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:57 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ce18f94b-1bfa-4210-abc8-2d83787eee97 tempest-AttachVolumeTestJSON-784394024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e6446e9-fe61-421b-9175-9ab7c72780c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:57 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ce18f94b-1bfa-4210-abc8-2d83787eee97 tempest-AttachVolumeTestJSON-784394024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e6446e9-fe61-421b-9175-9ab7c72780c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e70bb95-2ff7-41cb-8fd9-414de9a1d8d9', 'volume_name': 'volume-6e70bb95-2ff7-41cb-8fd9-414de9a1d8d9', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:57 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ce18f94b-1bfa-4210-abc8-2d83787eee97 tempest-AttachVolumeTestJSON-784394024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d2e0849-66f8-4b02-a1a9-07769d2056d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:57 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ce18f94b-1bfa-4210-abc8-2d83787eee97 tempest-AttachVolumeTestJSON-784394024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d2e0849-66f8-4b02-a1a9-07769d2056d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:57 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ce18f94b-1bfa-4210-abc8-2d83787eee97 tempest-AttachVolumeTestJSON-784394024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47a31e79-dce3-47c3-8ccb-4d2f079937b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:57 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-ce18f94b-1bfa-4210-abc8-2d83787eee97 tempest-AttachVolumeTestJSON-784394024 None] Volume 6e70bb95-2ff7-41cb-8fd9-414de9a1d8d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e70bb95-2ff7-41cb-8fd9-414de9a1d8d9', 'volume_size': 1}
Nov 06 11:52:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ce18f94b-1bfa-4210-abc8-2d83787eee97 tempest-AttachVolumeTestJSON-784394024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:52:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ce18f94b-1bfa-4210-abc8-2d83787eee97 tempest-AttachVolumeTestJSON-784394024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:52:57 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ce18f94b-1bfa-4210-abc8-2d83787eee97 tempest-AttachVolumeTestJSON-784394024 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-87932055',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e70bb95-2ff7-41cb-8fd9-414de9a1d8d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c8c96fbf20e4dbe93f206aae0052c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:52:58Z,use_quota=True,user_id='a68744c6220f4aa58b94e599665d1df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:52:57 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-ce18f94b-1bfa-4210-abc8-2d83787eee97 tempest-AttachVolumeTestJSON-784394024 None] Creating volume 6e70bb95-2ff7-41cb-8fd9-414de9a1d8d9 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:52:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ce18f94b-1bfa-4210-abc8-2d83787eee97 tempest-AttachVolumeTestJSON-784394024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:52:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ce18f94b-1bfa-4210-abc8-2d83787eee97 tempest-AttachVolumeTestJSON-784394024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:52:57 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ce18f94b-1bfa-4210-abc8-2d83787eee97 tempest-AttachVolumeTestJSON-784394024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:52:57 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ce18f94b-1bfa-4210-abc8-2d83787eee97 tempest-AttachVolumeTestJSON-784394024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:52:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ce18f94b-1bfa-4210-abc8-2d83787eee97 tempest-AttachVolumeTestJSON-784394024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:52:57 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ce18f94b-1bfa-4210-abc8-2d83787eee97 tempest-AttachVolumeTestJSON-784394024 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:52:57 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-ce18f94b-1bfa-4210-abc8-2d83787eee97 tempest-AttachVolumeTestJSON-784394024 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:52:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ce18f94b-1bfa-4210-abc8-2d83787eee97 tempest-AttachVolumeTestJSON-784394024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6e70bb95-2ff7-41cb-8fd9-414de9a1d8d9 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:57 devstack sudo[99779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6e70bb95-2ff7-41cb-8fd9-414de9a1d8d9 1073741824
Nov 06 11:52:57 devstack sudo[99779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:58 devstack sudo[99777]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1b35df35-9fa4-4cdb-a7f3-ee96c0a1a86c tempest-VolumesGetTest-1808283213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b6d93bc7-cddb-42c3-99e1-ee7d00485c82" returned: 0 in 0.299s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:58 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-1b35df35-9fa4-4cdb-a7f3-ee96c0a1a86c tempest-VolumesGetTest-1808283213 None] Lock "cinder-quobyte-b6d93bc7-cddb-42c3-99e1-ee7d00485c82" released by "delete_volume" :: held 0.967s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:52:58 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-1b35df35-9fa4-4cdb-a7f3-ee96c0a1a86c tempest-VolumesGetTest-1808283213 None] Created reservations ['ea3d39cd-3ff4-4310-8cd6-1d770925e438', 'fc187ea6-4227-414a-a04e-c6bd3c9fe614', '9f97985f-d930-4011-9506-1bad6fd1c80e', '0b0b62b7-6f1b-4123-8330-1e10ea4e4029'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:52:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-1b35df35-9fa4-4cdb-a7f3-ee96c0a1a86c tempest-VolumesGetTest-1808283213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:52:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-1b35df35-9fa4-4cdb-a7f3-ee96c0a1a86c tempest-VolumesGetTest-1808283213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:52:58 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-1b35df35-9fa4-4cdb-a7f3-ee96c0a1a86c tempest-VolumesGetTest-1808283213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:52:58 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-1b35df35-9fa4-4cdb-a7f3-ee96c0a1a86c tempest-VolumesGetTest-1808283213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:52:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-1b35df35-9fa4-4cdb-a7f3-ee96c0a1a86c tempest-VolumesGetTest-1808283213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:52:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1b35df35-9fa4-4cdb-a7f3-ee96c0a1a86c tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:58 devstack sudo[99785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:52:58 devstack sudo[99785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:58 devstack sudo[99779]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ce18f94b-1bfa-4210-abc8-2d83787eee97 tempest-AttachVolumeTestJSON-784394024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6e70bb95-2ff7-41cb-8fd9-414de9a1d8d9 1073741824" returned: 0 in 0.559s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ce18f94b-1bfa-4210-abc8-2d83787eee97 tempest-AttachVolumeTestJSON-784394024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6e70bb95-2ff7-41cb-8fd9-414de9a1d8d9 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:58 devstack sudo[99789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6e70bb95-2ff7-41cb-8fd9-414de9a1d8d9
Nov 06 11:52:58 devstack sudo[99789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:58 devstack sudo[99785]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1b35df35-9fa4-4cdb-a7f3-ee96c0a1a86c tempest-VolumesGetTest-1808283213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.297s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:58 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-1b35df35-9fa4-4cdb-a7f3-ee96c0a1a86c tempest-VolumesGetTest-1808283213 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:52:58 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-1b35df35-9fa4-4cdb-a7f3-ee96c0a1a86c tempest-VolumesGetTest-1808283213 None] Deleted volume successfully.
Nov 06 11:52:58 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-1b35df35-9fa4-4cdb-a7f3-ee96c0a1a86c tempest-VolumesGetTest-1808283213 None] Lock "cinder-b6d93bc7-cddb-42c3-99e1-ee7d00485c82-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:52:58 devstack sudo[99789]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ce18f94b-1bfa-4210-abc8-2d83787eee97 tempest-AttachVolumeTestJSON-784394024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6e70bb95-2ff7-41cb-8fd9-414de9a1d8d9" returned: 0 in 0.307s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:58 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ce18f94b-1bfa-4210-abc8-2d83787eee97 tempest-AttachVolumeTestJSON-784394024 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:52:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ce18f94b-1bfa-4210-abc8-2d83787eee97 tempest-AttachVolumeTestJSON-784394024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:52:58 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ce18f94b-1bfa-4210-abc8-2d83787eee97 tempest-AttachVolumeTestJSON-784394024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47a31e79-dce3-47c3-8ccb-4d2f079937b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e70bb95-2ff7-41cb-8fd9-414de9a1d8d9', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:58 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ce18f94b-1bfa-4210-abc8-2d83787eee97 tempest-AttachVolumeTestJSON-784394024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89d6aa39-0cec-471f-a4dd-100864e04393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:52:58 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-ce18f94b-1bfa-4210-abc8-2d83787eee97 tempest-AttachVolumeTestJSON-784394024 None] Volume volume-6e70bb95-2ff7-41cb-8fd9-414de9a1d8d9 (6e70bb95-2ff7-41cb-8fd9-414de9a1d8d9): created successfully
Nov 06 11:52:58 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ce18f94b-1bfa-4210-abc8-2d83787eee97 tempest-AttachVolumeTestJSON-784394024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89d6aa39-0cec-471f-a4dd-100864e04393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:52:58 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ce18f94b-1bfa-4210-abc8-2d83787eee97 tempest-AttachVolumeTestJSON-784394024 None] Flow 'volume_create_manager' (9f709748-c637-421c-b649-fb70034b8d02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:52:58 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-ce18f94b-1bfa-4210-abc8-2d83787eee97 tempest-AttachVolumeTestJSON-784394024 None] Created volume successfully.
Nov 06 11:52:59 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b1dccceb-5960-4a91-98b4-c6f9857ed68f tempest-VolumesGetTest-1808283213 None] Acquiring lock "cinder-5f922761-7e56-494e-8ea1-e9793020e038-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:52:59 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b1dccceb-5960-4a91-98b4-c6f9857ed68f tempest-VolumesGetTest-1808283213 None] Lock "cinder-5f922761-7e56-494e-8ea1-e9793020e038-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:52:59 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b1dccceb-5960-4a91-98b4-c6f9857ed68f tempest-VolumesGetTest-1808283213 None] Acquiring lock "cinder-quobyte-5f922761-7e56-494e-8ea1-e9793020e038" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:52:59 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b1dccceb-5960-4a91-98b4-c6f9857ed68f tempest-VolumesGetTest-1808283213 None] Lock "cinder-quobyte-5f922761-7e56-494e-8ea1-e9793020e038" acquired by "delete_volume" :: waited 0.022s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:52:59 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c07ef2c-76be-4935-878c-83d930d0c64c]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:52:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b1dccceb-5960-4a91-98b4-c6f9857ed68f tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:52:59 devstack sudo[99796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038
Nov 06 11:52:59 devstack sudo[99796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:52:59 devstack sudo[99796]: pam_unix(sudo:session): session closed for user root
Nov 06 11:52:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b1dccceb-5960-4a91-98b4-c6f9857ed68f tempest-VolumesGetTest-1808283213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038" returned: 0 in 0.568s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:52:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b1dccceb-5960-4a91-98b4-c6f9857ed68f tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:00 devstack sudo[99804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038
Nov 06 11:53:00 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:00 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b1dccceb-5960-4a91-98b4-c6f9857ed68f tempest-VolumesGetTest-1808283213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-5f922761-7e56-494e-8ea1-e9793020e038" returned: 0 in 0.343s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:00 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b1dccceb-5960-4a91-98b4-c6f9857ed68f tempest-VolumesGetTest-1808283213 None] Lock "cinder-quobyte-5f922761-7e56-494e-8ea1-e9793020e038" released by "delete_volume" :: held 0.994s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:53:00 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-b1dccceb-5960-4a91-98b4-c6f9857ed68f tempest-VolumesGetTest-1808283213 None] Created reservations ['b235ea31-b294-48cd-9577-83eb6b8010b2', '16d6fe1d-a0c0-451a-b88c-68db8aed07a6', '10e759a3-fca3-4583-b71a-ff043406ebe3', 'e85a5143-83b6-4421-b09f-37ea077b8292'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:53:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b1dccceb-5960-4a91-98b4-c6f9857ed68f tempest-VolumesGetTest-1808283213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:53:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b1dccceb-5960-4a91-98b4-c6f9857ed68f tempest-VolumesGetTest-1808283213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:53:00 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b1dccceb-5960-4a91-98b4-c6f9857ed68f tempest-VolumesGetTest-1808283213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:53:00 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b1dccceb-5960-4a91-98b4-c6f9857ed68f tempest-VolumesGetTest-1808283213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:53:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b1dccceb-5960-4a91-98b4-c6f9857ed68f tempest-VolumesGetTest-1808283213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:53:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b1dccceb-5960-4a91-98b4-c6f9857ed68f tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:00 devstack sudo[99807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:53:00 devstack sudo[99807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:00 devstack sudo[99807]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b1dccceb-5960-4a91-98b4-c6f9857ed68f tempest-VolumesGetTest-1808283213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.334s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:00 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-b1dccceb-5960-4a91-98b4-c6f9857ed68f tempest-VolumesGetTest-1808283213 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:53:00 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-b1dccceb-5960-4a91-98b4-c6f9857ed68f tempest-VolumesGetTest-1808283213 None] Deleted volume successfully.
Nov 06 11:53:00 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b1dccceb-5960-4a91-98b4-c6f9857ed68f tempest-VolumesGetTest-1808283213 None] Lock "cinder-5f922761-7e56-494e-8ea1-e9793020e038-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:53:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-6c73a807-a90c-4845-b30f-02087bcfba67 req-b0979205-55dc-4334-89bc-79c72cc23458 tempest-AttachVolumeTestJSON-784394024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:53:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-6c73a807-a90c-4845-b30f-02087bcfba67 req-b0979205-55dc-4334-89bc-79c72cc23458 tempest-AttachVolumeTestJSON-784394024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:53:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-6c73a807-a90c-4845-b30f-02087bcfba67 req-b0979205-55dc-4334-89bc-79c72cc23458 tempest-AttachVolumeTestJSON-784394024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:53:01 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-6c73a807-a90c-4845-b30f-02087bcfba67 req-b0979205-55dc-4334-89bc-79c72cc23458 tempest-AttachVolumeTestJSON-784394024 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50', 'name': 'volume-6e70bb95-2ff7-41cb-8fd9-414de9a1d8d9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '73ded625-f7a1-4822-8c7f-3dbb79092b95', 'enforce_multipath': True} {{(pid=87165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 11:53:01 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-6c73a807-a90c-4845-b30f-02087bcfba67 req-b0979205-55dc-4334-89bc-79c72cc23458 tempest-AttachVolumeTestJSON-784394024 None] attachment_update completed successfully.
Nov 06 11:53:02 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:53:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] Flow 'volume_create_manager' (e160f69c-bb40-464e-879d-124c4953f685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:53:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abf8fb64-db41-478f-97dc-6e605524ea0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abf8fb64-db41-478f-97dc-6e605524ea0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1038292823',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f096d0a9-39e7-4f09-8bc7-0c0701a7b6b7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b5e75b8c20d74e969666dcfe5a136c77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:53:03Z,use_quota=True,user_id='e6366d137d5243fd83eef9883759cc58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87c597fc-cfd7-4d1d-a41b-c2a0e21e18e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87c597fc-cfd7-4d1d-a41b-c2a0e21e18e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (269e5f74-84de-4227-88c3-32ee65f842db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:03 devstack cinder-volume[87165]: DEBUG cinder.image.glance [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] Creating Keystone auth plugin from conf {{(pid=87165) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 06 11:53:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (269e5f74-84de-4227-88c3-32ee65f842db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f096d0a9-39e7-4f09-8bc7-0c0701a7b6b7', 'volume_name': 'volume-f096d0a9-39e7-4f09-8bc7-0c0701a7b6b7', 'volume_size': 1, 'image_id': 'c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '28942f14a9e2424ca7367c6efa5fb47a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'created_at': datetime.datetime(2026, 11, 6, 10, 37, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 10, 37, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c315441d-48d2-43fb-b56a-c983b5a6f9cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x742c1e7a0530>}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a1f1685-e204-4ead-b64a-00b69f706fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a1f1685-e204-4ead-b64a-00b69f706fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88ae7808-7b55-4a2f-8ebf-af1f6dbcd2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:03 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] Volume f096d0a9-39e7-4f09-8bc7-0c0701a7b6b7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f096d0a9-39e7-4f09-8bc7-0c0701a7b6b7', 'volume_size': 1, 'image_id': 'c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '28942f14a9e2424ca7367c6efa5fb47a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'created_at': datetime.datetime(2026, 11, 6, 10, 37, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 10, 37, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c315441d-48d2-43fb-b56a-c983b5a6f9cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x742c1e7a0530>}
Nov 06 11:53:03 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] Trying to clone f096d0a9-39e7-4f09-8bc7-0c0701a7b6b7 from image c315441d-48d2-43fb-b56a-c983b5a6f9cd at location (None, [{'url': 'file:///opt/stack/data/glance/images/c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'metadata': {}}]). {{(pid=87165) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 06 11:53:03 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-860f7a8d-ee6f-47d5-bdf4-5fc499f2dab1 req-1387d73e-da64-41aa-8509-729fac027fc2 tempest-TestMinimumBasicScenario-1496090552 None] Terminate volume connection completed successfully.
Nov 06 11:53:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-860f7a8d-ee6f-47d5-bdf4-5fc499f2dab1 req-1387d73e-da64-41aa-8509-729fac027fc2 tempest-TestMinimumBasicScenario-1496090552 None] Deleting attachment 0011110b-fa8a-4268-aed4-3fe3813cf07f. {{(pid=87165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 11:53:04 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_73o5cqc9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87165) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 06 11:53:04 devstack cinder-volume[87165]: INFO cinder.image.image_utils [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] Image download 20.69 MB at 20.69 MB/s
Nov 06 11:53:04 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff64882-4b94-497f-ad8f-1086a4472c32]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:53:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_73o5cqc9devstack@QuobyteHD {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:04 devstack sudo[99864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_73o5cqc9devstack@QuobyteHD
Nov 06 11:53:04 devstack sudo[99864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:04 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-f765a8d7-f937-4ebc-80f9-0f5c83479231 req-2eb261d2-1634-45cc-89e3-b176d817f785 tempest-AttachVolumeTestJSON-784394024 None] Terminate volume connection completed successfully.
Nov 06 11:53:04 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-f765a8d7-f937-4ebc-80f9-0f5c83479231 req-2eb261d2-1634-45cc-89e3-b176d817f785 tempest-AttachVolumeTestJSON-784394024 None] Deleting attachment 9f3f7119-dd78-443f-98a9-87def5f474b2. {{(pid=87165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 11:53:04 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-fb68361d-aa11-4a46-85b7-77f11fb7adc3 tempest-TestMinimumBasicScenario-1496090552 None] Acquiring lock "cinder-94ab5008-21a5-4cdc-82e5-092d5293904c-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:53:04 devstack sudo[99864]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_73o5cqc9devstack@QuobyteHD" returned: 0 in 0.413s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:04 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] Temporary image c315441d-48d2-43fb-b56a-c983b5a6f9cd is fetched for user e6366d137d5243fd83eef9883759cc58. {{(pid=87165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 06 11:53:04 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-fb68361d-aa11-4a46-85b7-77f11fb7adc3 tempest-TestMinimumBasicScenario-1496090552 None] Lock "cinder-94ab5008-21a5-4cdc-82e5-092d5293904c-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:53:04 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-fb68361d-aa11-4a46-85b7-77f11fb7adc3 tempest-TestMinimumBasicScenario-1496090552 None] Acquiring lock "cinder-quobyte-94ab5008-21a5-4cdc-82e5-092d5293904c" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:53:05 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-fb68361d-aa11-4a46-85b7-77f11fb7adc3 tempest-TestMinimumBasicScenario-1496090552 None] Lock "cinder-quobyte-94ab5008-21a5-4cdc-82e5-092d5293904c" acquired by "delete_volume" :: waited 0.021s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:53:05 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[679dfd8a-b902-41bb-9235-6d672640413e]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:53:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_73o5cqc9devstack@QuobyteHD {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:05 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3984e2a9-fc2d-4a2c-8614-5a449e75cee4]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:53:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-fb68361d-aa11-4a46-85b7-77f11fb7adc3 tempest-TestMinimumBasicScenario-1496090552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-94ab5008-21a5-4cdc-82e5-092d5293904c {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:05 devstack sudo[99874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-94ab5008-21a5-4cdc-82e5-092d5293904c
Nov 06 11:53:05 devstack sudo[99874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:05 devstack sudo[99873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_73o5cqc9devstack@QuobyteHD
Nov 06 11:53:05 devstack sudo[99873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:05 devstack sudo[99873]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_73o5cqc9devstack@QuobyteHD" returned: 0 in 0.400s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:53:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:53:05 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1038292823',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f096d0a9-39e7-4f09-8bc7-0c0701a7b6b7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b5e75b8c20d74e969666dcfe5a136c77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:53:03Z,use_quota=True,user_id='e6366d137d5243fd83eef9883759cc58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:53:05 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] Creating volume f096d0a9-39e7-4f09-8bc7-0c0701a7b6b7 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:53:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:53:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:53:05 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:53:05 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:53:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:53:05 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:53:05 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:53:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f096d0a9-39e7-4f09-8bc7-0c0701a7b6b7 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:05 devstack sudo[99883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f096d0a9-39e7-4f09-8bc7-0c0701a7b6b7 1073741824
Nov 06 11:53:05 devstack sudo[99883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:05 devstack sudo[99874]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-fb68361d-aa11-4a46-85b7-77f11fb7adc3 tempest-TestMinimumBasicScenario-1496090552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-94ab5008-21a5-4cdc-82e5-092d5293904c" returned: 0 in 0.591s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-fb68361d-aa11-4a46-85b7-77f11fb7adc3 tempest-TestMinimumBasicScenario-1496090552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-94ab5008-21a5-4cdc-82e5-092d5293904c {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:05 devstack sudo[99885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-94ab5008-21a5-4cdc-82e5-092d5293904c
Nov 06 11:53:05 devstack sudo[99885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:05 devstack sudo[99885]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-fb68361d-aa11-4a46-85b7-77f11fb7adc3 tempest-TestMinimumBasicScenario-1496090552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-94ab5008-21a5-4cdc-82e5-092d5293904c" returned: 0 in 0.335s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:06 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-fb68361d-aa11-4a46-85b7-77f11fb7adc3 tempest-TestMinimumBasicScenario-1496090552 None] Lock "cinder-quobyte-94ab5008-21a5-4cdc-82e5-092d5293904c" released by "delete_volume" :: held 0.998s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:53:06 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-fb68361d-aa11-4a46-85b7-77f11fb7adc3 tempest-TestMinimumBasicScenario-1496090552 None] Created reservations ['4f378e64-fcae-440f-a9e5-ca7dfebd194b', '2ef87cd1-d11d-47e8-92ce-c000cfe575d5', '62171a57-ff30-4948-ac49-e453d4312e6f', '9a900625-dad4-4b32-89fc-af17e3062ba6'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:53:06 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-a22afceb-0124-40b8-825f-0cced4f8ca94 req-e19d4564-33a3-4785-b6ca-28eb31396cce tempest-AttachVolumeTestJSON-784394024 None] Terminate volume connection completed successfully.
Nov 06 11:53:06 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-a22afceb-0124-40b8-825f-0cced4f8ca94 req-e19d4564-33a3-4785-b6ca-28eb31396cce tempest-AttachVolumeTestJSON-784394024 None] Deleting attachment 73ded625-f7a1-4822-8c7f-3dbb79092b95. {{(pid=87165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 11:53:06 devstack sudo[99883]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f096d0a9-39e7-4f09-8bc7-0c0701a7b6b7 1073741824" returned: 0 in 0.772s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-fb68361d-aa11-4a46-85b7-77f11fb7adc3 tempest-TestMinimumBasicScenario-1496090552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:53:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-fb68361d-aa11-4a46-85b7-77f11fb7adc3 tempest-TestMinimumBasicScenario-1496090552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:53:06 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-fb68361d-aa11-4a46-85b7-77f11fb7adc3 tempest-TestMinimumBasicScenario-1496090552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:53:06 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-fb68361d-aa11-4a46-85b7-77f11fb7adc3 tempest-TestMinimumBasicScenario-1496090552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:53:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-fb68361d-aa11-4a46-85b7-77f11fb7adc3 tempest-TestMinimumBasicScenario-1496090552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:53:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-fb68361d-aa11-4a46-85b7-77f11fb7adc3 tempest-TestMinimumBasicScenario-1496090552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:06 devstack sudo[99895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:53:06 devstack sudo[99895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f096d0a9-39e7-4f09-8bc7-0c0701a7b6b7 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:06 devstack sudo[99897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f096d0a9-39e7-4f09-8bc7-0c0701a7b6b7
Nov 06 11:53:06 devstack sudo[99897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:06 devstack sudo[99895]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-fb68361d-aa11-4a46-85b7-77f11fb7adc3 tempest-TestMinimumBasicScenario-1496090552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.330s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:06 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-fb68361d-aa11-4a46-85b7-77f11fb7adc3 tempest-TestMinimumBasicScenario-1496090552 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:53:06 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-fb68361d-aa11-4a46-85b7-77f11fb7adc3 tempest-TestMinimumBasicScenario-1496090552 None] Deleted volume successfully.
Nov 06 11:53:06 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-fb68361d-aa11-4a46-85b7-77f11fb7adc3 tempest-TestMinimumBasicScenario-1496090552 None] Lock "cinder-94ab5008-21a5-4cdc-82e5-092d5293904c-delete_volume" released by "delete_volume" :: held 1.787s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:53:06 devstack sudo[99897]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f096d0a9-39e7-4f09-8bc7-0c0701a7b6b7" returned: 0 in 0.393s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:06 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] <== create_volume: return (1278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:53:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.281s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:53:06 devstack cinder-volume[87165]: DEBUG cinder.volume.volume_utils [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] Attempting download of c315441d-48d2-43fb-b56a-c983b5a6f9cd ((None, [{'url': 'file:///opt/stack/data/glance/images/c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'metadata': {}}])) to volume f096d0a9-39e7-4f09-8bc7-0c0701a7b6b7. {{(pid=87165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 06 11:53:06 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d112b487-ea9a-454b-afdd-7e63861aa4b8]: (4, 'raw') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:53:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c315441d-48d2-43fb-b56a-c983b5a6f9cd_5e_qta15 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:06 devstack sudo[99901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c315441d-48d2-43fb-b56a-c983b5a6f9cd_5e_qta15
Nov 06 11:53:06 devstack sudo[99901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:07 devstack sudo[99901]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c315441d-48d2-43fb-b56a-c983b5a6f9cd_5e_qta15" returned: 0 in 0.509s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c315441d-48d2-43fb-b56a-c983b5a6f9cd_5e_qta15 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:07 devstack sudo[99911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c315441d-48d2-43fb-b56a-c983b5a6f9cd_5e_qta15
Nov 06 11:53:07 devstack sudo[99911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:07 devstack sudo[99911]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c315441d-48d2-43fb-b56a-c983b5a6f9cd_5e_qta15" returned: 1 in 0.521s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c315441d-48d2-43fb-b56a-c983b5a6f9cd_5e_qta15' failed. Not Retrying. {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 11:53:07 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4fb1e6-a710-460b-82b2-57cdd418aabe]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:53:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_73o5cqc9devstack@QuobyteHD {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:08 devstack sudo[99923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_73o5cqc9devstack@QuobyteHD
Nov 06 11:53:08 devstack sudo[99923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:08 devstack sudo[99923]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_73o5cqc9devstack@QuobyteHD" returned: 0 in 0.642s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:08 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] c315441d-48d2-43fb-b56a-c983b5a6f9cd was qcow2, converting to qcow2 {{(pid=87165) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 06 11:53:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_73o5cqc9devstack@QuobyteHD /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f096d0a9-39e7-4f09-8bc7-0c0701a7b6b7 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:08 devstack sudo[99955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_73o5cqc9devstack@QuobyteHD /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f096d0a9-39e7-4f09-8bc7-0c0701a7b6b7
Nov 06 11:53:08 devstack sudo[99955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:11 devstack sudo[99955]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_73o5cqc9devstack@QuobyteHD /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f096d0a9-39e7-4f09-8bc7-0c0701a7b6b7" returned: 0 in 2.549s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:11 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_73o5cqc9devstack@QuobyteHD, size 112.00 MB, duration 2.55 sec, destination /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f096d0a9-39e7-4f09-8bc7-0c0701a7b6b7 {{(pid=87165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 11:53:11 devstack cinder-volume[87165]: INFO cinder.image.image_utils [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] Converted 112.00 MB image at 43.92 MB/s
Nov 06 11:53:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f096d0a9-39e7-4f09-8bc7-0c0701a7b6b7 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:11 devstack sudo[99965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f096d0a9-39e7-4f09-8bc7-0c0701a7b6b7 1G
Nov 06 11:53:11 devstack sudo[99965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:11 devstack sudo[99965]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f096d0a9-39e7-4f09-8bc7-0c0701a7b6b7 1G" returned: 0 in 0.462s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:11 devstack cinder-volume[87165]: DEBUG cinder.volume.volume_utils [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] Downloaded image c315441d-48d2-43fb-b56a-c983b5a6f9cd ((None, [{'url': 'file:///opt/stack/data/glance/images/c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'metadata': {}}])) to volume f096d0a9-39e7-4f09-8bc7-0c0701a7b6b7 successfully. {{(pid=87165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 06 11:53:11 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] Temporary image c315441d-48d2-43fb-b56a-c983b5a6f9cd for user e6366d137d5243fd83eef9883759cc58 is deleted. {{(pid=87165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 06 11:53:11 devstack cinder-volume[87165]: DEBUG cinder.volume.volume_utils [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] Marking volume f096d0a9-39e7-4f09-8bc7-0c0701a7b6b7 as bootable. {{(pid=87165) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 06 11:53:11 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] Copying metadata from image c315441d-48d2-43fb-b56a-c983b5a6f9cd to f096d0a9-39e7-4f09-8bc7-0c0701a7b6b7. {{(pid=87165) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 06 11:53:11 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] Creating volume glance metadata for volume f096d0a9-39e7-4f09-8bc7-0c0701a7b6b7 backed by image c315441d-48d2-43fb-b56a-c983b5a6f9cd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87165) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 06 11:53:11 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88ae7808-7b55-4a2f-8ebf-af1f6dbcd2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f096d0a9-39e7-4f09-8bc7-0c0701a7b6b7', 'volume_size': 1, 'image_id': 'c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '28942f14a9e2424ca7367c6efa5fb47a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'created_at': datetime.datetime(2026, 11, 6, 10, 37, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 10, 37, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c315441d-48d2-43fb-b56a-c983b5a6f9cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x742c1e7a0530>}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:11 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e53db4a-1795-47c8-bc3c-c6d3f8ac21d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:11 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] Volume volume-f096d0a9-39e7-4f09-8bc7-0c0701a7b6b7 (f096d0a9-39e7-4f09-8bc7-0c0701a7b6b7): created successfully
Nov 06 11:53:11 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e53db4a-1795-47c8-bc3c-c6d3f8ac21d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:11 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] Flow 'volume_create_manager' (e160f69c-bb40-464e-879d-124c4953f685) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:53:11 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-b73c38e3-2a5e-4599-b5f3-5d10b21e4f53 tempest-VolumesGetTest-1808283213 None] Created volume successfully.
Nov 06 11:53:13 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-3333c971-d459-41bb-9215-3b39247811f2 tempest-VolumesGetTest-1808283213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:53:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3333c971-d459-41bb-9215-3b39247811f2 tempest-VolumesGetTest-1808283213 None] Flow 'volume_create_manager' (ff542234-25f5-40cb-8ff3-dfebc5f27a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:53:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3333c971-d459-41bb-9215-3b39247811f2 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55728d64-efbd-4e5c-a615-fb24ffb9224c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:14 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3333c971-d459-41bb-9215-3b39247811f2 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55728d64-efbd-4e5c-a615-fb24ffb9224c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:53:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1705712634',display_name='tempest-VolumesGetTest-Volume-2079174410',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62381b62-2dc5-4de3-bfc1-377cb236f0db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5e75b8c20d74e969666dcfe5a136c77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:53:14Z,use_quota=True,user_id='e6366d137d5243fd83eef9883759cc58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:14 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3333c971-d459-41bb-9215-3b39247811f2 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d3e5da-f29b-4f0e-b887-220c8ff2a5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:14 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3333c971-d459-41bb-9215-3b39247811f2 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d3e5da-f29b-4f0e-b887-220c8ff2a5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:14 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3333c971-d459-41bb-9215-3b39247811f2 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4319ac55-288e-498e-acf5-56da5294809a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:14 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3333c971-d459-41bb-9215-3b39247811f2 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4319ac55-288e-498e-acf5-56da5294809a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62381b62-2dc5-4de3-bfc1-377cb236f0db', 'volume_name': 'volume-62381b62-2dc5-4de3-bfc1-377cb236f0db', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:14 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3333c971-d459-41bb-9215-3b39247811f2 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db1758f9-a8f9-48dc-8854-7d8086a89d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:14 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3333c971-d459-41bb-9215-3b39247811f2 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db1758f9-a8f9-48dc-8854-7d8086a89d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:14 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3333c971-d459-41bb-9215-3b39247811f2 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae4dfba3-2b0b-4387-99c0-ed21afaabad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:14 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-3333c971-d459-41bb-9215-3b39247811f2 tempest-VolumesGetTest-1808283213 None] Volume 62381b62-2dc5-4de3-bfc1-377cb236f0db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62381b62-2dc5-4de3-bfc1-377cb236f0db', 'volume_size': 1}
Nov 06 11:53:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3333c971-d459-41bb-9215-3b39247811f2 tempest-VolumesGetTest-1808283213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:53:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3333c971-d459-41bb-9215-3b39247811f2 tempest-VolumesGetTest-1808283213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:53:14 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-3333c971-d459-41bb-9215-3b39247811f2 tempest-VolumesGetTest-1808283213 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:53:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1705712634',display_name='tempest-VolumesGetTest-Volume-2079174410',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62381b62-2dc5-4de3-bfc1-377cb236f0db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5e75b8c20d74e969666dcfe5a136c77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:53:14Z,use_quota=True,user_id='e6366d137d5243fd83eef9883759cc58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:53:14 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-3333c971-d459-41bb-9215-3b39247811f2 tempest-VolumesGetTest-1808283213 None] Creating volume 62381b62-2dc5-4de3-bfc1-377cb236f0db {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:53:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3333c971-d459-41bb-9215-3b39247811f2 tempest-VolumesGetTest-1808283213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:53:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3333c971-d459-41bb-9215-3b39247811f2 tempest-VolumesGetTest-1808283213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:53:14 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-3333c971-d459-41bb-9215-3b39247811f2 tempest-VolumesGetTest-1808283213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:53:14 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-3333c971-d459-41bb-9215-3b39247811f2 tempest-VolumesGetTest-1808283213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:53:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3333c971-d459-41bb-9215-3b39247811f2 tempest-VolumesGetTest-1808283213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:53:14 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-3333c971-d459-41bb-9215-3b39247811f2 tempest-VolumesGetTest-1808283213 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:53:14 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-3333c971-d459-41bb-9215-3b39247811f2 tempest-VolumesGetTest-1808283213 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:53:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3333c971-d459-41bb-9215-3b39247811f2 tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-62381b62-2dc5-4de3-bfc1-377cb236f0db 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:14 devstack sudo[99977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-62381b62-2dc5-4de3-bfc1-377cb236f0db 1073741824
Nov 06 11:53:14 devstack sudo[99977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:14 devstack sudo[99977]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3333c971-d459-41bb-9215-3b39247811f2 tempest-VolumesGetTest-1808283213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-62381b62-2dc5-4de3-bfc1-377cb236f0db 1073741824" returned: 0 in 0.572s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3333c971-d459-41bb-9215-3b39247811f2 tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-62381b62-2dc5-4de3-bfc1-377cb236f0db {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:14 devstack sudo[99984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-62381b62-2dc5-4de3-bfc1-377cb236f0db
Nov 06 11:53:14 devstack sudo[99984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:15 devstack sudo[99984]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3333c971-d459-41bb-9215-3b39247811f2 tempest-VolumesGetTest-1808283213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-62381b62-2dc5-4de3-bfc1-377cb236f0db" returned: 0 in 0.320s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:15 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-3333c971-d459-41bb-9215-3b39247811f2 tempest-VolumesGetTest-1808283213 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:53:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3333c971-d459-41bb-9215-3b39247811f2 tempest-VolumesGetTest-1808283213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:53:15 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3333c971-d459-41bb-9215-3b39247811f2 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae4dfba3-2b0b-4387-99c0-ed21afaabad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62381b62-2dc5-4de3-bfc1-377cb236f0db', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:15 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3333c971-d459-41bb-9215-3b39247811f2 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a535acd-fda7-4b83-b728-ed64ca7998b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:15 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-3333c971-d459-41bb-9215-3b39247811f2 tempest-VolumesGetTest-1808283213 None] Volume volume-62381b62-2dc5-4de3-bfc1-377cb236f0db (62381b62-2dc5-4de3-bfc1-377cb236f0db): created successfully
Nov 06 11:53:15 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3333c971-d459-41bb-9215-3b39247811f2 tempest-VolumesGetTest-1808283213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a535acd-fda7-4b83-b728-ed64ca7998b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:15 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3333c971-d459-41bb-9215-3b39247811f2 tempest-VolumesGetTest-1808283213 None] Flow 'volume_create_manager' (ff542234-25f5-40cb-8ff3-dfebc5f27a1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:53:15 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-3333c971-d459-41bb-9215-3b39247811f2 tempest-VolumesGetTest-1808283213 None] Created volume successfully.
Nov 06 11:53:16 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-cb1b10bd-e7a5-4ff9-9aa3-a13166c5b89b tempest-VolumesGetTest-1808283213 None] Acquiring lock "cinder-62381b62-2dc5-4de3-bfc1-377cb236f0db-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:53:16 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-cb1b10bd-e7a5-4ff9-9aa3-a13166c5b89b tempest-VolumesGetTest-1808283213 None] Lock "cinder-62381b62-2dc5-4de3-bfc1-377cb236f0db-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:53:16 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-cb1b10bd-e7a5-4ff9-9aa3-a13166c5b89b tempest-VolumesGetTest-1808283213 None] Acquiring lock "cinder-quobyte-62381b62-2dc5-4de3-bfc1-377cb236f0db" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:53:16 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-cb1b10bd-e7a5-4ff9-9aa3-a13166c5b89b tempest-VolumesGetTest-1808283213 None] Lock "cinder-quobyte-62381b62-2dc5-4de3-bfc1-377cb236f0db" acquired by "delete_volume" :: waited 0.029s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:53:16 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ab5974-aeb8-498d-bd9d-66b567612326]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:53:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cb1b10bd-e7a5-4ff9-9aa3-a13166c5b89b tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-62381b62-2dc5-4de3-bfc1-377cb236f0db {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:16 devstack sudo[99988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-62381b62-2dc5-4de3-bfc1-377cb236f0db
Nov 06 11:53:16 devstack sudo[99988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:16 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb727bf5-0448-4c10-b8b0-4e7aa778ef17 tempest-TestStampPattern-1153361119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:53:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-fb727bf5-0448-4c10-b8b0-4e7aa778ef17 tempest-TestStampPattern-1153361119 None] Flow 'volume_create_manager' (bf2e63d8-560d-4a40-a88c-047b0ea8ea41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:53:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-fb727bf5-0448-4c10-b8b0-4e7aa778ef17 tempest-TestStampPattern-1153361119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8d113ec-20bb-4db9-8f8f-a482be525c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:16 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0b1f9e26-a91a-4e08-b8cc-5dd8a60604b4 tempest-AttachVolumeTestJSON-784394024 None] Acquiring lock "cinder-6e70bb95-2ff7-41cb-8fd9-414de9a1d8d9-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:53:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-fb727bf5-0448-4c10-b8b0-4e7aa778ef17 tempest-TestStampPattern-1153361119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8d113ec-20bb-4db9-8f8f-a482be525c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1071242649',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b294b1d2-5006-4243-9a13-b1aeb251204b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffa73c43605f466eb7cf9062967949f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:53:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:53:16Z,use_quota=True,user_id='b253a3a89e5f46a1b8fecd67f642c0f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-fb727bf5-0448-4c10-b8b0-4e7aa778ef17 tempest-TestStampPattern-1153361119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e324700-920f-4dba-9e13-af39d841ee11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-fb727bf5-0448-4c10-b8b0-4e7aa778ef17 tempest-TestStampPattern-1153361119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e324700-920f-4dba-9e13-af39d841ee11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-fb727bf5-0448-4c10-b8b0-4e7aa778ef17 tempest-TestStampPattern-1153361119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e73ea34-4f3b-4d1e-a6b9-2d3008916efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-fb727bf5-0448-4c10-b8b0-4e7aa778ef17 tempest-TestStampPattern-1153361119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e73ea34-4f3b-4d1e-a6b9-2d3008916efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b294b1d2-5006-4243-9a13-b1aeb251204b', 'volume_name': 'volume-b294b1d2-5006-4243-9a13-b1aeb251204b', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-fb727bf5-0448-4c10-b8b0-4e7aa778ef17 tempest-TestStampPattern-1153361119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d36aa19-a8f1-403b-93d4-41f718a9f166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-fb727bf5-0448-4c10-b8b0-4e7aa778ef17 tempest-TestStampPattern-1153361119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d36aa19-a8f1-403b-93d4-41f718a9f166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-fb727bf5-0448-4c10-b8b0-4e7aa778ef17 tempest-TestStampPattern-1153361119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70e71ec8-6742-4ac6-8d3e-d51dd4709a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:16 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-fb727bf5-0448-4c10-b8b0-4e7aa778ef17 tempest-TestStampPattern-1153361119 None] Volume b294b1d2-5006-4243-9a13-b1aeb251204b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b294b1d2-5006-4243-9a13-b1aeb251204b', 'volume_size': 1}
Nov 06 11:53:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-fb727bf5-0448-4c10-b8b0-4e7aa778ef17 tempest-TestStampPattern-1153361119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:53:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-fb727bf5-0448-4c10-b8b0-4e7aa778ef17 tempest-TestStampPattern-1153361119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:53:16 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-fb727bf5-0448-4c10-b8b0-4e7aa778ef17 tempest-TestStampPattern-1153361119 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1071242649',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b294b1d2-5006-4243-9a13-b1aeb251204b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffa73c43605f466eb7cf9062967949f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:53:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:53:16Z,use_quota=True,user_id='b253a3a89e5f46a1b8fecd67f642c0f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:53:16 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-fb727bf5-0448-4c10-b8b0-4e7aa778ef17 tempest-TestStampPattern-1153361119 None] Creating volume b294b1d2-5006-4243-9a13-b1aeb251204b {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:53:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-fb727bf5-0448-4c10-b8b0-4e7aa778ef17 tempest-TestStampPattern-1153361119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:53:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-fb727bf5-0448-4c10-b8b0-4e7aa778ef17 tempest-TestStampPattern-1153361119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:53:16 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-fb727bf5-0448-4c10-b8b0-4e7aa778ef17 tempest-TestStampPattern-1153361119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:53:16 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-fb727bf5-0448-4c10-b8b0-4e7aa778ef17 tempest-TestStampPattern-1153361119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:53:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-fb727bf5-0448-4c10-b8b0-4e7aa778ef17 tempest-TestStampPattern-1153361119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:53:16 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-fb727bf5-0448-4c10-b8b0-4e7aa778ef17 tempest-TestStampPattern-1153361119 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:53:16 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-fb727bf5-0448-4c10-b8b0-4e7aa778ef17 tempest-TestStampPattern-1153361119 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:53:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-fb727bf5-0448-4c10-b8b0-4e7aa778ef17 tempest-TestStampPattern-1153361119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:16 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0b1f9e26-a91a-4e08-b8cc-5dd8a60604b4 tempest-AttachVolumeTestJSON-784394024 None] Lock "cinder-6e70bb95-2ff7-41cb-8fd9-414de9a1d8d9-delete_volume" acquired by "delete_volume" :: waited 0.104s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:53:16 devstack sudo[99990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b 1073741824
Nov 06 11:53:16 devstack sudo[99990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:16 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0b1f9e26-a91a-4e08-b8cc-5dd8a60604b4 tempest-AttachVolumeTestJSON-784394024 None] Acquiring lock "cinder-quobyte-6e70bb95-2ff7-41cb-8fd9-414de9a1d8d9" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:53:16 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0b1f9e26-a91a-4e08-b8cc-5dd8a60604b4 tempest-AttachVolumeTestJSON-784394024 None] Lock "cinder-quobyte-6e70bb95-2ff7-41cb-8fd9-414de9a1d8d9" acquired by "delete_volume" :: waited 0.025s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:53:16 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4a493b-fe88-4cd9-ab42-9f2c172ba8a3]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:53:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0b1f9e26-a91a-4e08-b8cc-5dd8a60604b4 tempest-AttachVolumeTestJSON-784394024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6e70bb95-2ff7-41cb-8fd9-414de9a1d8d9 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:16 devstack sudo[99988]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cb1b10bd-e7a5-4ff9-9aa3-a13166c5b89b tempest-VolumesGetTest-1808283213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-62381b62-2dc5-4de3-bfc1-377cb236f0db" returned: 0 in 0.601s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cb1b10bd-e7a5-4ff9-9aa3-a13166c5b89b tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-62381b62-2dc5-4de3-bfc1-377cb236f0db {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:16 devstack sudo[99996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-62381b62-2dc5-4de3-bfc1-377cb236f0db
Nov 06 11:53:16 devstack sudo[99996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:16 devstack sudo[99995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6e70bb95-2ff7-41cb-8fd9-414de9a1d8d9
Nov 06 11:53:16 devstack sudo[99995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:17 devstack cinder-volume[87165]: DEBUG oslo_service.periodic_task [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 11:53:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:53:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:53:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:53:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:53:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:53:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:17 devstack sudo[100003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:53:17 devstack sudo[100003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:17 devstack sudo[99996]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cb1b10bd-e7a5-4ff9-9aa3-a13166c5b89b tempest-VolumesGetTest-1808283213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-62381b62-2dc5-4de3-bfc1-377cb236f0db" returned: 0 in 0.429s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:17 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-cb1b10bd-e7a5-4ff9-9aa3-a13166c5b89b tempest-VolumesGetTest-1808283213 None] Lock "cinder-quobyte-62381b62-2dc5-4de3-bfc1-377cb236f0db" released by "delete_volume" :: held 1.113s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:53:17 devstack sudo[99995]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0b1f9e26-a91a-4e08-b8cc-5dd8a60604b4 tempest-AttachVolumeTestJSON-784394024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6e70bb95-2ff7-41cb-8fd9-414de9a1d8d9" returned: 0 in 0.596s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0b1f9e26-a91a-4e08-b8cc-5dd8a60604b4 tempest-AttachVolumeTestJSON-784394024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6e70bb95-2ff7-41cb-8fd9-414de9a1d8d9 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:17 devstack sudo[99990]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-fb727bf5-0448-4c10-b8b0-4e7aa778ef17 tempest-TestStampPattern-1153361119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b 1073741824" returned: 0 in 0.754s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:17 devstack sudo[100009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6e70bb95-2ff7-41cb-8fd9-414de9a1d8d9
Nov 06 11:53:17 devstack sudo[100009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:17 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-cb1b10bd-e7a5-4ff9-9aa3-a13166c5b89b tempest-VolumesGetTest-1808283213 None] Created reservations ['68018124-626b-4179-be0c-fba37e6ca9be', 'b7c56693-54d1-47b5-94c0-89461547a904', 'c8e9a46e-9646-4ae6-87e7-2c252cecac50', '49190024-9427-484e-8f18-d21a7833e6af'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:53:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-fb727bf5-0448-4c10-b8b0-4e7aa778ef17 tempest-TestStampPattern-1153361119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:17 devstack sudo[100011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b
Nov 06 11:53:17 devstack sudo[100011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-cb1b10bd-e7a5-4ff9-9aa3-a13166c5b89b tempest-VolumesGetTest-1808283213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:53:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-cb1b10bd-e7a5-4ff9-9aa3-a13166c5b89b tempest-VolumesGetTest-1808283213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:53:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-cb1b10bd-e7a5-4ff9-9aa3-a13166c5b89b tempest-VolumesGetTest-1808283213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:53:17 devstack sudo[100003]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-cb1b10bd-e7a5-4ff9-9aa3-a13166c5b89b tempest-VolumesGetTest-1808283213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:53:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-cb1b10bd-e7a5-4ff9-9aa3-a13166c5b89b tempest-VolumesGetTest-1808283213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:53:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cb1b10bd-e7a5-4ff9-9aa3-a13166c5b89b tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.420s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:17 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:53:17 devstack cinder-volume[87165]: DEBUG oslo_service.periodic_task [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running periodic task VolumeManager._thread_info {{(pid=87165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 11:53:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] thread count: 29 {{(pid=87165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 11:53:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] thread info: [<_MainThread(MainThread, started 127732956901504)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127732842693056)>, <Thread(Thread-3 (stat_writer), started daemon 127732841891136)>, <Thread(Rabbit-heartbeat, started daemon 127732842515648)>, <Thread(Thread-5 (_runner), started daemon 127732840534464)>, <Thread(Thread-7 (_runner), started daemon 127732840636032)>, <Thread(fd_logger, started daemon 127732838664256)>, <Thread(privsep_reader, started daemon 127732838673408)>, <Thread(tpool_thread_0, started daemon 127732829828800)>, <Thread(tpool_thread_1, started daemon 127732821436096)>, <Thread(tpool_thread_2, started daemon 127732813043392)>, <Thread(tpool_thread_3, started daemon 127732804650688)>, <Thread(tpool_thread_4, started daemon 127732796257984)>, <Thread(tpool_thread_5, started daemon 127732787865280)>, <Thread(tpool_thread_6, started daemon 127732779456192)>, <Thread(tpool_thread_7, started daemon 127732771047104)>, <Thread(tpool_thread_8, started daemon 127732762638016)>, <Thread(tpool_thread_9, started daemon 127732754228928)>, <Thread(tpool_thread_10, started daemon 127732745819840)>, <Thread(tpool_thread_11, started daemon 127732737410752)>, <Thread(tpool_thread_12, started daemon 127732729001664)>, <Thread(tpool_thread_13, started daemon 127732720592576)>, <Thread(tpool_thread_14, started daemon 127732712183488)>, <Thread(tpool_thread_15, started daemon 127732703774400)>, <Thread(tpool_thread_16, started daemon 127732695365312)>, <Thread(tpool_thread_17, started daemon 127732686956224)>, <Thread(tpool_thread_18, started daemon 127732678547136)>, <Thread(tpool_thread_19, started daemon 127732670138048)>, <Thread(Rabbit-heartbeat, started daemon 127732832631296)>] {{(pid=87165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 11:53:17 devstack sudo[100014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:53:17 devstack sudo[100014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:17 devstack sudo[100009]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0b1f9e26-a91a-4e08-b8cc-5dd8a60604b4 tempest-AttachVolumeTestJSON-784394024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6e70bb95-2ff7-41cb-8fd9-414de9a1d8d9" returned: 0 in 0.337s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:17 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0b1f9e26-a91a-4e08-b8cc-5dd8a60604b4 tempest-AttachVolumeTestJSON-784394024 None] Lock "cinder-quobyte-6e70bb95-2ff7-41cb-8fd9-414de9a1d8d9" released by "delete_volume" :: held 0.983s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:53:17 devstack sudo[100011]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:17 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-0b1f9e26-a91a-4e08-b8cc-5dd8a60604b4 tempest-AttachVolumeTestJSON-784394024 None] Created reservations ['99e26918-3615-48ec-9ad5-4defccd988b0', 'fc7d4224-1df7-4a1b-a4d3-1690ef972f3d', 'e2b45c4c-2a3b-4bf8-8607-869840142e85', '9b2d7f1e-79b0-4eb7-9a52-23a203cd930d'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:53:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-fb727bf5-0448-4c10-b8b0-4e7aa778ef17 tempest-TestStampPattern-1153361119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b" returned: 0 in 0.356s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-fb727bf5-0448-4c10-b8b0-4e7aa778ef17 tempest-TestStampPattern-1153361119 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:53:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-fb727bf5-0448-4c10-b8b0-4e7aa778ef17 tempest-TestStampPattern-1153361119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:53:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-fb727bf5-0448-4c10-b8b0-4e7aa778ef17 tempest-TestStampPattern-1153361119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70e71ec8-6742-4ac6-8d3e-d51dd4709a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b294b1d2-5006-4243-9a13-b1aeb251204b', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-fb727bf5-0448-4c10-b8b0-4e7aa778ef17 tempest-TestStampPattern-1153361119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39ae3231-cf7b-4eb8-807c-f02ad56c9eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:17 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-fb727bf5-0448-4c10-b8b0-4e7aa778ef17 tempest-TestStampPattern-1153361119 None] Volume volume-b294b1d2-5006-4243-9a13-b1aeb251204b (b294b1d2-5006-4243-9a13-b1aeb251204b): created successfully
Nov 06 11:53:17 devstack sudo[100014]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-fb727bf5-0448-4c10-b8b0-4e7aa778ef17 tempest-TestStampPattern-1153361119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39ae3231-cf7b-4eb8-807c-f02ad56c9eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-fb727bf5-0448-4c10-b8b0-4e7aa778ef17 tempest-TestStampPattern-1153361119 None] Flow 'volume_create_manager' (bf2e63d8-560d-4a40-a88c-047b0ea8ea41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:53:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cb1b10bd-e7a5-4ff9-9aa3-a13166c5b89b tempest-VolumesGetTest-1808283213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.391s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:17 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-cb1b10bd-e7a5-4ff9-9aa3-a13166c5b89b tempest-VolumesGetTest-1808283213 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:53:17 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-cb1b10bd-e7a5-4ff9-9aa3-a13166c5b89b tempest-VolumesGetTest-1808283213 None] Deleted volume successfully.
Nov 06 11:53:17 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-fb727bf5-0448-4c10-b8b0-4e7aa778ef17 tempest-TestStampPattern-1153361119 None] Created volume successfully.
Nov 06 11:53:18 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-cb1b10bd-e7a5-4ff9-9aa3-a13166c5b89b tempest-VolumesGetTest-1808283213 None] Lock "cinder-62381b62-2dc5-4de3-bfc1-377cb236f0db-delete_volume" released by "delete_volume" :: held 1.933s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:53:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-0b1f9e26-a91a-4e08-b8cc-5dd8a60604b4 tempest-AttachVolumeTestJSON-784394024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:53:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-0b1f9e26-a91a-4e08-b8cc-5dd8a60604b4 tempest-AttachVolumeTestJSON-784394024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:53:18 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-0b1f9e26-a91a-4e08-b8cc-5dd8a60604b4 tempest-AttachVolumeTestJSON-784394024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:53:18 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-0b1f9e26-a91a-4e08-b8cc-5dd8a60604b4 tempest-AttachVolumeTestJSON-784394024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:53:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-0b1f9e26-a91a-4e08-b8cc-5dd8a60604b4 tempest-AttachVolumeTestJSON-784394024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:53:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0b1f9e26-a91a-4e08-b8cc-5dd8a60604b4 tempest-AttachVolumeTestJSON-784394024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:18 devstack sudo[100022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:53:18 devstack sudo[100022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:18 devstack sudo[100022]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0b1f9e26-a91a-4e08-b8cc-5dd8a60604b4 tempest-AttachVolumeTestJSON-784394024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.321s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:18 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-0b1f9e26-a91a-4e08-b8cc-5dd8a60604b4 tempest-AttachVolumeTestJSON-784394024 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:53:18 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-0b1f9e26-a91a-4e08-b8cc-5dd8a60604b4 tempest-AttachVolumeTestJSON-784394024 None] Deleted volume successfully.
Nov 06 11:53:18 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0b1f9e26-a91a-4e08-b8cc-5dd8a60604b4 tempest-AttachVolumeTestJSON-784394024 None] Lock "cinder-6e70bb95-2ff7-41cb-8fd9-414de9a1d8d9-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:53:18 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-f49a4ce7-bb82-415d-b7fd-f6e02444302f tempest-VolumesGetTest-1808283213 None] Acquiring lock "cinder-f096d0a9-39e7-4f09-8bc7-0c0701a7b6b7-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:53:18 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-f49a4ce7-bb82-415d-b7fd-f6e02444302f tempest-VolumesGetTest-1808283213 None] Lock "cinder-f096d0a9-39e7-4f09-8bc7-0c0701a7b6b7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:53:18 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-f49a4ce7-bb82-415d-b7fd-f6e02444302f tempest-VolumesGetTest-1808283213 None] Acquiring lock "cinder-quobyte-f096d0a9-39e7-4f09-8bc7-0c0701a7b6b7" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:53:18 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-f49a4ce7-bb82-415d-b7fd-f6e02444302f tempest-VolumesGetTest-1808283213 None] Lock "cinder-quobyte-f096d0a9-39e7-4f09-8bc7-0c0701a7b6b7" acquired by "delete_volume" :: waited 0.020s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:53:18 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51d6be2-d00b-49a8-a5a2-e806fad471d5]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:53:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f49a4ce7-bb82-415d-b7fd-f6e02444302f tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f096d0a9-39e7-4f09-8bc7-0c0701a7b6b7 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:18 devstack sudo[100025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f096d0a9-39e7-4f09-8bc7-0c0701a7b6b7
Nov 06 11:53:18 devstack sudo[100025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:18 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c33f1dcd-6b96-4b68-a40e-da15a59a4616 tempest-AttachVolumeTestJSON-784394024 None] Acquiring lock "cinder-41733ab2-68a3-4297-90d9-26c8ae688cc0-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:53:18 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c33f1dcd-6b96-4b68-a40e-da15a59a4616 tempest-AttachVolumeTestJSON-784394024 None] Lock "cinder-41733ab2-68a3-4297-90d9-26c8ae688cc0-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:53:19 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c33f1dcd-6b96-4b68-a40e-da15a59a4616 tempest-AttachVolumeTestJSON-784394024 None] Acquiring lock "cinder-quobyte-41733ab2-68a3-4297-90d9-26c8ae688cc0" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:53:19 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c33f1dcd-6b96-4b68-a40e-da15a59a4616 tempest-AttachVolumeTestJSON-784394024 None] Lock "cinder-quobyte-41733ab2-68a3-4297-90d9-26c8ae688cc0" acquired by "delete_volume" :: waited 0.032s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:53:19 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e17aec0-1d6f-43aa-9b13-71e55dc61d42]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:53:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c33f1dcd-6b96-4b68-a40e-da15a59a4616 tempest-AttachVolumeTestJSON-784394024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-41733ab2-68a3-4297-90d9-26c8ae688cc0 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:19 devstack sudo[100025]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f49a4ce7-bb82-415d-b7fd-f6e02444302f tempest-VolumesGetTest-1808283213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f096d0a9-39e7-4f09-8bc7-0c0701a7b6b7" returned: 0 in 0.520s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f49a4ce7-bb82-415d-b7fd-f6e02444302f tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f096d0a9-39e7-4f09-8bc7-0c0701a7b6b7 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:19 devstack sudo[100031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f096d0a9-39e7-4f09-8bc7-0c0701a7b6b7
Nov 06 11:53:19 devstack sudo[100031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:19 devstack sudo[100029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-41733ab2-68a3-4297-90d9-26c8ae688cc0
Nov 06 11:53:19 devstack sudo[100029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:19 devstack sudo[100031]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f49a4ce7-bb82-415d-b7fd-f6e02444302f tempest-VolumesGetTest-1808283213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f096d0a9-39e7-4f09-8bc7-0c0701a7b6b7" returned: 0 in 0.399s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:19 devstack sudo[100029]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c33f1dcd-6b96-4b68-a40e-da15a59a4616 tempest-AttachVolumeTestJSON-784394024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-41733ab2-68a3-4297-90d9-26c8ae688cc0" returned: 0 in 0.511s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c33f1dcd-6b96-4b68-a40e-da15a59a4616 tempest-AttachVolumeTestJSON-784394024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-41733ab2-68a3-4297-90d9-26c8ae688cc0 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:19 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-f49a4ce7-bb82-415d-b7fd-f6e02444302f tempest-VolumesGetTest-1808283213 None] Lock "cinder-quobyte-f096d0a9-39e7-4f09-8bc7-0c0701a7b6b7" released by "delete_volume" :: held 0.997s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:53:19 devstack sudo[100040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-41733ab2-68a3-4297-90d9-26c8ae688cc0
Nov 06 11:53:19 devstack sudo[100040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:19 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-f49a4ce7-bb82-415d-b7fd-f6e02444302f tempest-VolumesGetTest-1808283213 None] Created reservations ['197438d8-cf02-4604-83eb-e7d16125b7a4', 'affdbfd9-e922-4c09-9ed8-16677fcd649a', 'd9d9ab4b-c1f1-4c05-a2e0-4fbb292d065d', 'c114bbc2-9ec4-4363-addf-4d0a53a2c1fa'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:53:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f49a4ce7-bb82-415d-b7fd-f6e02444302f tempest-VolumesGetTest-1808283213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:53:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f49a4ce7-bb82-415d-b7fd-f6e02444302f tempest-VolumesGetTest-1808283213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:53:19 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-f49a4ce7-bb82-415d-b7fd-f6e02444302f tempest-VolumesGetTest-1808283213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:53:19 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-f49a4ce7-bb82-415d-b7fd-f6e02444302f tempest-VolumesGetTest-1808283213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:53:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f49a4ce7-bb82-415d-b7fd-f6e02444302f tempest-VolumesGetTest-1808283213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:53:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f49a4ce7-bb82-415d-b7fd-f6e02444302f tempest-VolumesGetTest-1808283213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:19 devstack sudo[100042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:53:19 devstack sudo[100042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:20 devstack sudo[100040]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c33f1dcd-6b96-4b68-a40e-da15a59a4616 tempest-AttachVolumeTestJSON-784394024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-41733ab2-68a3-4297-90d9-26c8ae688cc0" returned: 0 in 0.484s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:20 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c33f1dcd-6b96-4b68-a40e-da15a59a4616 tempest-AttachVolumeTestJSON-784394024 None] Lock "cinder-quobyte-41733ab2-68a3-4297-90d9-26c8ae688cc0" released by "delete_volume" :: held 1.075s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:53:20 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-c33f1dcd-6b96-4b68-a40e-da15a59a4616 tempest-AttachVolumeTestJSON-784394024 None] Created reservations ['42915829-931d-49c6-88ef-fb65dee7b829', 'eb32ccf3-3263-48c7-bb87-347790f4c378', '8c0fa45c-6cc8-4ea7-a779-ff73b0149eee', '295bd8e7-dbff-4397-890e-db9f1b94fbcd'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:53:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c33f1dcd-6b96-4b68-a40e-da15a59a4616 tempest-AttachVolumeTestJSON-784394024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:53:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c33f1dcd-6b96-4b68-a40e-da15a59a4616 tempest-AttachVolumeTestJSON-784394024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:53:20 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-c33f1dcd-6b96-4b68-a40e-da15a59a4616 tempest-AttachVolumeTestJSON-784394024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:53:20 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-c33f1dcd-6b96-4b68-a40e-da15a59a4616 tempest-AttachVolumeTestJSON-784394024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:53:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c33f1dcd-6b96-4b68-a40e-da15a59a4616 tempest-AttachVolumeTestJSON-784394024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:53:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c33f1dcd-6b96-4b68-a40e-da15a59a4616 tempest-AttachVolumeTestJSON-784394024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:20 devstack sudo[100042]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f49a4ce7-bb82-415d-b7fd-f6e02444302f tempest-VolumesGetTest-1808283213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.481s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:20 devstack sudo[100050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:53:20 devstack sudo[100050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:20 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-f49a4ce7-bb82-415d-b7fd-f6e02444302f tempest-VolumesGetTest-1808283213 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:53:20 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-f49a4ce7-bb82-415d-b7fd-f6e02444302f tempest-VolumesGetTest-1808283213 None] Deleted volume successfully.
Nov 06 11:53:20 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-f49a4ce7-bb82-415d-b7fd-f6e02444302f tempest-VolumesGetTest-1808283213 None] Lock "cinder-f096d0a9-39e7-4f09-8bc7-0c0701a7b6b7-delete_volume" released by "delete_volume" :: held 1.864s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:53:20 devstack sudo[100050]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c33f1dcd-6b96-4b68-a40e-da15a59a4616 tempest-AttachVolumeTestJSON-784394024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.338s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:20 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-c33f1dcd-6b96-4b68-a40e-da15a59a4616 tempest-AttachVolumeTestJSON-784394024 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:53:20 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-c33f1dcd-6b96-4b68-a40e-da15a59a4616 tempest-AttachVolumeTestJSON-784394024 None] Deleted volume successfully.
Nov 06 11:53:20 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c33f1dcd-6b96-4b68-a40e-da15a59a4616 tempest-AttachVolumeTestJSON-784394024 None] Lock "cinder-41733ab2-68a3-4297-90d9-26c8ae688cc0-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:53:21 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-3853594c-ada5-4e89-b828-4a464e1f52ba tempest-AttachVolumeTestJSON-784394024 None] Acquiring lock "cinder-fc75275c-8d0c-4d95-a63e-f8d874ccdd64-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:53:21 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-3853594c-ada5-4e89-b828-4a464e1f52ba tempest-AttachVolumeTestJSON-784394024 None] Lock "cinder-fc75275c-8d0c-4d95-a63e-f8d874ccdd64-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:53:21 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-3853594c-ada5-4e89-b828-4a464e1f52ba tempest-AttachVolumeTestJSON-784394024 None] Acquiring lock "cinder-quobyte-fc75275c-8d0c-4d95-a63e-f8d874ccdd64" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:53:21 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-3853594c-ada5-4e89-b828-4a464e1f52ba tempest-AttachVolumeTestJSON-784394024 None] Lock "cinder-quobyte-fc75275c-8d0c-4d95-a63e-f8d874ccdd64" acquired by "delete_volume" :: waited 0.021s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:53:21 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9470ec24-e688-47a8-92a4-0af0135abc48]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:53:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3853594c-ada5-4e89-b828-4a464e1f52ba tempest-AttachVolumeTestJSON-784394024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fc75275c-8d0c-4d95-a63e-f8d874ccdd64 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:21 devstack sudo[100065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fc75275c-8d0c-4d95-a63e-f8d874ccdd64
Nov 06 11:53:21 devstack sudo[100065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:21 devstack sudo[100065]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3853594c-ada5-4e89-b828-4a464e1f52ba tempest-AttachVolumeTestJSON-784394024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fc75275c-8d0c-4d95-a63e-f8d874ccdd64" returned: 0 in 0.458s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3853594c-ada5-4e89-b828-4a464e1f52ba tempest-AttachVolumeTestJSON-784394024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fc75275c-8d0c-4d95-a63e-f8d874ccdd64 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:21 devstack sudo[100071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fc75275c-8d0c-4d95-a63e-f8d874ccdd64
Nov 06 11:53:21 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:22 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3853594c-ada5-4e89-b828-4a464e1f52ba tempest-AttachVolumeTestJSON-784394024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fc75275c-8d0c-4d95-a63e-f8d874ccdd64" returned: 0 in 0.275s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:22 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-3853594c-ada5-4e89-b828-4a464e1f52ba tempest-AttachVolumeTestJSON-784394024 None] Lock "cinder-quobyte-fc75275c-8d0c-4d95-a63e-f8d874ccdd64" released by "delete_volume" :: held 0.791s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:53:22 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-3853594c-ada5-4e89-b828-4a464e1f52ba tempest-AttachVolumeTestJSON-784394024 None] Created reservations ['3ecd2609-1b3b-42dd-a044-d02d662c0b41', '1ddfead0-6b0d-468c-852b-6d4a9a3bd131', '4742de94-b402-44df-bf8f-c0beeec27e5d', 'a876ba77-f198-4919-a3cf-96ac592041f2'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:53:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3853594c-ada5-4e89-b828-4a464e1f52ba tempest-AttachVolumeTestJSON-784394024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:53:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3853594c-ada5-4e89-b828-4a464e1f52ba tempest-AttachVolumeTestJSON-784394024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:53:22 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-3853594c-ada5-4e89-b828-4a464e1f52ba tempest-AttachVolumeTestJSON-784394024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:53:22 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-3853594c-ada5-4e89-b828-4a464e1f52ba tempest-AttachVolumeTestJSON-784394024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:53:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3853594c-ada5-4e89-b828-4a464e1f52ba tempest-AttachVolumeTestJSON-784394024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:53:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3853594c-ada5-4e89-b828-4a464e1f52ba tempest-AttachVolumeTestJSON-784394024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:22 devstack sudo[100074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:53:22 devstack sudo[100074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:22 devstack sudo[100074]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3853594c-ada5-4e89-b828-4a464e1f52ba tempest-AttachVolumeTestJSON-784394024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.332s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:22 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-3853594c-ada5-4e89-b828-4a464e1f52ba tempest-AttachVolumeTestJSON-784394024 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:53:22 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-3853594c-ada5-4e89-b828-4a464e1f52ba tempest-AttachVolumeTestJSON-784394024 None] Deleted volume successfully.
Nov 06 11:53:22 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-3853594c-ada5-4e89-b828-4a464e1f52ba tempest-AttachVolumeTestJSON-784394024 None] Lock "cinder-fc75275c-8d0c-4d95-a63e-f8d874ccdd64-delete_volume" released by "delete_volume" :: held 1.394s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:53:29 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-27532249-d8f2-4015-bd03-1f7db4481315 tempest-VolumesListTestJSON-661208278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:53:29 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-27532249-d8f2-4015-bd03-1f7db4481315 tempest-VolumesListTestJSON-661208278 None] Flow 'volume_create_manager' (cc5ad377-48ab-470e-81ff-32a3ba1bbe21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:53:29 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-27532249-d8f2-4015-bd03-1f7db4481315 tempest-VolumesListTestJSON-661208278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03c99f1c-af11-4eeb-b9c3-cc1e6fff687f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:29 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-27532249-d8f2-4015-bd03-1f7db4481315 tempest-VolumesListTestJSON-661208278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03c99f1c-af11-4eeb-b9c3-cc1e6fff687f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:53:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-133169753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=593e2a88-d1b6-4b8c-b0a7-1b6d63981967,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e3909148e72944b0ab7b242af47b41a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:53:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:53:30Z,use_quota=True,user_id='e3172dc617c248179b7c3ca140ce74a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:29 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-27532249-d8f2-4015-bd03-1f7db4481315 tempest-VolumesListTestJSON-661208278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2c54c9d-b4eb-4efb-abe1-e11137550415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:29 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-27532249-d8f2-4015-bd03-1f7db4481315 tempest-VolumesListTestJSON-661208278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2c54c9d-b4eb-4efb-abe1-e11137550415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:29 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-27532249-d8f2-4015-bd03-1f7db4481315 tempest-VolumesListTestJSON-661208278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76ce4585-7020-467c-876b-d6cfae8ca319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:29 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-27532249-d8f2-4015-bd03-1f7db4481315 tempest-VolumesListTestJSON-661208278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76ce4585-7020-467c-876b-d6cfae8ca319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '593e2a88-d1b6-4b8c-b0a7-1b6d63981967', 'volume_name': 'volume-593e2a88-d1b6-4b8c-b0a7-1b6d63981967', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:29 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-27532249-d8f2-4015-bd03-1f7db4481315 tempest-VolumesListTestJSON-661208278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fc7793b-d8ee-4812-b270-fe349172bdb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:29 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-27532249-d8f2-4015-bd03-1f7db4481315 tempest-VolumesListTestJSON-661208278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fc7793b-d8ee-4812-b270-fe349172bdb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:29 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-27532249-d8f2-4015-bd03-1f7db4481315 tempest-VolumesListTestJSON-661208278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89980c87-4220-4327-8d02-eafc9df71696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:29 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-27532249-d8f2-4015-bd03-1f7db4481315 tempest-VolumesListTestJSON-661208278 None] Volume 593e2a88-d1b6-4b8c-b0a7-1b6d63981967: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-593e2a88-d1b6-4b8c-b0a7-1b6d63981967', 'volume_size': 1}
Nov 06 11:53:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-27532249-d8f2-4015-bd03-1f7db4481315 tempest-VolumesListTestJSON-661208278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:53:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-27532249-d8f2-4015-bd03-1f7db4481315 tempest-VolumesListTestJSON-661208278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:53:29 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-27532249-d8f2-4015-bd03-1f7db4481315 tempest-VolumesListTestJSON-661208278 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:53:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-133169753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=593e2a88-d1b6-4b8c-b0a7-1b6d63981967,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e3909148e72944b0ab7b242af47b41a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:53:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:53:30Z,use_quota=True,user_id='e3172dc617c248179b7c3ca140ce74a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:53:29 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-27532249-d8f2-4015-bd03-1f7db4481315 tempest-VolumesListTestJSON-661208278 None] Creating volume 593e2a88-d1b6-4b8c-b0a7-1b6d63981967 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:53:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-27532249-d8f2-4015-bd03-1f7db4481315 tempest-VolumesListTestJSON-661208278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:53:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-27532249-d8f2-4015-bd03-1f7db4481315 tempest-VolumesListTestJSON-661208278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:53:29 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-27532249-d8f2-4015-bd03-1f7db4481315 tempest-VolumesListTestJSON-661208278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:53:29 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-27532249-d8f2-4015-bd03-1f7db4481315 tempest-VolumesListTestJSON-661208278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:53:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-27532249-d8f2-4015-bd03-1f7db4481315 tempest-VolumesListTestJSON-661208278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:53:29 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-27532249-d8f2-4015-bd03-1f7db4481315 tempest-VolumesListTestJSON-661208278 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:53:29 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-27532249-d8f2-4015-bd03-1f7db4481315 tempest-VolumesListTestJSON-661208278 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:53:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-27532249-d8f2-4015-bd03-1f7db4481315 tempest-VolumesListTestJSON-661208278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-593e2a88-d1b6-4b8c-b0a7-1b6d63981967 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:29 devstack sudo[100151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-593e2a88-d1b6-4b8c-b0a7-1b6d63981967 1073741824
Nov 06 11:53:29 devstack sudo[100151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:30 devstack sudo[100151]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-27532249-d8f2-4015-bd03-1f7db4481315 tempest-VolumesListTestJSON-661208278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-593e2a88-d1b6-4b8c-b0a7-1b6d63981967 1073741824" returned: 0 in 0.717s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-27532249-d8f2-4015-bd03-1f7db4481315 tempest-VolumesListTestJSON-661208278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-593e2a88-d1b6-4b8c-b0a7-1b6d63981967 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:30 devstack sudo[100158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-593e2a88-d1b6-4b8c-b0a7-1b6d63981967
Nov 06 11:53:30 devstack sudo[100158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:31 devstack sudo[100158]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-27532249-d8f2-4015-bd03-1f7db4481315 tempest-VolumesListTestJSON-661208278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-593e2a88-d1b6-4b8c-b0a7-1b6d63981967" returned: 0 in 0.454s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:31 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-27532249-d8f2-4015-bd03-1f7db4481315 tempest-VolumesListTestJSON-661208278 None] <== create_volume: return (1259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:53:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-27532249-d8f2-4015-bd03-1f7db4481315 tempest-VolumesListTestJSON-661208278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:53:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-27532249-d8f2-4015-bd03-1f7db4481315 tempest-VolumesListTestJSON-661208278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89980c87-4220-4327-8d02-eafc9df71696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-593e2a88-d1b6-4b8c-b0a7-1b6d63981967', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-27532249-d8f2-4015-bd03-1f7db4481315 tempest-VolumesListTestJSON-661208278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (497f5bc6-e5e6-41a9-98c4-b294238b2286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:31 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-27532249-d8f2-4015-bd03-1f7db4481315 tempest-VolumesListTestJSON-661208278 None] Volume volume-593e2a88-d1b6-4b8c-b0a7-1b6d63981967 (593e2a88-d1b6-4b8c-b0a7-1b6d63981967): created successfully
Nov 06 11:53:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-27532249-d8f2-4015-bd03-1f7db4481315 tempest-VolumesListTestJSON-661208278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (497f5bc6-e5e6-41a9-98c4-b294238b2286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-27532249-d8f2-4015-bd03-1f7db4481315 tempest-VolumesListTestJSON-661208278 None] Flow 'volume_create_manager' (cc5ad377-48ab-470e-81ff-32a3ba1bbe21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:53:31 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-27532249-d8f2-4015-bd03-1f7db4481315 tempest-VolumesListTestJSON-661208278 None] Created volume successfully.
Nov 06 11:53:32 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4579a11-f5eb-490b-a0df-b71bb3090d0c tempest-VolumesListTestJSON-661208278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:53:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d4579a11-f5eb-490b-a0df-b71bb3090d0c tempest-VolumesListTestJSON-661208278 None] Flow 'volume_create_manager' (85227500-9852-48e8-828c-1e1f139c3ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:53:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d4579a11-f5eb-490b-a0df-b71bb3090d0c tempest-VolumesListTestJSON-661208278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30cfc3dd-f592-4a38-98d9-7cb0c6ca1828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d4579a11-f5eb-490b-a0df-b71bb3090d0c tempest-VolumesListTestJSON-661208278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30cfc3dd-f592-4a38-98d9-7cb0c6ca1828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:53:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-361836073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4de47092-37bb-4a94-86c8-712fa3b8f2b5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e3909148e72944b0ab7b242af47b41a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:53:32Z,use_quota=True,user_id='e3172dc617c248179b7c3ca140ce74a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d4579a11-f5eb-490b-a0df-b71bb3090d0c tempest-VolumesListTestJSON-661208278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8ead294-7dbf-4afb-8f0f-59ca7f01ccab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d4579a11-f5eb-490b-a0df-b71bb3090d0c tempest-VolumesListTestJSON-661208278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8ead294-7dbf-4afb-8f0f-59ca7f01ccab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d4579a11-f5eb-490b-a0df-b71bb3090d0c tempest-VolumesListTestJSON-661208278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (363d166d-5d1a-4d3b-a9c5-d7ad825cc7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d4579a11-f5eb-490b-a0df-b71bb3090d0c tempest-VolumesListTestJSON-661208278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (363d166d-5d1a-4d3b-a9c5-d7ad825cc7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4de47092-37bb-4a94-86c8-712fa3b8f2b5', 'volume_name': 'volume-4de47092-37bb-4a94-86c8-712fa3b8f2b5', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d4579a11-f5eb-490b-a0df-b71bb3090d0c tempest-VolumesListTestJSON-661208278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc191350-9ced-44cf-b760-0bc3da7785c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d4579a11-f5eb-490b-a0df-b71bb3090d0c tempest-VolumesListTestJSON-661208278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc191350-9ced-44cf-b760-0bc3da7785c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d4579a11-f5eb-490b-a0df-b71bb3090d0c tempest-VolumesListTestJSON-661208278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5824afe7-4149-432a-9066-2fb30b24923e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:32 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-d4579a11-f5eb-490b-a0df-b71bb3090d0c tempest-VolumesListTestJSON-661208278 None] Volume 4de47092-37bb-4a94-86c8-712fa3b8f2b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4de47092-37bb-4a94-86c8-712fa3b8f2b5', 'volume_size': 1}
Nov 06 11:53:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d4579a11-f5eb-490b-a0df-b71bb3090d0c tempest-VolumesListTestJSON-661208278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:53:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d4579a11-f5eb-490b-a0df-b71bb3090d0c tempest-VolumesListTestJSON-661208278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:53:32 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-d4579a11-f5eb-490b-a0df-b71bb3090d0c tempest-VolumesListTestJSON-661208278 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:53:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-361836073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4de47092-37bb-4a94-86c8-712fa3b8f2b5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e3909148e72944b0ab7b242af47b41a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:53:32Z,use_quota=True,user_id='e3172dc617c248179b7c3ca140ce74a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:53:32 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-d4579a11-f5eb-490b-a0df-b71bb3090d0c tempest-VolumesListTestJSON-661208278 None] Creating volume 4de47092-37bb-4a94-86c8-712fa3b8f2b5 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:53:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d4579a11-f5eb-490b-a0df-b71bb3090d0c tempest-VolumesListTestJSON-661208278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:53:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d4579a11-f5eb-490b-a0df-b71bb3090d0c tempest-VolumesListTestJSON-661208278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:53:32 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-d4579a11-f5eb-490b-a0df-b71bb3090d0c tempest-VolumesListTestJSON-661208278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:53:32 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-d4579a11-f5eb-490b-a0df-b71bb3090d0c tempest-VolumesListTestJSON-661208278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:53:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d4579a11-f5eb-490b-a0df-b71bb3090d0c tempest-VolumesListTestJSON-661208278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:53:32 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-d4579a11-f5eb-490b-a0df-b71bb3090d0c tempest-VolumesListTestJSON-661208278 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:53:32 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-d4579a11-f5eb-490b-a0df-b71bb3090d0c tempest-VolumesListTestJSON-661208278 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:53:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d4579a11-f5eb-490b-a0df-b71bb3090d0c tempest-VolumesListTestJSON-661208278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4de47092-37bb-4a94-86c8-712fa3b8f2b5 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:32 devstack sudo[100163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4de47092-37bb-4a94-86c8-712fa3b8f2b5 1073741824
Nov 06 11:53:32 devstack sudo[100163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:33 devstack sudo[100163]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d4579a11-f5eb-490b-a0df-b71bb3090d0c tempest-VolumesListTestJSON-661208278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4de47092-37bb-4a94-86c8-712fa3b8f2b5 1073741824" returned: 0 in 0.789s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d4579a11-f5eb-490b-a0df-b71bb3090d0c tempest-VolumesListTestJSON-661208278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4de47092-37bb-4a94-86c8-712fa3b8f2b5 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:33 devstack sudo[100169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4de47092-37bb-4a94-86c8-712fa3b8f2b5
Nov 06 11:53:33 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:34 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d4579a11-f5eb-490b-a0df-b71bb3090d0c tempest-VolumesListTestJSON-661208278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4de47092-37bb-4a94-86c8-712fa3b8f2b5" returned: 0 in 0.533s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:34 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-d4579a11-f5eb-490b-a0df-b71bb3090d0c tempest-VolumesListTestJSON-661208278 None] <== create_volume: return (1420ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:53:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d4579a11-f5eb-490b-a0df-b71bb3090d0c tempest-VolumesListTestJSON-661208278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.424s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:53:34 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d4579a11-f5eb-490b-a0df-b71bb3090d0c tempest-VolumesListTestJSON-661208278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5824afe7-4149-432a-9066-2fb30b24923e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4de47092-37bb-4a94-86c8-712fa3b8f2b5', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:34 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d4579a11-f5eb-490b-a0df-b71bb3090d0c tempest-VolumesListTestJSON-661208278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb26f5f6-9145-4cee-b926-37a984ccdcc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:34 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-d4579a11-f5eb-490b-a0df-b71bb3090d0c tempest-VolumesListTestJSON-661208278 None] Volume volume-4de47092-37bb-4a94-86c8-712fa3b8f2b5 (4de47092-37bb-4a94-86c8-712fa3b8f2b5): created successfully
Nov 06 11:53:34 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d4579a11-f5eb-490b-a0df-b71bb3090d0c tempest-VolumesListTestJSON-661208278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb26f5f6-9145-4cee-b926-37a984ccdcc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:34 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d4579a11-f5eb-490b-a0df-b71bb3090d0c tempest-VolumesListTestJSON-661208278 None] Flow 'volume_create_manager' (85227500-9852-48e8-828c-1e1f139c3ea7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:53:34 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-d4579a11-f5eb-490b-a0df-b71bb3090d0c tempest-VolumesListTestJSON-661208278 None] Created volume successfully.
Nov 06 11:53:36 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-53eb8ba3-f32b-4953-89e2-04d9689a5ac7 tempest-VolumesListTestJSON-661208278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:53:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-53eb8ba3-f32b-4953-89e2-04d9689a5ac7 tempest-VolumesListTestJSON-661208278 None] Flow 'volume_create_manager' (46e3c1db-0a1d-4391-b0cd-9ad85f545325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:53:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-53eb8ba3-f32b-4953-89e2-04d9689a5ac7 tempest-VolumesListTestJSON-661208278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68a4e836-368b-4cd1-81f6-e696e42be3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-53eb8ba3-f32b-4953-89e2-04d9689a5ac7 tempest-VolumesListTestJSON-661208278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68a4e836-368b-4cd1-81f6-e696e42be3f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-121340342',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dfb1128-fc25-49a1-a2fc-53104cc05ddf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e3909148e72944b0ab7b242af47b41a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:53:36Z,use_quota=True,user_id='e3172dc617c248179b7c3ca140ce74a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-53eb8ba3-f32b-4953-89e2-04d9689a5ac7 tempest-VolumesListTestJSON-661208278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e28fa9bf-220f-4958-8ac3-c84e6903cfaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-53eb8ba3-f32b-4953-89e2-04d9689a5ac7 tempest-VolumesListTestJSON-661208278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e28fa9bf-220f-4958-8ac3-c84e6903cfaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-53eb8ba3-f32b-4953-89e2-04d9689a5ac7 tempest-VolumesListTestJSON-661208278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eed8c81-24be-443c-8c95-5d2dcb64f325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-53eb8ba3-f32b-4953-89e2-04d9689a5ac7 tempest-VolumesListTestJSON-661208278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eed8c81-24be-443c-8c95-5d2dcb64f325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dfb1128-fc25-49a1-a2fc-53104cc05ddf', 'volume_name': 'volume-4dfb1128-fc25-49a1-a2fc-53104cc05ddf', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-53eb8ba3-f32b-4953-89e2-04d9689a5ac7 tempest-VolumesListTestJSON-661208278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (220f1d9d-0020-4311-a8b8-9404820ee8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-53eb8ba3-f32b-4953-89e2-04d9689a5ac7 tempest-VolumesListTestJSON-661208278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (220f1d9d-0020-4311-a8b8-9404820ee8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-53eb8ba3-f32b-4953-89e2-04d9689a5ac7 tempest-VolumesListTestJSON-661208278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4ee67fe-c965-4696-ab26-d8ae27e10ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:36 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-53eb8ba3-f32b-4953-89e2-04d9689a5ac7 tempest-VolumesListTestJSON-661208278 None] Volume 4dfb1128-fc25-49a1-a2fc-53104cc05ddf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dfb1128-fc25-49a1-a2fc-53104cc05ddf', 'volume_size': 1}
Nov 06 11:53:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-53eb8ba3-f32b-4953-89e2-04d9689a5ac7 tempest-VolumesListTestJSON-661208278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:53:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-53eb8ba3-f32b-4953-89e2-04d9689a5ac7 tempest-VolumesListTestJSON-661208278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:53:36 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-53eb8ba3-f32b-4953-89e2-04d9689a5ac7 tempest-VolumesListTestJSON-661208278 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-121340342',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dfb1128-fc25-49a1-a2fc-53104cc05ddf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e3909148e72944b0ab7b242af47b41a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:53:36Z,use_quota=True,user_id='e3172dc617c248179b7c3ca140ce74a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:53:36 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-53eb8ba3-f32b-4953-89e2-04d9689a5ac7 tempest-VolumesListTestJSON-661208278 None] Creating volume 4dfb1128-fc25-49a1-a2fc-53104cc05ddf {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:53:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-53eb8ba3-f32b-4953-89e2-04d9689a5ac7 tempest-VolumesListTestJSON-661208278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:53:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-53eb8ba3-f32b-4953-89e2-04d9689a5ac7 tempest-VolumesListTestJSON-661208278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:53:36 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-53eb8ba3-f32b-4953-89e2-04d9689a5ac7 tempest-VolumesListTestJSON-661208278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:53:36 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-53eb8ba3-f32b-4953-89e2-04d9689a5ac7 tempest-VolumesListTestJSON-661208278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:53:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-53eb8ba3-f32b-4953-89e2-04d9689a5ac7 tempest-VolumesListTestJSON-661208278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:53:36 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-53eb8ba3-f32b-4953-89e2-04d9689a5ac7 tempest-VolumesListTestJSON-661208278 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:53:36 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-53eb8ba3-f32b-4953-89e2-04d9689a5ac7 tempest-VolumesListTestJSON-661208278 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:53:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-53eb8ba3-f32b-4953-89e2-04d9689a5ac7 tempest-VolumesListTestJSON-661208278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4dfb1128-fc25-49a1-a2fc-53104cc05ddf 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:36 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [req-57150db1-a89b-465a-a4ad-0013652a259b req-84845c17-71f4-4226-b90c-8266696d213b tempest-VolumesSnapshotsTestJSON-1932056992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:53:36 devstack sudo[100175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4dfb1128-fc25-49a1-a2fc-53104cc05ddf 1073741824
Nov 06 11:53:36 devstack sudo[100175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-57150db1-a89b-465a-a4ad-0013652a259b req-84845c17-71f4-4226-b90c-8266696d213b tempest-VolumesSnapshotsTestJSON-1932056992 None] Flow 'volume_create_manager' (4e0e04a5-8527-430a-9dbf-24da73f034e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:53:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-57150db1-a89b-465a-a4ad-0013652a259b req-84845c17-71f4-4226-b90c-8266696d213b tempest-VolumesSnapshotsTestJSON-1932056992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e71653b8-edd1-409d-8ef9-060801d00d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-57150db1-a89b-465a-a4ad-0013652a259b req-84845c17-71f4-4226-b90c-8266696d213b tempest-VolumesSnapshotsTestJSON-1932056992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e71653b8-edd1-409d-8ef9-060801d00d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-757854420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=324f90ec-24b8-4996-8592-2f9a5f7749f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d967668ed1a14b5780d55add76f55878',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:53:36Z,use_quota=True,user_id='15cf68d8634f4e61a910ac9b1146fd36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-57150db1-a89b-465a-a4ad-0013652a259b req-84845c17-71f4-4226-b90c-8266696d213b tempest-VolumesSnapshotsTestJSON-1932056992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c857168-718d-4ca3-ba6f-5ee8f6c29902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-57150db1-a89b-465a-a4ad-0013652a259b req-84845c17-71f4-4226-b90c-8266696d213b tempest-VolumesSnapshotsTestJSON-1932056992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c857168-718d-4ca3-ba6f-5ee8f6c29902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-57150db1-a89b-465a-a4ad-0013652a259b req-84845c17-71f4-4226-b90c-8266696d213b tempest-VolumesSnapshotsTestJSON-1932056992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11d273ec-997d-44b4-98c8-b2c1790aef5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-57150db1-a89b-465a-a4ad-0013652a259b req-84845c17-71f4-4226-b90c-8266696d213b tempest-VolumesSnapshotsTestJSON-1932056992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11d273ec-997d-44b4-98c8-b2c1790aef5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '324f90ec-24b8-4996-8592-2f9a5f7749f7', 'volume_name': 'volume-324f90ec-24b8-4996-8592-2f9a5f7749f7', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-57150db1-a89b-465a-a4ad-0013652a259b req-84845c17-71f4-4226-b90c-8266696d213b tempest-VolumesSnapshotsTestJSON-1932056992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (922da44a-62ab-469c-9f92-d17b1b72cd2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-57150db1-a89b-465a-a4ad-0013652a259b req-84845c17-71f4-4226-b90c-8266696d213b tempest-VolumesSnapshotsTestJSON-1932056992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (922da44a-62ab-469c-9f92-d17b1b72cd2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-57150db1-a89b-465a-a4ad-0013652a259b req-84845c17-71f4-4226-b90c-8266696d213b tempest-VolumesSnapshotsTestJSON-1932056992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca637fa3-b85f-43ca-90ca-8f7518446d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:36 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [req-57150db1-a89b-465a-a4ad-0013652a259b req-84845c17-71f4-4226-b90c-8266696d213b tempest-VolumesSnapshotsTestJSON-1932056992 None] Volume 324f90ec-24b8-4996-8592-2f9a5f7749f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-324f90ec-24b8-4996-8592-2f9a5f7749f7', 'volume_size': 1}
Nov 06 11:53:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-57150db1-a89b-465a-a4ad-0013652a259b req-84845c17-71f4-4226-b90c-8266696d213b tempest-VolumesSnapshotsTestJSON-1932056992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:53:37 devstack sudo[100175]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-53eb8ba3-f32b-4953-89e2-04d9689a5ac7 tempest-VolumesListTestJSON-661208278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4dfb1128-fc25-49a1-a2fc-53104cc05ddf 1073741824" returned: 0 in 0.719s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-53eb8ba3-f32b-4953-89e2-04d9689a5ac7 tempest-VolumesListTestJSON-661208278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4dfb1128-fc25-49a1-a2fc-53104cc05ddf {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:37 devstack sudo[100181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4dfb1128-fc25-49a1-a2fc-53104cc05ddf
Nov 06 11:53:37 devstack sudo[100181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:37 devstack sudo[100181]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-53eb8ba3-f32b-4953-89e2-04d9689a5ac7 tempest-VolumesListTestJSON-661208278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4dfb1128-fc25-49a1-a2fc-53104cc05ddf" returned: 0 in 0.284s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:37 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-53eb8ba3-f32b-4953-89e2-04d9689a5ac7 tempest-VolumesListTestJSON-661208278 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:53:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-53eb8ba3-f32b-4953-89e2-04d9689a5ac7 tempest-VolumesListTestJSON-661208278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:53:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-57150db1-a89b-465a-a4ad-0013652a259b req-84845c17-71f4-4226-b90c-8266696d213b tempest-VolumesSnapshotsTestJSON-1932056992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.936s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:53:37 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [req-57150db1-a89b-465a-a4ad-0013652a259b req-84845c17-71f4-4226-b90c-8266696d213b tempest-VolumesSnapshotsTestJSON-1932056992 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-757854420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=324f90ec-24b8-4996-8592-2f9a5f7749f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d967668ed1a14b5780d55add76f55878',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:53:36Z,use_quota=True,user_id='15cf68d8634f4e61a910ac9b1146fd36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:53:37 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [req-57150db1-a89b-465a-a4ad-0013652a259b req-84845c17-71f4-4226-b90c-8266696d213b tempest-VolumesSnapshotsTestJSON-1932056992 None] Creating volume 324f90ec-24b8-4996-8592-2f9a5f7749f7 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:53:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-57150db1-a89b-465a-a4ad-0013652a259b req-84845c17-71f4-4226-b90c-8266696d213b tempest-VolumesSnapshotsTestJSON-1932056992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:53:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-57150db1-a89b-465a-a4ad-0013652a259b req-84845c17-71f4-4226-b90c-8266696d213b tempest-VolumesSnapshotsTestJSON-1932056992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:53:37 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [req-57150db1-a89b-465a-a4ad-0013652a259b req-84845c17-71f4-4226-b90c-8266696d213b tempest-VolumesSnapshotsTestJSON-1932056992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:53:37 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [req-57150db1-a89b-465a-a4ad-0013652a259b req-84845c17-71f4-4226-b90c-8266696d213b tempest-VolumesSnapshotsTestJSON-1932056992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:53:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-57150db1-a89b-465a-a4ad-0013652a259b req-84845c17-71f4-4226-b90c-8266696d213b tempest-VolumesSnapshotsTestJSON-1932056992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:53:37 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [req-57150db1-a89b-465a-a4ad-0013652a259b req-84845c17-71f4-4226-b90c-8266696d213b tempest-VolumesSnapshotsTestJSON-1932056992 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:53:37 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [req-57150db1-a89b-465a-a4ad-0013652a259b req-84845c17-71f4-4226-b90c-8266696d213b tempest-VolumesSnapshotsTestJSON-1932056992 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:53:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-57150db1-a89b-465a-a4ad-0013652a259b req-84845c17-71f4-4226-b90c-8266696d213b tempest-VolumesSnapshotsTestJSON-1932056992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-324f90ec-24b8-4996-8592-2f9a5f7749f7 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-53eb8ba3-f32b-4953-89e2-04d9689a5ac7 tempest-VolumesListTestJSON-661208278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4ee67fe-c965-4696-ab26-d8ae27e10ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dfb1128-fc25-49a1-a2fc-53104cc05ddf', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:37 devstack sudo[100184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-324f90ec-24b8-4996-8592-2f9a5f7749f7 1073741824
Nov 06 11:53:37 devstack sudo[100184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-53eb8ba3-f32b-4953-89e2-04d9689a5ac7 tempest-VolumesListTestJSON-661208278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (310854a2-a64a-4526-bddb-b8f5f6a590fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:37 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-53eb8ba3-f32b-4953-89e2-04d9689a5ac7 tempest-VolumesListTestJSON-661208278 None] Volume volume-4dfb1128-fc25-49a1-a2fc-53104cc05ddf (4dfb1128-fc25-49a1-a2fc-53104cc05ddf): created successfully
Nov 06 11:53:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-53eb8ba3-f32b-4953-89e2-04d9689a5ac7 tempest-VolumesListTestJSON-661208278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (310854a2-a64a-4526-bddb-b8f5f6a590fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-53eb8ba3-f32b-4953-89e2-04d9689a5ac7 tempest-VolumesListTestJSON-661208278 None] Flow 'volume_create_manager' (46e3c1db-0a1d-4391-b0cd-9ad85f545325) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:53:37 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-53eb8ba3-f32b-4953-89e2-04d9689a5ac7 tempest-VolumesListTestJSON-661208278 None] Created volume successfully.
Nov 06 11:53:38 devstack sudo[100184]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-57150db1-a89b-465a-a4ad-0013652a259b req-84845c17-71f4-4226-b90c-8266696d213b tempest-VolumesSnapshotsTestJSON-1932056992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-324f90ec-24b8-4996-8592-2f9a5f7749f7 1073741824" returned: 0 in 0.652s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-57150db1-a89b-465a-a4ad-0013652a259b req-84845c17-71f4-4226-b90c-8266696d213b tempest-VolumesSnapshotsTestJSON-1932056992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-324f90ec-24b8-4996-8592-2f9a5f7749f7 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:38 devstack sudo[100189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-324f90ec-24b8-4996-8592-2f9a5f7749f7
Nov 06 11:53:38 devstack sudo[100189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:38 devstack sudo[100189]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-57150db1-a89b-465a-a4ad-0013652a259b req-84845c17-71f4-4226-b90c-8266696d213b tempest-VolumesSnapshotsTestJSON-1932056992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-324f90ec-24b8-4996-8592-2f9a5f7749f7" returned: 0 in 0.389s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:38 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [req-57150db1-a89b-465a-a4ad-0013652a259b req-84845c17-71f4-4226-b90c-8266696d213b tempest-VolumesSnapshotsTestJSON-1932056992 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:53:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-57150db1-a89b-465a-a4ad-0013652a259b req-84845c17-71f4-4226-b90c-8266696d213b tempest-VolumesSnapshotsTestJSON-1932056992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:53:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-57150db1-a89b-465a-a4ad-0013652a259b req-84845c17-71f4-4226-b90c-8266696d213b tempest-VolumesSnapshotsTestJSON-1932056992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca637fa3-b85f-43ca-90ca-8f7518446d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-324f90ec-24b8-4996-8592-2f9a5f7749f7', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-57150db1-a89b-465a-a4ad-0013652a259b req-84845c17-71f4-4226-b90c-8266696d213b tempest-VolumesSnapshotsTestJSON-1932056992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1df1f241-0253-4e86-afd5-90eb95b6582e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:38 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [req-57150db1-a89b-465a-a4ad-0013652a259b req-84845c17-71f4-4226-b90c-8266696d213b tempest-VolumesSnapshotsTestJSON-1932056992 None] Volume volume-324f90ec-24b8-4996-8592-2f9a5f7749f7 (324f90ec-24b8-4996-8592-2f9a5f7749f7): created successfully
Nov 06 11:53:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-57150db1-a89b-465a-a4ad-0013652a259b req-84845c17-71f4-4226-b90c-8266696d213b tempest-VolumesSnapshotsTestJSON-1932056992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1df1f241-0253-4e86-afd5-90eb95b6582e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-57150db1-a89b-465a-a4ad-0013652a259b req-84845c17-71f4-4226-b90c-8266696d213b tempest-VolumesSnapshotsTestJSON-1932056992 None] Flow 'volume_create_manager' (4e0e04a5-8527-430a-9dbf-24da73f034e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:53:38 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-57150db1-a89b-465a-a4ad-0013652a259b req-84845c17-71f4-4226-b90c-8266696d213b tempest-VolumesSnapshotsTestJSON-1932056992 None] Created volume successfully.
Nov 06 11:53:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-dd60ca4f-c04e-47cd-8f8f-e00743a12866 req-64856db6-f593-46e4-b9e0-75c8c7cc6d17 tempest-VolumesSnapshotsTestJSON-1932056992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:53:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-dd60ca4f-c04e-47cd-8f8f-e00743a12866 req-64856db6-f593-46e4-b9e0-75c8c7cc6d17 tempest-VolumesSnapshotsTestJSON-1932056992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:53:39 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [req-dd60ca4f-c04e-47cd-8f8f-e00743a12866 req-64856db6-f593-46e4-b9e0-75c8c7cc6d17 tempest-VolumesSnapshotsTestJSON-1932056992 None] Creating offline snapshot 6b4b3715-8356-448f-beb2-c7af3f8126a8 of volume 324f90ec-24b8-4996-8592-2f9a5f7749f7 {{(pid=87165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 11:53:40 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a35c38-8d67-44a4-b508-4e2acb442cd0]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:53:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-dd60ca4f-c04e-47cd-8f8f-e00743a12866 req-64856db6-f593-46e4-b9e0-75c8c7cc6d17 tempest-VolumesSnapshotsTestJSON-1932056992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-324f90ec-24b8-4996-8592-2f9a5f7749f7 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:40 devstack sudo[100192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-324f90ec-24b8-4996-8592-2f9a5f7749f7
Nov 06 11:53:40 devstack sudo[100192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:40 devstack sudo[100192]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-dd60ca4f-c04e-47cd-8f8f-e00743a12866 req-64856db6-f593-46e4-b9e0-75c8c7cc6d17 tempest-VolumesSnapshotsTestJSON-1932056992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-324f90ec-24b8-4996-8592-2f9a5f7749f7" returned: 0 in 0.931s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-dd60ca4f-c04e-47cd-8f8f-e00743a12866 req-64856db6-f593-46e4-b9e0-75c8c7cc6d17 tempest-VolumesSnapshotsTestJSON-1932056992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-324f90ec-24b8-4996-8592-2f9a5f7749f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-324f90ec-24b8-4996-8592-2f9a5f7749f7.6b4b3715-8356-448f-beb2-c7af3f8126a8 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:41 devstack sudo[100222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-324f90ec-24b8-4996-8592-2f9a5f7749f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-324f90ec-24b8-4996-8592-2f9a5f7749f7.6b4b3715-8356-448f-beb2-c7af3f8126a8 1G
Nov 06 11:53:41 devstack sudo[100222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:41 devstack sudo[100222]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-dd60ca4f-c04e-47cd-8f8f-e00743a12866 req-64856db6-f593-46e4-b9e0-75c8c7cc6d17 tempest-VolumesSnapshotsTestJSON-1932056992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-324f90ec-24b8-4996-8592-2f9a5f7749f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-324f90ec-24b8-4996-8592-2f9a5f7749f7.6b4b3715-8356-448f-beb2-c7af3f8126a8 1G" returned: 0 in 0.578s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-dd60ca4f-c04e-47cd-8f8f-e00743a12866 req-64856db6-f593-46e4-b9e0-75c8c7cc6d17 tempest-VolumesSnapshotsTestJSON-1932056992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-324f90ec-24b8-4996-8592-2f9a5f7749f7 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-324f90ec-24b8-4996-8592-2f9a5f7749f7.6b4b3715-8356-448f-beb2-c7af3f8126a8 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:41 devstack sudo[100228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-324f90ec-24b8-4996-8592-2f9a5f7749f7 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-324f90ec-24b8-4996-8592-2f9a5f7749f7.6b4b3715-8356-448f-beb2-c7af3f8126a8
Nov 06 11:53:41 devstack sudo[100228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:41 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-7be0775f-15b4-4397-ad4e-5b0e764e31a9 tempest-VolumesListTestJSON-661208278 None] Acquiring lock "cinder-4dfb1128-fc25-49a1-a2fc-53104cc05ddf-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:53:41 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-7be0775f-15b4-4397-ad4e-5b0e764e31a9 tempest-VolumesListTestJSON-661208278 None] Lock "cinder-4dfb1128-fc25-49a1-a2fc-53104cc05ddf-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:53:41 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-7be0775f-15b4-4397-ad4e-5b0e764e31a9 tempest-VolumesListTestJSON-661208278 None] Acquiring lock "cinder-quobyte-4dfb1128-fc25-49a1-a2fc-53104cc05ddf" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:53:41 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-7be0775f-15b4-4397-ad4e-5b0e764e31a9 tempest-VolumesListTestJSON-661208278 None] Lock "cinder-quobyte-4dfb1128-fc25-49a1-a2fc-53104cc05ddf" acquired by "delete_volume" :: waited 0.025s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:53:41 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfd451a-0fbc-4d4a-8f3a-6d344a13d90a]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:53:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7be0775f-15b4-4397-ad4e-5b0e764e31a9 tempest-VolumesListTestJSON-661208278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4dfb1128-fc25-49a1-a2fc-53104cc05ddf {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:41 devstack sudo[100228]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-dd60ca4f-c04e-47cd-8f8f-e00743a12866 req-64856db6-f593-46e4-b9e0-75c8c7cc6d17 tempest-VolumesSnapshotsTestJSON-1932056992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-324f90ec-24b8-4996-8592-2f9a5f7749f7 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-324f90ec-24b8-4996-8592-2f9a5f7749f7.6b4b3715-8356-448f-beb2-c7af3f8126a8" returned: 0 in 0.405s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:41 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [req-dd60ca4f-c04e-47cd-8f8f-e00743a12866 req-64856db6-f593-46e4-b9e0-75c8c7cc6d17 tempest-VolumesSnapshotsTestJSON-1932056992 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-324f90ec-24b8-4996-8592-2f9a5f7749f7.6b4b3715-8356-448f-beb2-c7af3f8126a8 is being set with open permissions: ugo+rw
Nov 06 11:53:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-dd60ca4f-c04e-47cd-8f8f-e00743a12866 req-64856db6-f593-46e4-b9e0-75c8c7cc6d17 tempest-VolumesSnapshotsTestJSON-1932056992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-324f90ec-24b8-4996-8592-2f9a5f7749f7.6b4b3715-8356-448f-beb2-c7af3f8126a8 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:41 devstack sudo[100235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-324f90ec-24b8-4996-8592-2f9a5f7749f7.6b4b3715-8356-448f-beb2-c7af3f8126a8
Nov 06 11:53:41 devstack sudo[100235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:41 devstack sudo[100233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4dfb1128-fc25-49a1-a2fc-53104cc05ddf
Nov 06 11:53:41 devstack sudo[100233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:42 devstack sudo[100235]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-dd60ca4f-c04e-47cd-8f8f-e00743a12866 req-64856db6-f593-46e4-b9e0-75c8c7cc6d17 tempest-VolumesSnapshotsTestJSON-1932056992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-324f90ec-24b8-4996-8592-2f9a5f7749f7.6b4b3715-8356-448f-beb2-c7af3f8126a8" returned: 0 in 0.269s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-dd60ca4f-c04e-47cd-8f8f-e00743a12866 req-64856db6-f593-46e4-b9e0-75c8c7cc6d17 tempest-VolumesSnapshotsTestJSON-1932056992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-324f90ec-24b8-4996-8592-2f9a5f7749f7.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:42 devstack sudo[100233]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7be0775f-15b4-4397-ad4e-5b0e764e31a9 tempest-VolumesListTestJSON-661208278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4dfb1128-fc25-49a1-a2fc-53104cc05ddf" returned: 0 in 0.384s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7be0775f-15b4-4397-ad4e-5b0e764e31a9 tempest-VolumesListTestJSON-661208278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4dfb1128-fc25-49a1-a2fc-53104cc05ddf {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:42 devstack sudo[100242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-324f90ec-24b8-4996-8592-2f9a5f7749f7.info
Nov 06 11:53:42 devstack sudo[100242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:42 devstack sudo[100243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4dfb1128-fc25-49a1-a2fc-53104cc05ddf
Nov 06 11:53:42 devstack sudo[100243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:42 devstack sudo[100243]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7be0775f-15b4-4397-ad4e-5b0e764e31a9 tempest-VolumesListTestJSON-661208278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4dfb1128-fc25-49a1-a2fc-53104cc05ddf" returned: 0 in 0.255s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:42 devstack sudo[100242]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-dd60ca4f-c04e-47cd-8f8f-e00743a12866 req-64856db6-f593-46e4-b9e0-75c8c7cc6d17 tempest-VolumesSnapshotsTestJSON-1932056992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-324f90ec-24b8-4996-8592-2f9a5f7749f7.info" returned: 0 in 0.292s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:42 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [req-dd60ca4f-c04e-47cd-8f8f-e00743a12866 req-64856db6-f593-46e4-b9e0-75c8c7cc6d17 tempest-VolumesSnapshotsTestJSON-1932056992 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-324f90ec-24b8-4996-8592-2f9a5f7749f7.info is being set with open permissions: ugo+rw
Nov 06 11:53:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-dd60ca4f-c04e-47cd-8f8f-e00743a12866 req-64856db6-f593-46e4-b9e0-75c8c7cc6d17 tempest-VolumesSnapshotsTestJSON-1932056992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-324f90ec-24b8-4996-8592-2f9a5f7749f7.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:42 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-7be0775f-15b4-4397-ad4e-5b0e764e31a9 tempest-VolumesListTestJSON-661208278 None] Lock "cinder-quobyte-4dfb1128-fc25-49a1-a2fc-53104cc05ddf" released by "delete_volume" :: held 0.706s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:53:42 devstack sudo[100248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-324f90ec-24b8-4996-8592-2f9a5f7749f7.info
Nov 06 11:53:42 devstack sudo[100248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:42 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-7be0775f-15b4-4397-ad4e-5b0e764e31a9 tempest-VolumesListTestJSON-661208278 None] Created reservations ['c099c8cd-a6fd-483c-a1a6-399000a91661', '59a81a72-4a5b-4ef9-8ad8-f03553436ff3', 'd55cde08-b733-4730-b740-ce10aeaee1c0', '47b230a1-8aaa-43f1-afc9-a4c55d8c2da4'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:53:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-7be0775f-15b4-4397-ad4e-5b0e764e31a9 tempest-VolumesListTestJSON-661208278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:53:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-7be0775f-15b4-4397-ad4e-5b0e764e31a9 tempest-VolumesListTestJSON-661208278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:53:42 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-7be0775f-15b4-4397-ad4e-5b0e764e31a9 tempest-VolumesListTestJSON-661208278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:53:42 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-7be0775f-15b4-4397-ad4e-5b0e764e31a9 tempest-VolumesListTestJSON-661208278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:53:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-7be0775f-15b4-4397-ad4e-5b0e764e31a9 tempest-VolumesListTestJSON-661208278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:53:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7be0775f-15b4-4397-ad4e-5b0e764e31a9 tempest-VolumesListTestJSON-661208278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:42 devstack sudo[100250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:53:42 devstack sudo[100250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:42 devstack sudo[100248]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-dd60ca4f-c04e-47cd-8f8f-e00743a12866 req-64856db6-f593-46e4-b9e0-75c8c7cc6d17 tempest-VolumesSnapshotsTestJSON-1932056992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-324f90ec-24b8-4996-8592-2f9a5f7749f7.info" returned: 0 in 0.302s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-dd60ca4f-c04e-47cd-8f8f-e00743a12866 req-64856db6-f593-46e4-b9e0-75c8c7cc6d17 tempest-VolumesSnapshotsTestJSON-1932056992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.963s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:53:42 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-dd60ca4f-c04e-47cd-8f8f-e00743a12866 req-64856db6-f593-46e4-b9e0-75c8c7cc6d17 tempest-VolumesSnapshotsTestJSON-1932056992 None] Create snapshot completed successfully
Nov 06 11:53:43 devstack sudo[100250]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7be0775f-15b4-4397-ad4e-5b0e764e31a9 tempest-VolumesListTestJSON-661208278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.297s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:43 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-7be0775f-15b4-4397-ad4e-5b0e764e31a9 tempest-VolumesListTestJSON-661208278 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:53:43 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-7be0775f-15b4-4397-ad4e-5b0e764e31a9 tempest-VolumesListTestJSON-661208278 None] Deleted volume successfully.
Nov 06 11:53:43 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0556fffa-76d4-4dde-8bc8-b2ffee8bee63 tempest-VolumesListTestJSON-661208278 None] Acquiring lock "cinder-4de47092-37bb-4a94-86c8-712fa3b8f2b5-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:53:43 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-7be0775f-15b4-4397-ad4e-5b0e764e31a9 tempest-VolumesListTestJSON-661208278 None] Lock "cinder-4dfb1128-fc25-49a1-a2fc-53104cc05ddf-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:53:43 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0556fffa-76d4-4dde-8bc8-b2ffee8bee63 tempest-VolumesListTestJSON-661208278 None] Lock "cinder-4de47092-37bb-4a94-86c8-712fa3b8f2b5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:53:43 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0556fffa-76d4-4dde-8bc8-b2ffee8bee63 tempest-VolumesListTestJSON-661208278 None] Acquiring lock "cinder-quobyte-4de47092-37bb-4a94-86c8-712fa3b8f2b5" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:53:43 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0556fffa-76d4-4dde-8bc8-b2ffee8bee63 tempest-VolumesListTestJSON-661208278 None] Lock "cinder-quobyte-4de47092-37bb-4a94-86c8-712fa3b8f2b5" acquired by "delete_volume" :: waited 0.027s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:53:43 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd44e2e-0127-47cd-bcea-1c6913159a1d]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:53:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0556fffa-76d4-4dde-8bc8-b2ffee8bee63 tempest-VolumesListTestJSON-661208278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4de47092-37bb-4a94-86c8-712fa3b8f2b5 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:43 devstack sudo[100255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4de47092-37bb-4a94-86c8-712fa3b8f2b5
Nov 06 11:53:43 devstack sudo[100255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:43 devstack sudo[100255]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0556fffa-76d4-4dde-8bc8-b2ffee8bee63 tempest-VolumesListTestJSON-661208278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4de47092-37bb-4a94-86c8-712fa3b8f2b5" returned: 0 in 0.388s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0556fffa-76d4-4dde-8bc8-b2ffee8bee63 tempest-VolumesListTestJSON-661208278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4de47092-37bb-4a94-86c8-712fa3b8f2b5 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:43 devstack sudo[100260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4de47092-37bb-4a94-86c8-712fa3b8f2b5
Nov 06 11:53:43 devstack sudo[100260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:43 devstack cinder-volume[87165]: DEBUG cinder.coordination [req-36c73a44-9d91-426e-bdb5-6aef8a94b919 req-f7bdc7bd-823e-49bb-af4a-9c19f14cf500 tempest-VolumesSnapshotsTestJSON-1932056992 None] Acquiring lock "cinder-6b4b3715-8356-448f-beb2-c7af3f8126a8-delete_snapshot" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:53:43 devstack cinder-volume[87165]: DEBUG cinder.coordination [req-36c73a44-9d91-426e-bdb5-6aef8a94b919 req-f7bdc7bd-823e-49bb-af4a-9c19f14cf500 tempest-VolumesSnapshotsTestJSON-1932056992 None] Lock "cinder-6b4b3715-8356-448f-beb2-c7af3f8126a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:53:43 devstack cinder-volume[87165]: DEBUG cinder.coordination [req-36c73a44-9d91-426e-bdb5-6aef8a94b919 req-f7bdc7bd-823e-49bb-af4a-9c19f14cf500 tempest-VolumesSnapshotsTestJSON-1932056992 None] Acquiring lock "cinder-quobyte-324f90ec-24b8-4996-8592-2f9a5f7749f7" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:53:43 devstack cinder-volume[87165]: DEBUG cinder.coordination [req-36c73a44-9d91-426e-bdb5-6aef8a94b919 req-f7bdc7bd-823e-49bb-af4a-9c19f14cf500 tempest-VolumesSnapshotsTestJSON-1932056992 None] Lock "cinder-quobyte-324f90ec-24b8-4996-8592-2f9a5f7749f7" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:53:43 devstack cinder-volume[87165]: DEBUG cinder.coordination [req-36c73a44-9d91-426e-bdb5-6aef8a94b919 req-f7bdc7bd-823e-49bb-af4a-9c19f14cf500 tempest-VolumesSnapshotsTestJSON-1932056992 None] Acquiring lock "cinder-quobyte-6b4b3715-8356-448f-beb2-c7af3f8126a8" by "_delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:53:43 devstack cinder-volume[87165]: DEBUG cinder.coordination [req-36c73a44-9d91-426e-bdb5-6aef8a94b919 req-f7bdc7bd-823e-49bb-af4a-9c19f14cf500 tempest-VolumesSnapshotsTestJSON-1932056992 None] Lock "cinder-quobyte-6b4b3715-8356-448f-beb2-c7af3f8126a8" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:53:43 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [req-36c73a44-9d91-426e-bdb5-6aef8a94b919 req-f7bdc7bd-823e-49bb-af4a-9c19f14cf500 tempest-VolumesSnapshotsTestJSON-1932056992 None] Deleting offline snapshot 6b4b3715-8356-448f-beb2-c7af3f8126a8 of volume 324f90ec-24b8-4996-8592-2f9a5f7749f7 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 11:53:43 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [req-36c73a44-9d91-426e-bdb5-6aef8a94b919 req-f7bdc7bd-823e-49bb-af4a-9c19f14cf500 tempest-VolumesSnapshotsTestJSON-1932056992 None] snapshot_file for this snap is: volume-324f90ec-24b8-4996-8592-2f9a5f7749f7.6b4b3715-8356-448f-beb2-c7af3f8126a8 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 11:53:43 devstack sudo[100260]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0556fffa-76d4-4dde-8bc8-b2ffee8bee63 tempest-VolumesListTestJSON-661208278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4de47092-37bb-4a94-86c8-712fa3b8f2b5" returned: 0 in 0.302s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:43 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0556fffa-76d4-4dde-8bc8-b2ffee8bee63 tempest-VolumesListTestJSON-661208278 None] Lock "cinder-quobyte-4de47092-37bb-4a94-86c8-712fa3b8f2b5" released by "delete_volume" :: held 0.736s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:53:43 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0327b2c5-0476-4edd-9a37-bc7e100926a6]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:53:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-36c73a44-9d91-426e-bdb5-6aef8a94b919 req-f7bdc7bd-823e-49bb-af4a-9c19f14cf500 tempest-VolumesSnapshotsTestJSON-1932056992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-324f90ec-24b8-4996-8592-2f9a5f7749f7.6b4b3715-8356-448f-beb2-c7af3f8126a8 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:43 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-0556fffa-76d4-4dde-8bc8-b2ffee8bee63 tempest-VolumesListTestJSON-661208278 None] Created reservations ['2e165f62-3bb2-442d-b976-d5443ed58ac4', '62aec170-f250-412d-b83d-d941755e7433', 'a5d3b637-b025-4d96-b93b-3f48b6163876', 'd90e7c04-6efc-4fea-995d-e5015152be5a'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:53:44 devstack sudo[100263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-324f90ec-24b8-4996-8592-2f9a5f7749f7.6b4b3715-8356-448f-beb2-c7af3f8126a8
Nov 06 11:53:44 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-0556fffa-76d4-4dde-8bc8-b2ffee8bee63 tempest-VolumesListTestJSON-661208278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:53:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-0556fffa-76d4-4dde-8bc8-b2ffee8bee63 tempest-VolumesListTestJSON-661208278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:53:44 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-0556fffa-76d4-4dde-8bc8-b2ffee8bee63 tempest-VolumesListTestJSON-661208278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:53:44 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-0556fffa-76d4-4dde-8bc8-b2ffee8bee63 tempest-VolumesListTestJSON-661208278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:53:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-0556fffa-76d4-4dde-8bc8-b2ffee8bee63 tempest-VolumesListTestJSON-661208278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:53:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0556fffa-76d4-4dde-8bc8-b2ffee8bee63 tempest-VolumesListTestJSON-661208278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:44 devstack sudo[100265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:53:44 devstack sudo[100265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:44 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-11bfee61-1518-4353-b2eb-b8cb897b68f7 tempest-VolumesListTestJSON-661208278 None] Acquiring lock "cinder-593e2a88-d1b6-4b8c-b0a7-1b6d63981967-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:53:44 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-36c73a44-9d91-426e-bdb5-6aef8a94b919 req-f7bdc7bd-823e-49bb-af4a-9c19f14cf500 tempest-VolumesSnapshotsTestJSON-1932056992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-324f90ec-24b8-4996-8592-2f9a5f7749f7.6b4b3715-8356-448f-beb2-c7af3f8126a8" returned: 0 in 0.446s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:44 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [req-36c73a44-9d91-426e-bdb5-6aef8a94b919 req-f7bdc7bd-823e-49bb-af4a-9c19f14cf500 tempest-VolumesSnapshotsTestJSON-1932056992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-324f90ec-24b8-4996-8592-2f9a5f7749f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:53:44 devstack sudo[100265]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:44 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-11bfee61-1518-4353-b2eb-b8cb897b68f7 tempest-VolumesListTestJSON-661208278 None] Lock "cinder-593e2a88-d1b6-4b8c-b0a7-1b6d63981967-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:53:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0556fffa-76d4-4dde-8bc8-b2ffee8bee63 tempest-VolumesListTestJSON-661208278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.343s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:44 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-0556fffa-76d4-4dde-8bc8-b2ffee8bee63 tempest-VolumesListTestJSON-661208278 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:53:44 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6403e0-d9dc-44d9-8433-7ec5e41fed0a]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:53:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-36c73a44-9d91-426e-bdb5-6aef8a94b919 req-f7bdc7bd-823e-49bb-af4a-9c19f14cf500 tempest-VolumesSnapshotsTestJSON-1932056992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-324f90ec-24b8-4996-8592-2f9a5f7749f7 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:44 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-0556fffa-76d4-4dde-8bc8-b2ffee8bee63 tempest-VolumesListTestJSON-661208278 None] Deleted volume successfully.
Nov 06 11:53:44 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0556fffa-76d4-4dde-8bc8-b2ffee8bee63 tempest-VolumesListTestJSON-661208278 None] Lock "cinder-4de47092-37bb-4a94-86c8-712fa3b8f2b5-delete_volume" released by "delete_volume" :: held 1.357s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:53:44 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-11bfee61-1518-4353-b2eb-b8cb897b68f7 tempest-VolumesListTestJSON-661208278 None] Acquiring lock "cinder-quobyte-593e2a88-d1b6-4b8c-b0a7-1b6d63981967" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:53:44 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-11bfee61-1518-4353-b2eb-b8cb897b68f7 tempest-VolumesListTestJSON-661208278 None] Lock "cinder-quobyte-593e2a88-d1b6-4b8c-b0a7-1b6d63981967" acquired by "delete_volume" :: waited 0.015s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:53:44 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[246d6366-5966-4209-8725-098e91bc918c]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:53:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-11bfee61-1518-4353-b2eb-b8cb897b68f7 tempest-VolumesListTestJSON-661208278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-593e2a88-d1b6-4b8c-b0a7-1b6d63981967 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:44 devstack sudo[100272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-324f90ec-24b8-4996-8592-2f9a5f7749f7
Nov 06 11:53:44 devstack sudo[100272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:44 devstack sudo[100274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-593e2a88-d1b6-4b8c-b0a7-1b6d63981967
Nov 06 11:53:44 devstack sudo[100274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:44 devstack sudo[100272]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-36c73a44-9d91-426e-bdb5-6aef8a94b919 req-f7bdc7bd-823e-49bb-af4a-9c19f14cf500 tempest-VolumesSnapshotsTestJSON-1932056992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-324f90ec-24b8-4996-8592-2f9a5f7749f7" returned: 0 in 0.395s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-36c73a44-9d91-426e-bdb5-6aef8a94b919 req-f7bdc7bd-823e-49bb-af4a-9c19f14cf500 tempest-VolumesSnapshotsTestJSON-1932056992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-324f90ec-24b8-4996-8592-2f9a5f7749f7.6b4b3715-8356-448f-beb2-c7af3f8126a8 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:44 devstack sudo[100281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-324f90ec-24b8-4996-8592-2f9a5f7749f7.6b4b3715-8356-448f-beb2-c7af3f8126a8
Nov 06 11:53:44 devstack sudo[100281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:44 devstack sudo[100274]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-11bfee61-1518-4353-b2eb-b8cb897b68f7 tempest-VolumesListTestJSON-661208278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-593e2a88-d1b6-4b8c-b0a7-1b6d63981967" returned: 0 in 0.487s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-11bfee61-1518-4353-b2eb-b8cb897b68f7 tempest-VolumesListTestJSON-661208278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-593e2a88-d1b6-4b8c-b0a7-1b6d63981967 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:45 devstack sudo[100286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-593e2a88-d1b6-4b8c-b0a7-1b6d63981967
Nov 06 11:53:45 devstack sudo[100286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:45 devstack sudo[100281]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-36c73a44-9d91-426e-bdb5-6aef8a94b919 req-f7bdc7bd-823e-49bb-af4a-9c19f14cf500 tempest-VolumesSnapshotsTestJSON-1932056992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-324f90ec-24b8-4996-8592-2f9a5f7749f7.6b4b3715-8356-448f-beb2-c7af3f8126a8" returned: 0 in 0.456s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-36c73a44-9d91-426e-bdb5-6aef8a94b919 req-f7bdc7bd-823e-49bb-af4a-9c19f14cf500 tempest-VolumesSnapshotsTestJSON-1932056992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-324f90ec-24b8-4996-8592-2f9a5f7749f7.6b4b3715-8356-448f-beb2-c7af3f8126a8 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:45 devstack sudo[100286]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-11bfee61-1518-4353-b2eb-b8cb897b68f7 tempest-VolumesListTestJSON-661208278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-593e2a88-d1b6-4b8c-b0a7-1b6d63981967" returned: 0 in 0.288s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:45 devstack sudo[100295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-324f90ec-24b8-4996-8592-2f9a5f7749f7.6b4b3715-8356-448f-beb2-c7af3f8126a8
Nov 06 11:53:45 devstack sudo[100295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:45 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-11bfee61-1518-4353-b2eb-b8cb897b68f7 tempest-VolumesListTestJSON-661208278 None] Lock "cinder-quobyte-593e2a88-d1b6-4b8c-b0a7-1b6d63981967" released by "delete_volume" :: held 0.823s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:53:45 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-11bfee61-1518-4353-b2eb-b8cb897b68f7 tempest-VolumesListTestJSON-661208278 None] Created reservations ['f45d8337-9b03-4ab6-8f7c-e784a80eb291', '03856643-1d7e-45c5-a70f-2150db580afc', 'c37b6a10-3c75-4132-8554-66125172d1b7', '6246807f-d752-4b9b-8350-2c3c31a9d54a'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:53:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-11bfee61-1518-4353-b2eb-b8cb897b68f7 tempest-VolumesListTestJSON-661208278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:53:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-11bfee61-1518-4353-b2eb-b8cb897b68f7 tempest-VolumesListTestJSON-661208278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:53:45 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-11bfee61-1518-4353-b2eb-b8cb897b68f7 tempest-VolumesListTestJSON-661208278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:53:45 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-11bfee61-1518-4353-b2eb-b8cb897b68f7 tempest-VolumesListTestJSON-661208278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:53:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-11bfee61-1518-4353-b2eb-b8cb897b68f7 tempest-VolumesListTestJSON-661208278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:53:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-11bfee61-1518-4353-b2eb-b8cb897b68f7 tempest-VolumesListTestJSON-661208278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:45 devstack sudo[100297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:53:45 devstack sudo[100297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:45 devstack sudo[100295]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-36c73a44-9d91-426e-bdb5-6aef8a94b919 req-f7bdc7bd-823e-49bb-af4a-9c19f14cf500 tempest-VolumesSnapshotsTestJSON-1932056992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-324f90ec-24b8-4996-8592-2f9a5f7749f7.6b4b3715-8356-448f-beb2-c7af3f8126a8" returned: 0 in 0.315s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:45 devstack cinder-volume[87165]: DEBUG cinder.coordination [req-36c73a44-9d91-426e-bdb5-6aef8a94b919 req-f7bdc7bd-823e-49bb-af4a-9c19f14cf500 tempest-VolumesSnapshotsTestJSON-1932056992 None] Lock "cinder-quobyte-6b4b3715-8356-448f-beb2-c7af3f8126a8" released by "_delete_snapshot" :: held 1.787s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:53:45 devstack cinder-volume[87165]: DEBUG cinder.coordination [req-36c73a44-9d91-426e-bdb5-6aef8a94b919 req-f7bdc7bd-823e-49bb-af4a-9c19f14cf500 tempest-VolumesSnapshotsTestJSON-1932056992 None] Lock "cinder-quobyte-324f90ec-24b8-4996-8592-2f9a5f7749f7" released by "delete_snapshot" :: held 1.823s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:53:45 devstack cinder-volume[87165]: DEBUG cinder.quota [req-36c73a44-9d91-426e-bdb5-6aef8a94b919 req-f7bdc7bd-823e-49bb-af4a-9c19f14cf500 tempest-VolumesSnapshotsTestJSON-1932056992 None] Created reservations ['e27245b4-845f-44c2-8db4-4a838a3e5cfa', '817d48db-9301-42ac-8232-3319d7fd853f', '0e680648-4545-4d12-88a2-98f469c200a9', 'fb259342-3207-4f8b-b297-ce0d36d3403c'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:53:45 devstack sudo[100297]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-11bfee61-1518-4353-b2eb-b8cb897b68f7 tempest-VolumesListTestJSON-661208278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.294s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:45 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-11bfee61-1518-4353-b2eb-b8cb897b68f7 tempest-VolumesListTestJSON-661208278 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:53:45 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-11bfee61-1518-4353-b2eb-b8cb897b68f7 tempest-VolumesListTestJSON-661208278 None] Deleted volume successfully.
Nov 06 11:53:45 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-11bfee61-1518-4353-b2eb-b8cb897b68f7 tempest-VolumesListTestJSON-661208278 None] Lock "cinder-593e2a88-d1b6-4b8c-b0a7-1b6d63981967-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:53:45 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-36c73a44-9d91-426e-bdb5-6aef8a94b919 req-f7bdc7bd-823e-49bb-af4a-9c19f14cf500 tempest-VolumesSnapshotsTestJSON-1932056992 None] Delete snapshot completed successfully.
Nov 06 11:53:45 devstack cinder-volume[87165]: DEBUG cinder.coordination [req-36c73a44-9d91-426e-bdb5-6aef8a94b919 req-f7bdc7bd-823e-49bb-af4a-9c19f14cf500 tempest-VolumesSnapshotsTestJSON-1932056992 None] Lock "cinder-6b4b3715-8356-448f-beb2-c7af3f8126a8-delete_snapshot" released by "delete_snapshot" :: held 2.029s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:53:46 devstack cinder-volume[87165]: DEBUG cinder.coordination [req-70d0a2ea-4dc3-4ca8-8b6a-2acdc7f6573e req-4f7f4ef5-51f2-4995-bb45-94b9d30a9037 tempest-VolumesSnapshotsTestJSON-1932056992 None] Acquiring lock "cinder-324f90ec-24b8-4996-8592-2f9a5f7749f7-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:53:46 devstack cinder-volume[87165]: DEBUG cinder.coordination [req-70d0a2ea-4dc3-4ca8-8b6a-2acdc7f6573e req-4f7f4ef5-51f2-4995-bb45-94b9d30a9037 tempest-VolumesSnapshotsTestJSON-1932056992 None] Lock "cinder-324f90ec-24b8-4996-8592-2f9a5f7749f7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:53:46 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:SELECT=107,cinder:UPDATE=149,cinder:INSERT=43,cinder:DELETE=9 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 11:53:46 devstack cinder-volume[87165]: DEBUG cinder.coordination [req-70d0a2ea-4dc3-4ca8-8b6a-2acdc7f6573e req-4f7f4ef5-51f2-4995-bb45-94b9d30a9037 tempest-VolumesSnapshotsTestJSON-1932056992 None] Acquiring lock "cinder-quobyte-324f90ec-24b8-4996-8592-2f9a5f7749f7" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:53:46 devstack cinder-volume[87165]: DEBUG cinder.coordination [req-70d0a2ea-4dc3-4ca8-8b6a-2acdc7f6573e req-4f7f4ef5-51f2-4995-bb45-94b9d30a9037 tempest-VolumesSnapshotsTestJSON-1932056992 None] Lock "cinder-quobyte-324f90ec-24b8-4996-8592-2f9a5f7749f7" acquired by "delete_volume" :: waited 0.018s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:53:46 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[cacf9ae4-c0cc-461b-bf31-0028617a53e6]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:53:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-70d0a2ea-4dc3-4ca8-8b6a-2acdc7f6573e req-4f7f4ef5-51f2-4995-bb45-94b9d30a9037 tempest-VolumesSnapshotsTestJSON-1932056992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-324f90ec-24b8-4996-8592-2f9a5f7749f7 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:46 devstack sudo[100301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-324f90ec-24b8-4996-8592-2f9a5f7749f7
Nov 06 11:53:46 devstack sudo[100301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:46 devstack sudo[100301]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-70d0a2ea-4dc3-4ca8-8b6a-2acdc7f6573e req-4f7f4ef5-51f2-4995-bb45-94b9d30a9037 tempest-VolumesSnapshotsTestJSON-1932056992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-324f90ec-24b8-4996-8592-2f9a5f7749f7" returned: 0 in 0.445s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-70d0a2ea-4dc3-4ca8-8b6a-2acdc7f6573e req-4f7f4ef5-51f2-4995-bb45-94b9d30a9037 tempest-VolumesSnapshotsTestJSON-1932056992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-324f90ec-24b8-4996-8592-2f9a5f7749f7 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:46 devstack sudo[100306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-324f90ec-24b8-4996-8592-2f9a5f7749f7
Nov 06 11:53:46 devstack sudo[100306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:47 devstack sudo[100306]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-70d0a2ea-4dc3-4ca8-8b6a-2acdc7f6573e req-4f7f4ef5-51f2-4995-bb45-94b9d30a9037 tempest-VolumesSnapshotsTestJSON-1932056992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-324f90ec-24b8-4996-8592-2f9a5f7749f7" returned: 0 in 0.269s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:47 devstack cinder-volume[87165]: DEBUG cinder.coordination [req-70d0a2ea-4dc3-4ca8-8b6a-2acdc7f6573e req-4f7f4ef5-51f2-4995-bb45-94b9d30a9037 tempest-VolumesSnapshotsTestJSON-1932056992 None] Lock "cinder-quobyte-324f90ec-24b8-4996-8592-2f9a5f7749f7" released by "delete_volume" :: held 0.802s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:53:47 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:UPDATE=134,cinder:SELECT=123,cinder:INSERT=34,cinder:DELETE=15 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 11:53:47 devstack cinder-volume[87165]: DEBUG cinder.quota [req-70d0a2ea-4dc3-4ca8-8b6a-2acdc7f6573e req-4f7f4ef5-51f2-4995-bb45-94b9d30a9037 tempest-VolumesSnapshotsTestJSON-1932056992 None] Created reservations ['2d40b3c6-9e14-49ee-becf-bc0dd7d5ba18', 'f5aa10f8-fe2d-4a9d-ad7f-60a42a00bd75', '17b520ed-ac1c-443c-8c51-4b99c63f36f2', 'be2213a1-a46d-4881-96f1-0c91670d501e'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:53:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-70d0a2ea-4dc3-4ca8-8b6a-2acdc7f6573e req-4f7f4ef5-51f2-4995-bb45-94b9d30a9037 tempest-VolumesSnapshotsTestJSON-1932056992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:53:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-70d0a2ea-4dc3-4ca8-8b6a-2acdc7f6573e req-4f7f4ef5-51f2-4995-bb45-94b9d30a9037 tempest-VolumesSnapshotsTestJSON-1932056992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:53:47 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [req-70d0a2ea-4dc3-4ca8-8b6a-2acdc7f6573e req-4f7f4ef5-51f2-4995-bb45-94b9d30a9037 tempest-VolumesSnapshotsTestJSON-1932056992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:53:47 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [req-70d0a2ea-4dc3-4ca8-8b6a-2acdc7f6573e req-4f7f4ef5-51f2-4995-bb45-94b9d30a9037 tempest-VolumesSnapshotsTestJSON-1932056992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:53:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-70d0a2ea-4dc3-4ca8-8b6a-2acdc7f6573e req-4f7f4ef5-51f2-4995-bb45-94b9d30a9037 tempest-VolumesSnapshotsTestJSON-1932056992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:53:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-70d0a2ea-4dc3-4ca8-8b6a-2acdc7f6573e req-4f7f4ef5-51f2-4995-bb45-94b9d30a9037 tempest-VolumesSnapshotsTestJSON-1932056992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:47 devstack sudo[100309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:53:47 devstack sudo[100309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:47 devstack sudo[100309]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-70d0a2ea-4dc3-4ca8-8b6a-2acdc7f6573e req-4f7f4ef5-51f2-4995-bb45-94b9d30a9037 tempest-VolumesSnapshotsTestJSON-1932056992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.446s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:47 devstack cinder-volume[87165]: DEBUG cinder.manager [req-70d0a2ea-4dc3-4ca8-8b6a-2acdc7f6573e req-4f7f4ef5-51f2-4995-bb45-94b9d30a9037 tempest-VolumesSnapshotsTestJSON-1932056992 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:53:47 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-70d0a2ea-4dc3-4ca8-8b6a-2acdc7f6573e req-4f7f4ef5-51f2-4995-bb45-94b9d30a9037 tempest-VolumesSnapshotsTestJSON-1932056992 None] Deleted volume successfully.
Nov 06 11:53:47 devstack cinder-volume[87165]: DEBUG cinder.coordination [req-70d0a2ea-4dc3-4ca8-8b6a-2acdc7f6573e req-4f7f4ef5-51f2-4995-bb45-94b9d30a9037 tempest-VolumesSnapshotsTestJSON-1932056992 None] Lock "cinder-324f90ec-24b8-4996-8592-2f9a5f7749f7-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:53:50 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-48e21913-1c49-41a8-937e-f65c2d445430 tempest-VolumesNegativeTest-512062815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:53:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-48e21913-1c49-41a8-937e-f65c2d445430 tempest-VolumesNegativeTest-512062815 None] Flow 'volume_create_manager' (3582aa49-50e7-4671-bc78-cf02584d4b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:53:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-48e21913-1c49-41a8-937e-f65c2d445430 tempest-VolumesNegativeTest-512062815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a5c9b8e-2ac9-4dfb-a9f7-3dcff3b98a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-48e21913-1c49-41a8-937e-f65c2d445430 tempest-VolumesNegativeTest-512062815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a5c9b8e-2ac9-4dfb-a9f7-3dcff3b98a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1695511717',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ecf4559-5fda-4555-bba3-e4ef0f5cb0e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e52d7f5b8a041f19b0809d696444e14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:53:51Z,use_quota=True,user_id='7180f8b473284bd1ae2d33d898b8e335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-48e21913-1c49-41a8-937e-f65c2d445430 tempest-VolumesNegativeTest-512062815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bf29ee3-5ca4-49c8-9aa6-8e800a507856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-48e21913-1c49-41a8-937e-f65c2d445430 tempest-VolumesNegativeTest-512062815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bf29ee3-5ca4-49c8-9aa6-8e800a507856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-48e21913-1c49-41a8-937e-f65c2d445430 tempest-VolumesNegativeTest-512062815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (460aa15e-a463-4a81-907e-96365b1ea2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-48e21913-1c49-41a8-937e-f65c2d445430 tempest-VolumesNegativeTest-512062815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (460aa15e-a463-4a81-907e-96365b1ea2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ecf4559-5fda-4555-bba3-e4ef0f5cb0e5', 'volume_name': 'volume-4ecf4559-5fda-4555-bba3-e4ef0f5cb0e5', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-48e21913-1c49-41a8-937e-f65c2d445430 tempest-VolumesNegativeTest-512062815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e999d1b2-0b1e-443e-b4e8-fe345fe60ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-48e21913-1c49-41a8-937e-f65c2d445430 tempest-VolumesNegativeTest-512062815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e999d1b2-0b1e-443e-b4e8-fe345fe60ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-48e21913-1c49-41a8-937e-f65c2d445430 tempest-VolumesNegativeTest-512062815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43b1665a-0f19-48c8-b70f-653e2b32fd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:51 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-48e21913-1c49-41a8-937e-f65c2d445430 tempest-VolumesNegativeTest-512062815 None] Volume 4ecf4559-5fda-4555-bba3-e4ef0f5cb0e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ecf4559-5fda-4555-bba3-e4ef0f5cb0e5', 'volume_size': 1}
Nov 06 11:53:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-48e21913-1c49-41a8-937e-f65c2d445430 tempest-VolumesNegativeTest-512062815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:53:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-48e21913-1c49-41a8-937e-f65c2d445430 tempest-VolumesNegativeTest-512062815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:53:51 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-48e21913-1c49-41a8-937e-f65c2d445430 tempest-VolumesNegativeTest-512062815 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1695511717',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ecf4559-5fda-4555-bba3-e4ef0f5cb0e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e52d7f5b8a041f19b0809d696444e14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:53:51Z,use_quota=True,user_id='7180f8b473284bd1ae2d33d898b8e335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:53:51 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-48e21913-1c49-41a8-937e-f65c2d445430 tempest-VolumesNegativeTest-512062815 None] Creating volume 4ecf4559-5fda-4555-bba3-e4ef0f5cb0e5 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:53:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-48e21913-1c49-41a8-937e-f65c2d445430 tempest-VolumesNegativeTest-512062815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:53:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-48e21913-1c49-41a8-937e-f65c2d445430 tempest-VolumesNegativeTest-512062815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:53:51 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-48e21913-1c49-41a8-937e-f65c2d445430 tempest-VolumesNegativeTest-512062815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:53:51 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-48e21913-1c49-41a8-937e-f65c2d445430 tempest-VolumesNegativeTest-512062815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:53:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-48e21913-1c49-41a8-937e-f65c2d445430 tempest-VolumesNegativeTest-512062815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:53:51 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-48e21913-1c49-41a8-937e-f65c2d445430 tempest-VolumesNegativeTest-512062815 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:53:51 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-48e21913-1c49-41a8-937e-f65c2d445430 tempest-VolumesNegativeTest-512062815 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:53:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-48e21913-1c49-41a8-937e-f65c2d445430 tempest-VolumesNegativeTest-512062815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4ecf4559-5fda-4555-bba3-e4ef0f5cb0e5 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:51 devstack sudo[100312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4ecf4559-5fda-4555-bba3-e4ef0f5cb0e5 1073741824
Nov 06 11:53:51 devstack sudo[100312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:51 devstack sudo[100312]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-48e21913-1c49-41a8-937e-f65c2d445430 tempest-VolumesNegativeTest-512062815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4ecf4559-5fda-4555-bba3-e4ef0f5cb0e5 1073741824" returned: 0 in 0.488s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-48e21913-1c49-41a8-937e-f65c2d445430 tempest-VolumesNegativeTest-512062815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4ecf4559-5fda-4555-bba3-e4ef0f5cb0e5 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:51 devstack sudo[100318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4ecf4559-5fda-4555-bba3-e4ef0f5cb0e5
Nov 06 11:53:51 devstack sudo[100318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:51 devstack sudo[100318]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-48e21913-1c49-41a8-937e-f65c2d445430 tempest-VolumesNegativeTest-512062815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4ecf4559-5fda-4555-bba3-e4ef0f5cb0e5" returned: 0 in 0.300s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:51 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-48e21913-1c49-41a8-937e-f65c2d445430 tempest-VolumesNegativeTest-512062815 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:53:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-48e21913-1c49-41a8-937e-f65c2d445430 tempest-VolumesNegativeTest-512062815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:53:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-48e21913-1c49-41a8-937e-f65c2d445430 tempest-VolumesNegativeTest-512062815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43b1665a-0f19-48c8-b70f-653e2b32fd7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ecf4559-5fda-4555-bba3-e4ef0f5cb0e5', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-48e21913-1c49-41a8-937e-f65c2d445430 tempest-VolumesNegativeTest-512062815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (102e1e71-46b1-4b76-9663-753ee7f560f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:51 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-48e21913-1c49-41a8-937e-f65c2d445430 tempest-VolumesNegativeTest-512062815 None] Volume volume-4ecf4559-5fda-4555-bba3-e4ef0f5cb0e5 (4ecf4559-5fda-4555-bba3-e4ef0f5cb0e5): created successfully
Nov 06 11:53:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-48e21913-1c49-41a8-937e-f65c2d445430 tempest-VolumesNegativeTest-512062815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (102e1e71-46b1-4b76-9663-753ee7f560f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-48e21913-1c49-41a8-937e-f65c2d445430 tempest-VolumesNegativeTest-512062815 None] Flow 'volume_create_manager' (3582aa49-50e7-4671-bc78-cf02584d4b21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:53:52 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-48e21913-1c49-41a8-937e-f65c2d445430 tempest-VolumesNegativeTest-512062815 None] Created volume successfully.
Nov 06 11:53:52 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [req-499848b9-994e-4a1d-91ee-b7e941d8cafa req-fc14f1a3-48ca-4508-82be-dad9c07b4157 tempest-VolumesGetTestJSON-1683051522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:53:52 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-499848b9-994e-4a1d-91ee-b7e941d8cafa req-fc14f1a3-48ca-4508-82be-dad9c07b4157 tempest-VolumesGetTestJSON-1683051522 None] Flow 'volume_create_manager' (2326998f-6582-4f6b-83d6-074aa3cdc3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:53:52 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-499848b9-994e-4a1d-91ee-b7e941d8cafa req-fc14f1a3-48ca-4508-82be-dad9c07b4157 tempest-VolumesGetTestJSON-1683051522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (347f54dc-efbc-41f7-91d4-424fd41d20c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:52 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-499848b9-994e-4a1d-91ee-b7e941d8cafa req-fc14f1a3-48ca-4508-82be-dad9c07b4157 tempest-VolumesGetTestJSON-1683051522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (347f54dc-efbc-41f7-91d4-424fd41d20c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-568044835',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee4c0c35-7d09-41a7-93a9-682891d6b862,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b9a1f90aa826456aba8297748646944c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:53:53Z,use_quota=True,user_id='282e6eec981749248c7b1d719a97ad37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:52 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-499848b9-994e-4a1d-91ee-b7e941d8cafa req-fc14f1a3-48ca-4508-82be-dad9c07b4157 tempest-VolumesGetTestJSON-1683051522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e09e757d-5ada-4dd9-b8c1-0fb77073091f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:52 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-499848b9-994e-4a1d-91ee-b7e941d8cafa req-fc14f1a3-48ca-4508-82be-dad9c07b4157 tempest-VolumesGetTestJSON-1683051522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e09e757d-5ada-4dd9-b8c1-0fb77073091f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:52 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-499848b9-994e-4a1d-91ee-b7e941d8cafa req-fc14f1a3-48ca-4508-82be-dad9c07b4157 tempest-VolumesGetTestJSON-1683051522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b8a63ca-69d5-4e63-ba69-551611460529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:52 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-499848b9-994e-4a1d-91ee-b7e941d8cafa req-fc14f1a3-48ca-4508-82be-dad9c07b4157 tempest-VolumesGetTestJSON-1683051522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b8a63ca-69d5-4e63-ba69-551611460529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee4c0c35-7d09-41a7-93a9-682891d6b862', 'volume_name': 'volume-ee4c0c35-7d09-41a7-93a9-682891d6b862', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:52 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-499848b9-994e-4a1d-91ee-b7e941d8cafa req-fc14f1a3-48ca-4508-82be-dad9c07b4157 tempest-VolumesGetTestJSON-1683051522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9b3bf7f-8a11-42dd-82b3-017ede5f6543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:52 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-499848b9-994e-4a1d-91ee-b7e941d8cafa req-fc14f1a3-48ca-4508-82be-dad9c07b4157 tempest-VolumesGetTestJSON-1683051522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9b3bf7f-8a11-42dd-82b3-017ede5f6543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:52 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-499848b9-994e-4a1d-91ee-b7e941d8cafa req-fc14f1a3-48ca-4508-82be-dad9c07b4157 tempest-VolumesGetTestJSON-1683051522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d7bbad9-51cd-498e-a1b5-cab95ed74d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:52 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [req-499848b9-994e-4a1d-91ee-b7e941d8cafa req-fc14f1a3-48ca-4508-82be-dad9c07b4157 tempest-VolumesGetTestJSON-1683051522 None] Volume ee4c0c35-7d09-41a7-93a9-682891d6b862: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee4c0c35-7d09-41a7-93a9-682891d6b862', 'volume_size': 1}
Nov 06 11:53:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-499848b9-994e-4a1d-91ee-b7e941d8cafa req-fc14f1a3-48ca-4508-82be-dad9c07b4157 tempest-VolumesGetTestJSON-1683051522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:53:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-499848b9-994e-4a1d-91ee-b7e941d8cafa req-fc14f1a3-48ca-4508-82be-dad9c07b4157 tempest-VolumesGetTestJSON-1683051522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:53:52 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [req-499848b9-994e-4a1d-91ee-b7e941d8cafa req-fc14f1a3-48ca-4508-82be-dad9c07b4157 tempest-VolumesGetTestJSON-1683051522 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-568044835',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee4c0c35-7d09-41a7-93a9-682891d6b862,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b9a1f90aa826456aba8297748646944c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:53:53Z,use_quota=True,user_id='282e6eec981749248c7b1d719a97ad37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:53:52 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [req-499848b9-994e-4a1d-91ee-b7e941d8cafa req-fc14f1a3-48ca-4508-82be-dad9c07b4157 tempest-VolumesGetTestJSON-1683051522 None] Creating volume ee4c0c35-7d09-41a7-93a9-682891d6b862 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:53:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-499848b9-994e-4a1d-91ee-b7e941d8cafa req-fc14f1a3-48ca-4508-82be-dad9c07b4157 tempest-VolumesGetTestJSON-1683051522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:53:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-499848b9-994e-4a1d-91ee-b7e941d8cafa req-fc14f1a3-48ca-4508-82be-dad9c07b4157 tempest-VolumesGetTestJSON-1683051522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:53:52 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [req-499848b9-994e-4a1d-91ee-b7e941d8cafa req-fc14f1a3-48ca-4508-82be-dad9c07b4157 tempest-VolumesGetTestJSON-1683051522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:53:52 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [req-499848b9-994e-4a1d-91ee-b7e941d8cafa req-fc14f1a3-48ca-4508-82be-dad9c07b4157 tempest-VolumesGetTestJSON-1683051522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:53:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-499848b9-994e-4a1d-91ee-b7e941d8cafa req-fc14f1a3-48ca-4508-82be-dad9c07b4157 tempest-VolumesGetTestJSON-1683051522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:53:52 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [req-499848b9-994e-4a1d-91ee-b7e941d8cafa req-fc14f1a3-48ca-4508-82be-dad9c07b4157 tempest-VolumesGetTestJSON-1683051522 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:53:52 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [req-499848b9-994e-4a1d-91ee-b7e941d8cafa req-fc14f1a3-48ca-4508-82be-dad9c07b4157 tempest-VolumesGetTestJSON-1683051522 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:53:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-499848b9-994e-4a1d-91ee-b7e941d8cafa req-fc14f1a3-48ca-4508-82be-dad9c07b4157 tempest-VolumesGetTestJSON-1683051522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ee4c0c35-7d09-41a7-93a9-682891d6b862 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:52 devstack sudo[100321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ee4c0c35-7d09-41a7-93a9-682891d6b862 1073741824
Nov 06 11:53:52 devstack sudo[100321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:53 devstack sudo[100321]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-499848b9-994e-4a1d-91ee-b7e941d8cafa req-fc14f1a3-48ca-4508-82be-dad9c07b4157 tempest-VolumesGetTestJSON-1683051522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ee4c0c35-7d09-41a7-93a9-682891d6b862 1073741824" returned: 0 in 0.513s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-499848b9-994e-4a1d-91ee-b7e941d8cafa req-fc14f1a3-48ca-4508-82be-dad9c07b4157 tempest-VolumesGetTestJSON-1683051522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ee4c0c35-7d09-41a7-93a9-682891d6b862 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:53 devstack sudo[100327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ee4c0c35-7d09-41a7-93a9-682891d6b862
Nov 06 11:53:53 devstack sudo[100327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:53 devstack sudo[100327]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-499848b9-994e-4a1d-91ee-b7e941d8cafa req-fc14f1a3-48ca-4508-82be-dad9c07b4157 tempest-VolumesGetTestJSON-1683051522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ee4c0c35-7d09-41a7-93a9-682891d6b862" returned: 0 in 0.276s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:53 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [req-499848b9-994e-4a1d-91ee-b7e941d8cafa req-fc14f1a3-48ca-4508-82be-dad9c07b4157 tempest-VolumesGetTestJSON-1683051522 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:53:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-499848b9-994e-4a1d-91ee-b7e941d8cafa req-fc14f1a3-48ca-4508-82be-dad9c07b4157 tempest-VolumesGetTestJSON-1683051522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:53:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-499848b9-994e-4a1d-91ee-b7e941d8cafa req-fc14f1a3-48ca-4508-82be-dad9c07b4157 tempest-VolumesGetTestJSON-1683051522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d7bbad9-51cd-498e-a1b5-cab95ed74d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee4c0c35-7d09-41a7-93a9-682891d6b862', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-499848b9-994e-4a1d-91ee-b7e941d8cafa req-fc14f1a3-48ca-4508-82be-dad9c07b4157 tempest-VolumesGetTestJSON-1683051522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (786392ce-6e1a-4759-bb8c-ba401ff6e69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:53:53 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [req-499848b9-994e-4a1d-91ee-b7e941d8cafa req-fc14f1a3-48ca-4508-82be-dad9c07b4157 tempest-VolumesGetTestJSON-1683051522 None] Volume volume-ee4c0c35-7d09-41a7-93a9-682891d6b862 (ee4c0c35-7d09-41a7-93a9-682891d6b862): created successfully
Nov 06 11:53:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-499848b9-994e-4a1d-91ee-b7e941d8cafa req-fc14f1a3-48ca-4508-82be-dad9c07b4157 tempest-VolumesGetTestJSON-1683051522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (786392ce-6e1a-4759-bb8c-ba401ff6e69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:53:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-499848b9-994e-4a1d-91ee-b7e941d8cafa req-fc14f1a3-48ca-4508-82be-dad9c07b4157 tempest-VolumesGetTestJSON-1683051522 None] Flow 'volume_create_manager' (2326998f-6582-4f6b-83d6-074aa3cdc3e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:53:53 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-499848b9-994e-4a1d-91ee-b7e941d8cafa req-fc14f1a3-48ca-4508-82be-dad9c07b4157 tempest-VolumesGetTestJSON-1683051522 None] Created volume successfully.
Nov 06 11:53:54 devstack cinder-volume[87165]: DEBUG cinder.coordination [req-5a8a86b6-bf33-4aa2-8fbe-eeebc419b989 req-d14eb789-d6dc-437d-8f8e-caf662fe2375 tempest-VolumesGetTestJSON-1683051522 None] Acquiring lock "cinder-ee4c0c35-7d09-41a7-93a9-682891d6b862-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:53:54 devstack cinder-volume[87165]: DEBUG cinder.coordination [req-5a8a86b6-bf33-4aa2-8fbe-eeebc419b989 req-d14eb789-d6dc-437d-8f8e-caf662fe2375 tempest-VolumesGetTestJSON-1683051522 None] Lock "cinder-ee4c0c35-7d09-41a7-93a9-682891d6b862-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:53:54 devstack cinder-volume[87165]: DEBUG cinder.coordination [req-5a8a86b6-bf33-4aa2-8fbe-eeebc419b989 req-d14eb789-d6dc-437d-8f8e-caf662fe2375 tempest-VolumesGetTestJSON-1683051522 None] Acquiring lock "cinder-quobyte-ee4c0c35-7d09-41a7-93a9-682891d6b862" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:53:54 devstack cinder-volume[87165]: DEBUG cinder.coordination [req-5a8a86b6-bf33-4aa2-8fbe-eeebc419b989 req-d14eb789-d6dc-437d-8f8e-caf662fe2375 tempest-VolumesGetTestJSON-1683051522 None] Lock "cinder-quobyte-ee4c0c35-7d09-41a7-93a9-682891d6b862" acquired by "delete_volume" :: waited 0.031s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:53:54 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca92624-05d5-4c5d-be91-4cc384281797]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:53:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-5a8a86b6-bf33-4aa2-8fbe-eeebc419b989 req-d14eb789-d6dc-437d-8f8e-caf662fe2375 tempest-VolumesGetTestJSON-1683051522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ee4c0c35-7d09-41a7-93a9-682891d6b862 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:54 devstack sudo[100334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ee4c0c35-7d09-41a7-93a9-682891d6b862
Nov 06 11:53:54 devstack sudo[100334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:54 devstack sudo[100334]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-5a8a86b6-bf33-4aa2-8fbe-eeebc419b989 req-d14eb789-d6dc-437d-8f8e-caf662fe2375 tempest-VolumesGetTestJSON-1683051522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ee4c0c35-7d09-41a7-93a9-682891d6b862" returned: 0 in 0.501s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-5a8a86b6-bf33-4aa2-8fbe-eeebc419b989 req-d14eb789-d6dc-437d-8f8e-caf662fe2375 tempest-VolumesGetTestJSON-1683051522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ee4c0c35-7d09-41a7-93a9-682891d6b862 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:54 devstack sudo[100349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ee4c0c35-7d09-41a7-93a9-682891d6b862
Nov 06 11:53:54 devstack sudo[100349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:55 devstack sudo[100349]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-5a8a86b6-bf33-4aa2-8fbe-eeebc419b989 req-d14eb789-d6dc-437d-8f8e-caf662fe2375 tempest-VolumesGetTestJSON-1683051522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ee4c0c35-7d09-41a7-93a9-682891d6b862" returned: 0 in 0.344s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:55 devstack cinder-volume[87165]: DEBUG cinder.coordination [req-5a8a86b6-bf33-4aa2-8fbe-eeebc419b989 req-d14eb789-d6dc-437d-8f8e-caf662fe2375 tempest-VolumesGetTestJSON-1683051522 None] Lock "cinder-quobyte-ee4c0c35-7d09-41a7-93a9-682891d6b862" released by "delete_volume" :: held 0.929s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:53:55 devstack cinder-volume[87165]: DEBUG cinder.quota [req-5a8a86b6-bf33-4aa2-8fbe-eeebc419b989 req-d14eb789-d6dc-437d-8f8e-caf662fe2375 tempest-VolumesGetTestJSON-1683051522 None] Created reservations ['27f92a6c-f13c-4291-a005-01f806c38813', 'c1958791-8770-408f-b2c0-a2be5df68e98', 'b2f59cc2-e8a7-401d-830b-39164089f46c', 'e70a340c-5ca9-45e2-aaf1-35c7c313b5f2'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:53:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-5a8a86b6-bf33-4aa2-8fbe-eeebc419b989 req-d14eb789-d6dc-437d-8f8e-caf662fe2375 tempest-VolumesGetTestJSON-1683051522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:53:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-5a8a86b6-bf33-4aa2-8fbe-eeebc419b989 req-d14eb789-d6dc-437d-8f8e-caf662fe2375 tempest-VolumesGetTestJSON-1683051522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:53:55 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [req-5a8a86b6-bf33-4aa2-8fbe-eeebc419b989 req-d14eb789-d6dc-437d-8f8e-caf662fe2375 tempest-VolumesGetTestJSON-1683051522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:53:55 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [req-5a8a86b6-bf33-4aa2-8fbe-eeebc419b989 req-d14eb789-d6dc-437d-8f8e-caf662fe2375 tempest-VolumesGetTestJSON-1683051522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:53:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-5a8a86b6-bf33-4aa2-8fbe-eeebc419b989 req-d14eb789-d6dc-437d-8f8e-caf662fe2375 tempest-VolumesGetTestJSON-1683051522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:53:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-5a8a86b6-bf33-4aa2-8fbe-eeebc419b989 req-d14eb789-d6dc-437d-8f8e-caf662fe2375 tempest-VolumesGetTestJSON-1683051522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:53:55 devstack sudo[100352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:53:55 devstack sudo[100352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:53:55 devstack sudo[100352]: pam_unix(sudo:session): session closed for user root
Nov 06 11:53:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-5a8a86b6-bf33-4aa2-8fbe-eeebc419b989 req-d14eb789-d6dc-437d-8f8e-caf662fe2375 tempest-VolumesGetTestJSON-1683051522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.408s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:53:55 devstack cinder-volume[87165]: DEBUG cinder.manager [req-5a8a86b6-bf33-4aa2-8fbe-eeebc419b989 req-d14eb789-d6dc-437d-8f8e-caf662fe2375 tempest-VolumesGetTestJSON-1683051522 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:53:55 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-5a8a86b6-bf33-4aa2-8fbe-eeebc419b989 req-d14eb789-d6dc-437d-8f8e-caf662fe2375 tempest-VolumesGetTestJSON-1683051522 None] Deleted volume successfully.
Nov 06 11:53:55 devstack cinder-volume[87165]: DEBUG cinder.coordination [req-5a8a86b6-bf33-4aa2-8fbe-eeebc419b989 req-d14eb789-d6dc-437d-8f8e-caf662fe2375 tempest-VolumesGetTestJSON-1683051522 None] Lock "cinder-ee4c0c35-7d09-41a7-93a9-682891d6b862-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:53:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-e83732b4-c6b8-46f3-a364-24244de7bc88 req-271e3846-916c-4bba-8f8e-ab57717d8960 tempest-TestStampPattern-1153361119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:53:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-e83732b4-c6b8-46f3-a364-24244de7bc88 req-271e3846-916c-4bba-8f8e-ab57717d8960 tempest-TestStampPattern-1153361119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:53:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-e83732b4-c6b8-46f3-a364-24244de7bc88 req-271e3846-916c-4bba-8f8e-ab57717d8960 tempest-TestStampPattern-1153361119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:53:57 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-e83732b4-c6b8-46f3-a364-24244de7bc88 req-271e3846-916c-4bba-8f8e-ab57717d8960 tempest-TestStampPattern-1153361119 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50', 'name': 'volume-b294b1d2-5006-4243-9a13-b1aeb251204b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a3026410-88e4-446e-b6bf-fb8fedc434bc', 'enforce_multipath': True} {{(pid=87165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 11:53:57 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-e83732b4-c6b8-46f3-a364-24244de7bc88 req-271e3846-916c-4bba-8f8e-ab57717d8960 tempest-TestStampPattern-1153361119 None] attachment_update completed successfully.
Nov 06 11:54:02 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-057f1e76-02f3-4dfb-b40c-36f268f7a0d0 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:54:02 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-057f1e76-02f3-4dfb-b40c-36f268f7a0d0 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Flow 'volume_create_manager' (31acf56a-51da-4c9c-8933-5034c3c124ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:54:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-057f1e76-02f3-4dfb-b40c-36f268f7a0d0 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53affc57-994c-4cd1-a926-856753495d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:54:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-057f1e76-02f3-4dfb-b40c-36f268f7a0d0 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53affc57-994c-4cd1-a926-856753495d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-186969719',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97d975a0-f59a-486b-a027-06eaab867f79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1d37195538240aa91758d37e10e6b54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:54:03Z,use_quota=True,user_id='d730580008b9499582f59d48a1dd95b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:54:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-057f1e76-02f3-4dfb-b40c-36f268f7a0d0 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57327860-76d6-42c2-8914-43935065aba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:54:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-057f1e76-02f3-4dfb-b40c-36f268f7a0d0 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57327860-76d6-42c2-8914-43935065aba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:54:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-057f1e76-02f3-4dfb-b40c-36f268f7a0d0 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2a6e414-0eff-4f88-aa5a-a84ce8c31e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:54:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-057f1e76-02f3-4dfb-b40c-36f268f7a0d0 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2a6e414-0eff-4f88-aa5a-a84ce8c31e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97d975a0-f59a-486b-a027-06eaab867f79', 'volume_name': 'volume-97d975a0-f59a-486b-a027-06eaab867f79', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:54:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-057f1e76-02f3-4dfb-b40c-36f268f7a0d0 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f49608da-71c9-4537-8ba2-4a8e3cc2a193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:54:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-057f1e76-02f3-4dfb-b40c-36f268f7a0d0 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f49608da-71c9-4537-8ba2-4a8e3cc2a193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:54:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-057f1e76-02f3-4dfb-b40c-36f268f7a0d0 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cee02d9-c228-4bd3-a913-72ff1d0c0663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:54:03 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-057f1e76-02f3-4dfb-b40c-36f268f7a0d0 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Volume 97d975a0-f59a-486b-a027-06eaab867f79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97d975a0-f59a-486b-a027-06eaab867f79', 'volume_size': 1}
Nov 06 11:54:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-057f1e76-02f3-4dfb-b40c-36f268f7a0d0 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:54:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-057f1e76-02f3-4dfb-b40c-36f268f7a0d0 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:54:03 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-057f1e76-02f3-4dfb-b40c-36f268f7a0d0 tempest-TestServerVolumeAttachmentScenario-1119344216 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-186969719',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97d975a0-f59a-486b-a027-06eaab867f79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1d37195538240aa91758d37e10e6b54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:54:03Z,use_quota=True,user_id='d730580008b9499582f59d48a1dd95b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:54:03 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-057f1e76-02f3-4dfb-b40c-36f268f7a0d0 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Creating volume 97d975a0-f59a-486b-a027-06eaab867f79 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:54:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-057f1e76-02f3-4dfb-b40c-36f268f7a0d0 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:54:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-057f1e76-02f3-4dfb-b40c-36f268f7a0d0 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:54:03 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-057f1e76-02f3-4dfb-b40c-36f268f7a0d0 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:54:03 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-057f1e76-02f3-4dfb-b40c-36f268f7a0d0 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:54:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-057f1e76-02f3-4dfb-b40c-36f268f7a0d0 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:54:03 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-057f1e76-02f3-4dfb-b40c-36f268f7a0d0 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:54:03 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-057f1e76-02f3-4dfb-b40c-36f268f7a0d0 tempest-TestServerVolumeAttachmentScenario-1119344216 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:54:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-057f1e76-02f3-4dfb-b40c-36f268f7a0d0 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-97d975a0-f59a-486b-a027-06eaab867f79 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:54:03 devstack sudo[100826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-97d975a0-f59a-486b-a027-06eaab867f79 1073741824
Nov 06 11:54:03 devstack sudo[100826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:54:04 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-40711e16-da92-429d-965d-ece8f640c27b tempest-TestServerVolumeAttachmentScenario-1119344216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:54:04 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-40711e16-da92-429d-965d-ece8f640c27b tempest-TestServerVolumeAttachmentScenario-1119344216 None] Flow 'volume_create_manager' (3bebc944-8760-42f7-b8f0-e6e74d9219d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:54:04 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-40711e16-da92-429d-965d-ece8f640c27b tempest-TestServerVolumeAttachmentScenario-1119344216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8523d9a5-889f-4298-ba11-088bea4c3f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:54:04 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-40711e16-da92-429d-965d-ece8f640c27b tempest-TestServerVolumeAttachmentScenario-1119344216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8523d9a5-889f-4298-ba11-088bea4c3f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2103953672',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e9b0588-c5fd-4d84-830a-bf081c2d7260,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1d37195538240aa91758d37e10e6b54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:54:04Z,use_quota=True,user_id='d730580008b9499582f59d48a1dd95b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:54:04 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-40711e16-da92-429d-965d-ece8f640c27b tempest-TestServerVolumeAttachmentScenario-1119344216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db532f99-e58f-4c3f-81bf-b56714984a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:54:04 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-40711e16-da92-429d-965d-ece8f640c27b tempest-TestServerVolumeAttachmentScenario-1119344216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db532f99-e58f-4c3f-81bf-b56714984a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:54:04 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-40711e16-da92-429d-965d-ece8f640c27b tempest-TestServerVolumeAttachmentScenario-1119344216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db400add-982b-430d-910c-4b829d5e84b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:54:04 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-40711e16-da92-429d-965d-ece8f640c27b tempest-TestServerVolumeAttachmentScenario-1119344216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db400add-982b-430d-910c-4b829d5e84b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e9b0588-c5fd-4d84-830a-bf081c2d7260', 'volume_name': 'volume-3e9b0588-c5fd-4d84-830a-bf081c2d7260', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:54:04 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-40711e16-da92-429d-965d-ece8f640c27b tempest-TestServerVolumeAttachmentScenario-1119344216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c02dff9-3560-4df2-be5e-34b78de607f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:54:04 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-40711e16-da92-429d-965d-ece8f640c27b tempest-TestServerVolumeAttachmentScenario-1119344216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c02dff9-3560-4df2-be5e-34b78de607f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:54:04 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-40711e16-da92-429d-965d-ece8f640c27b tempest-TestServerVolumeAttachmentScenario-1119344216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2717565a-c402-469d-b126-ca6e58dfce48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:54:04 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-40711e16-da92-429d-965d-ece8f640c27b tempest-TestServerVolumeAttachmentScenario-1119344216 None] Volume 3e9b0588-c5fd-4d84-830a-bf081c2d7260: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e9b0588-c5fd-4d84-830a-bf081c2d7260', 'volume_size': 1}
Nov 06 11:54:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-40711e16-da92-429d-965d-ece8f640c27b tempest-TestServerVolumeAttachmentScenario-1119344216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:54:04 devstack sudo[100826]: pam_unix(sudo:session): session closed for user root
Nov 06 11:54:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-057f1e76-02f3-4dfb-b40c-36f268f7a0d0 tempest-TestServerVolumeAttachmentScenario-1119344216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-97d975a0-f59a-486b-a027-06eaab867f79 1073741824" returned: 0 in 1.424s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:54:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-057f1e76-02f3-4dfb-b40c-36f268f7a0d0 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-97d975a0-f59a-486b-a027-06eaab867f79 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:54:04 devstack sudo[100887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-97d975a0-f59a-486b-a027-06eaab867f79
Nov 06 11:54:04 devstack sudo[100887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:54:05 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-78630ae1-bcb5-48bb-9393-da71f5e0b31c req-b73cc866-8db0-49cf-8674-5ba024e40178 tempest-TestStampPattern-1153361119 None] Terminate volume connection completed successfully.
Nov 06 11:54:05 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-78630ae1-bcb5-48bb-9393-da71f5e0b31c req-b73cc866-8db0-49cf-8674-5ba024e40178 tempest-TestStampPattern-1153361119 None] Deleting attachment a3026410-88e4-446e-b6bf-fb8fedc434bc. {{(pid=87165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 11:54:05 devstack sudo[100887]: pam_unix(sudo:session): session closed for user root
Nov 06 11:54:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-057f1e76-02f3-4dfb-b40c-36f268f7a0d0 tempest-TestServerVolumeAttachmentScenario-1119344216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-97d975a0-f59a-486b-a027-06eaab867f79" returned: 0 in 0.727s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:54:05 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-057f1e76-02f3-4dfb-b40c-36f268f7a0d0 tempest-TestServerVolumeAttachmentScenario-1119344216 None] <== create_volume: return (2306ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:54:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-057f1e76-02f3-4dfb-b40c-36f268f7a0d0 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.311s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:54:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-40711e16-da92-429d-965d-ece8f640c27b tempest-TestServerVolumeAttachmentScenario-1119344216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.052s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:54:05 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-40711e16-da92-429d-965d-ece8f640c27b tempest-TestServerVolumeAttachmentScenario-1119344216 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2103953672',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e9b0588-c5fd-4d84-830a-bf081c2d7260,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1d37195538240aa91758d37e10e6b54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:54:04Z,use_quota=True,user_id='d730580008b9499582f59d48a1dd95b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:54:05 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-40711e16-da92-429d-965d-ece8f640c27b tempest-TestServerVolumeAttachmentScenario-1119344216 None] Creating volume 3e9b0588-c5fd-4d84-830a-bf081c2d7260 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:54:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-40711e16-da92-429d-965d-ece8f640c27b tempest-TestServerVolumeAttachmentScenario-1119344216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:54:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-40711e16-da92-429d-965d-ece8f640c27b tempest-TestServerVolumeAttachmentScenario-1119344216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:54:05 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-40711e16-da92-429d-965d-ece8f640c27b tempest-TestServerVolumeAttachmentScenario-1119344216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:54:05 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-40711e16-da92-429d-965d-ece8f640c27b tempest-TestServerVolumeAttachmentScenario-1119344216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:54:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-40711e16-da92-429d-965d-ece8f640c27b tempest-TestServerVolumeAttachmentScenario-1119344216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:54:05 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-40711e16-da92-429d-965d-ece8f640c27b tempest-TestServerVolumeAttachmentScenario-1119344216 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:54:05 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-40711e16-da92-429d-965d-ece8f640c27b tempest-TestServerVolumeAttachmentScenario-1119344216 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:54:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-40711e16-da92-429d-965d-ece8f640c27b tempest-TestServerVolumeAttachmentScenario-1119344216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3e9b0588-c5fd-4d84-830a-bf081c2d7260 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:54:05 devstack sudo[100961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3e9b0588-c5fd-4d84-830a-bf081c2d7260 1073741824
Nov 06 11:54:05 devstack sudo[100961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:54:05 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-057f1e76-02f3-4dfb-b40c-36f268f7a0d0 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cee02d9-c228-4bd3-a913-72ff1d0c0663) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97d975a0-f59a-486b-a027-06eaab867f79', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:54:05 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-057f1e76-02f3-4dfb-b40c-36f268f7a0d0 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf98d053-7b17-4ebd-90c0-ebf2bf960c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:54:05 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-057f1e76-02f3-4dfb-b40c-36f268f7a0d0 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Volume volume-97d975a0-f59a-486b-a027-06eaab867f79 (97d975a0-f59a-486b-a027-06eaab867f79): created successfully
Nov 06 11:54:05 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-057f1e76-02f3-4dfb-b40c-36f268f7a0d0 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf98d053-7b17-4ebd-90c0-ebf2bf960c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:54:05 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-057f1e76-02f3-4dfb-b40c-36f268f7a0d0 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Flow 'volume_create_manager' (31acf56a-51da-4c9c-8933-5034c3c124ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:54:05 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-057f1e76-02f3-4dfb-b40c-36f268f7a0d0 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Created volume successfully.
Nov 06 11:54:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4828e7fa-91a3-402f-904d-73444eabd547 tempest-TestStampPattern-1153361119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:54:06 devstack sudo[100961]: pam_unix(sudo:session): session closed for user root
Nov 06 11:54:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-40711e16-da92-429d-965d-ece8f640c27b tempest-TestServerVolumeAttachmentScenario-1119344216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3e9b0588-c5fd-4d84-830a-bf081c2d7260 1073741824" returned: 0 in 1.069s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:54:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-40711e16-da92-429d-965d-ece8f640c27b tempest-TestServerVolumeAttachmentScenario-1119344216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3e9b0588-c5fd-4d84-830a-bf081c2d7260 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:54:06 devstack sudo[100971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3e9b0588-c5fd-4d84-830a-bf081c2d7260
Nov 06 11:54:06 devstack sudo[100971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:54:07 devstack sudo[100971]: pam_unix(sudo:session): session closed for user root
Nov 06 11:54:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-40711e16-da92-429d-965d-ece8f640c27b tempest-TestServerVolumeAttachmentScenario-1119344216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3e9b0588-c5fd-4d84-830a-bf081c2d7260" returned: 0 in 0.402s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:54:07 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-40711e16-da92-429d-965d-ece8f640c27b tempest-TestServerVolumeAttachmentScenario-1119344216 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:54:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-40711e16-da92-429d-965d-ece8f640c27b tempest-TestServerVolumeAttachmentScenario-1119344216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.640s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:54:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4828e7fa-91a3-402f-904d-73444eabd547 tempest-TestStampPattern-1153361119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.699s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:54:07 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-40711e16-da92-429d-965d-ece8f640c27b tempest-TestServerVolumeAttachmentScenario-1119344216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2717565a-c402-469d-b126-ca6e58dfce48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e9b0588-c5fd-4d84-830a-bf081c2d7260', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:54:07 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-40711e16-da92-429d-965d-ece8f640c27b tempest-TestServerVolumeAttachmentScenario-1119344216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c363d6f-f429-473a-a40c-a096bd01a953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:54:07 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-4828e7fa-91a3-402f-904d-73444eabd547 tempest-TestStampPattern-1153361119 None] Creating offline snapshot 2ec83545-b071-44d5-b360-8f63161a55fb of volume b294b1d2-5006-4243-9a13-b1aeb251204b {{(pid=87165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 11:54:07 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-40711e16-da92-429d-965d-ece8f640c27b tempest-TestServerVolumeAttachmentScenario-1119344216 None] Volume volume-3e9b0588-c5fd-4d84-830a-bf081c2d7260 (3e9b0588-c5fd-4d84-830a-bf081c2d7260): created successfully
Nov 06 11:54:07 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-40711e16-da92-429d-965d-ece8f640c27b tempest-TestServerVolumeAttachmentScenario-1119344216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c363d6f-f429-473a-a40c-a096bd01a953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:54:07 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-40711e16-da92-429d-965d-ece8f640c27b tempest-TestServerVolumeAttachmentScenario-1119344216 None] Flow 'volume_create_manager' (3bebc944-8760-42f7-b8f0-e6e74d9219d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:54:07 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6917a7-cb9d-447b-938d-5eafff326566]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:54:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4828e7fa-91a3-402f-904d-73444eabd547 tempest-TestStampPattern-1153361119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:54:07 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-40711e16-da92-429d-965d-ece8f640c27b tempest-TestServerVolumeAttachmentScenario-1119344216 None] Created volume successfully.
Nov 06 11:54:07 devstack sudo[100981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b
Nov 06 11:54:07 devstack sudo[100981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:54:07 devstack sudo[100981]: pam_unix(sudo:session): session closed for user root
Nov 06 11:54:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4828e7fa-91a3-402f-904d-73444eabd547 tempest-TestStampPattern-1153361119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b" returned: 0 in 0.552s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:54:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4828e7fa-91a3-402f-904d-73444eabd547 tempest-TestStampPattern-1153361119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b.2ec83545-b071-44d5-b360-8f63161a55fb 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:54:07 devstack sudo[100986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b.2ec83545-b071-44d5-b360-8f63161a55fb 1G
Nov 06 11:54:07 devstack sudo[100986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:54:08 devstack sudo[100986]: pam_unix(sudo:session): session closed for user root
Nov 06 11:54:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4828e7fa-91a3-402f-904d-73444eabd547 tempest-TestStampPattern-1153361119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b.2ec83545-b071-44d5-b360-8f63161a55fb 1G" returned: 0 in 0.722s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:54:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4828e7fa-91a3-402f-904d-73444eabd547 tempest-TestStampPattern-1153361119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b294b1d2-5006-4243-9a13-b1aeb251204b -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b.2ec83545-b071-44d5-b360-8f63161a55fb {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:54:08 devstack sudo[100993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b294b1d2-5006-4243-9a13-b1aeb251204b -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b.2ec83545-b071-44d5-b360-8f63161a55fb
Nov 06 11:54:08 devstack sudo[100993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:54:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-83b675f3-c0c3-43d2-aa80-2add4b83695d tempest-BackendsCapabilitiesAdminTestsJSON-2059659119 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.401268005371, 'free_capacity_gb': 1773.401268005371, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87165) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 06 11:54:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-66e50516-07cf-43c9-a10a-a42e51402222 tempest-BackendsCapabilitiesAdminTestsJSON-2059659119 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.401268005371, 'free_capacity_gb': 1773.401268005371, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87165) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 06 11:54:09 devstack sudo[100993]: pam_unix(sudo:session): session closed for user root
Nov 06 11:54:09 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4828e7fa-91a3-402f-904d-73444eabd547 tempest-TestStampPattern-1153361119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b294b1d2-5006-4243-9a13-b1aeb251204b -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b.2ec83545-b071-44d5-b360-8f63161a55fb" returned: 0 in 0.579s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:54:09 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-4828e7fa-91a3-402f-904d-73444eabd547 tempest-TestStampPattern-1153361119 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b.2ec83545-b071-44d5-b360-8f63161a55fb is being set with open permissions: ugo+rw
Nov 06 11:54:09 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4828e7fa-91a3-402f-904d-73444eabd547 tempest-TestStampPattern-1153361119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b.2ec83545-b071-44d5-b360-8f63161a55fb {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:54:09 devstack sudo[101008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b.2ec83545-b071-44d5-b360-8f63161a55fb
Nov 06 11:54:09 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:54:09 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root
Nov 06 11:54:09 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4828e7fa-91a3-402f-904d-73444eabd547 tempest-TestStampPattern-1153361119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b.2ec83545-b071-44d5-b360-8f63161a55fb" returned: 0 in 0.404s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:54:09 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4828e7fa-91a3-402f-904d-73444eabd547 tempest-TestStampPattern-1153361119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:54:09 devstack sudo[101021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b.info
Nov 06 11:54:09 devstack sudo[101021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:54:09 devstack sudo[101021]: pam_unix(sudo:session): session closed for user root
Nov 06 11:54:09 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4828e7fa-91a3-402f-904d-73444eabd547 tempest-TestStampPattern-1153361119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b.info" returned: 0 in 0.339s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:54:09 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-4828e7fa-91a3-402f-904d-73444eabd547 tempest-TestStampPattern-1153361119 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b.info is being set with open permissions: ugo+rw
Nov 06 11:54:09 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4828e7fa-91a3-402f-904d-73444eabd547 tempest-TestStampPattern-1153361119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:54:09 devstack sudo[101024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b.info
Nov 06 11:54:09 devstack sudo[101024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:54:10 devstack sudo[101024]: pam_unix(sudo:session): session closed for user root
Nov 06 11:54:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4828e7fa-91a3-402f-904d-73444eabd547 tempest-TestStampPattern-1153361119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b.info" returned: 0 in 0.294s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:54:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4828e7fa-91a3-402f-904d-73444eabd547 tempest-TestStampPattern-1153361119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.133s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:54:10 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-4828e7fa-91a3-402f-904d-73444eabd547 tempest-TestStampPattern-1153361119 None] Create snapshot completed successfully
Nov 06 11:54:17 devstack cinder-volume[87165]: DEBUG oslo_service.periodic_task [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 11:54:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:54:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:54:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:54:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:54:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:54:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:54:17 devstack sudo[101121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:54:17 devstack sudo[101121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:54:17 devstack sudo[101121]: pam_unix(sudo:session): session closed for user root
Nov 06 11:54:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.360s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:54:17 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:54:17 devstack cinder-volume[87165]: DEBUG oslo_service.periodic_task [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running periodic task VolumeManager._thread_info {{(pid=87165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 11:54:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] thread count: 29 {{(pid=87165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 11:54:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] thread info: [<_MainThread(MainThread, started 127732956901504)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127732842693056)>, <Thread(Thread-3 (stat_writer), started daemon 127732841891136)>, <Thread(Rabbit-heartbeat, started daemon 127732842515648)>, <Thread(Thread-5 (_runner), started daemon 127732840534464)>, <Thread(Thread-7 (_runner), started daemon 127732840636032)>, <Thread(fd_logger, started daemon 127732838664256)>, <Thread(privsep_reader, started daemon 127732838673408)>, <Thread(tpool_thread_0, started daemon 127732829828800)>, <Thread(tpool_thread_1, started daemon 127732821436096)>, <Thread(tpool_thread_2, started daemon 127732813043392)>, <Thread(tpool_thread_3, started daemon 127732804650688)>, <Thread(tpool_thread_4, started daemon 127732796257984)>, <Thread(tpool_thread_5, started daemon 127732787865280)>, <Thread(tpool_thread_6, started daemon 127732779456192)>, <Thread(tpool_thread_7, started daemon 127732771047104)>, <Thread(tpool_thread_8, started daemon 127732762638016)>, <Thread(tpool_thread_9, started daemon 127732754228928)>, <Thread(tpool_thread_10, started daemon 127732745819840)>, <Thread(tpool_thread_11, started daemon 127732737410752)>, <Thread(tpool_thread_12, started daemon 127732729001664)>, <Thread(tpool_thread_13, started daemon 127732720592576)>, <Thread(tpool_thread_14, started daemon 127732712183488)>, <Thread(tpool_thread_15, started daemon 127732703774400)>, <Thread(tpool_thread_16, started daemon 127732695365312)>, <Thread(tpool_thread_17, started daemon 127732686956224)>, <Thread(tpool_thread_18, started daemon 127732678547136)>, <Thread(tpool_thread_19, started daemon 127732670138048)>, <Thread(Rabbit-heartbeat, started daemon 127732832631296)>] {{(pid=87165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 11:54:19 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-2e074c09-f1ba-4410-92f2-73983773508e tempest-GroupsTest-1295184119 None] Group tempest-Group1-1478846392: creating
Nov 06 11:54:19 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-2e074c09-f1ba-4410-92f2-73983773508e tempest-GroupsTest-1295184119 None] Group tempest-Group1-1478846392: created successfully
Nov 06 11:54:19 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-2e074c09-f1ba-4410-92f2-73983773508e tempest-GroupsTest-1295184119 None] Create group completed successfully.
Nov 06 11:54:20 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-50537a56-e3bc-4a05-afc8-cf7a7f7568b9 tempest-GroupsTest-1295184119 None] Group tempest-Group2-1833060262: creating
Nov 06 11:54:20 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-50537a56-e3bc-4a05-afc8-cf7a7f7568b9 tempest-GroupsTest-1295184119 None] Group tempest-Group2-1833060262: created successfully
Nov 06 11:54:20 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-50537a56-e3bc-4a05-afc8-cf7a7f7568b9 tempest-GroupsTest-1295184119 None] Create group completed successfully.
Nov 06 11:54:22 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:54:22 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] Flow 'volume_create_manager' (fc71cfc2-f5b2-4b85-b82d-b2d3d489d2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:54:22 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a57e117-f2d5-405b-a604-55c4a077d93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:54:22 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a57e117-f2d5-405b-a604-55c4a077d93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:54:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-596170006',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c19d6592-0185-4480-8990-0d64bc712712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffa73c43605f466eb7cf9062967949f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:54:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2ec83545-b071-44d5-b360-8f63161a55fb,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:54:22Z,use_quota=True,user_id='b253a3a89e5f46a1b8fecd67f642c0f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:54:22 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e3a931d-a87e-4ee5-b4f0-5193e00d980a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:54:22 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e3a931d-a87e-4ee5-b4f0-5193e00d980a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:54:22 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fb5fe78-4d2e-4bd9-a0cf-81816b5805a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:54:22 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fb5fe78-4d2e-4bd9-a0cf-81816b5805a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c19d6592-0185-4480-8990-0d64bc712712', 'volume_name': 'volume-c19d6592-0185-4480-8990-0d64bc712712', 'volume_size': 1, 'snapshot_id': '2ec83545-b071-44d5-b360-8f63161a55fb'}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:54:22 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d22bc24-0068-4d6a-81b0-f34d2e4f4c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:54:22 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d22bc24-0068-4d6a-81b0-f34d2e4f4c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:54:22 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a054d7f-2cea-4dae-aba2-f9df5d15fd2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:54:22 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] Volume c19d6592-0185-4480-8990-0d64bc712712: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c19d6592-0185-4480-8990-0d64bc712712', 'volume_size': 1, 'snapshot_id': '2ec83545-b071-44d5-b360-8f63161a55fb'}
Nov 06 11:54:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:54:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:54:22 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] Acquiring lock "cinder-quobyte-2ec83545-b071-44d5-b360-8f63161a55fb-c19d6592-0185-4480-8990-0d64bc712712" by "_create_volume_from_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:54:22 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] Lock "cinder-quobyte-2ec83545-b071-44d5-b360-8f63161a55fb-c19d6592-0185-4480-8990-0d64bc712712" acquired by "_create_volume_from_snapshot" :: waited 0.159s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:54:22 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] Creating volume c19d6592-0185-4480-8990-0d64bc712712 from snapshot 2ec83545-b071-44d5-b360-8f63161a55fb {{(pid=87165) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 06 11:54:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:54:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:54:22 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:54:22 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:54:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:54:22 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:54:22 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] Acquiring lock "cinder-quobyte-c19d6592-0185-4480-8990-0d64bc712712" by "_copy_volume_from_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:54:22 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] Lock "cinder-quobyte-c19d6592-0185-4480-8990-0d64bc712712" acquired by "_copy_volume_from_snapshot" :: waited 0.063s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:54:22 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] snapshot: 2ec83545-b071-44d5-b360-8f63161a55fb, volume: c19d6592-0185-4480-8990-0d64bc712712,  {{(pid=87165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 06 11:54:22 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa853783-0e33-455b-ba7f-8dca00742551 tempest-GroupsTest-1295184119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:54:22 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-fa853783-0e33-455b-ba7f-8dca00742551 tempest-GroupsTest-1295184119 None] Flow 'volume_create_manager' (48a96cc9-9bc4-4ee2-9c7a-fc29829254fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:54:23 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-fa853783-0e33-455b-ba7f-8dca00742551 tempest-GroupsTest-1295184119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd444fd2-5199-4fa9-a025-5efde63236e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:54:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:54:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:54:23 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:54:23 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:54:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:54:23 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-fa853783-0e33-455b-ba7f-8dca00742551 tempest-GroupsTest-1295184119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd444fd2-5199-4fa9-a025-5efde63236e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:54:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-831407019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8dfd70e4-ed9d-4c45-8439-510e2c2b993d,host='devstack@QuobyteHD#QuobyteHD',id=1c9f181d-5ef7-425c-bd53-cbd671f775d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a98a11bb54834d6a838492f213fb6f44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:54:23Z,use_quota=True,user_id='e27a35124d6742a5bc8dbef323910b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(008db8c0-9731-47f0-8b25-3e724bae6490),volume_type_id=008db8c0-9731-47f0-8b25-3e724bae6490)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:54:23 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-fa853783-0e33-455b-ba7f-8dca00742551 tempest-GroupsTest-1295184119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eddaa43c-edd2-4445-be96-4930140771b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:54:23 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-fa853783-0e33-455b-ba7f-8dca00742551 tempest-GroupsTest-1295184119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eddaa43c-edd2-4445-be96-4930140771b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:54:23 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-fa853783-0e33-455b-ba7f-8dca00742551 tempest-GroupsTest-1295184119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7895a9d6-e112-4f68-9d60-8aefe1e05c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:54:23 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-fa853783-0e33-455b-ba7f-8dca00742551 tempest-GroupsTest-1295184119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7895a9d6-e112-4f68-9d60-8aefe1e05c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c9f181d-5ef7-425c-bd53-cbd671f775d5', 'volume_name': 'volume-1c9f181d-5ef7-425c-bd53-cbd671f775d5', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:54:23 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-fa853783-0e33-455b-ba7f-8dca00742551 tempest-GroupsTest-1295184119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e996b1c2-4369-4332-921f-e64b48b270e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:54:23 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-fa853783-0e33-455b-ba7f-8dca00742551 tempest-GroupsTest-1295184119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e996b1c2-4369-4332-921f-e64b48b270e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:54:23 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-fa853783-0e33-455b-ba7f-8dca00742551 tempest-GroupsTest-1295184119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e93665b-105d-4ada-9f57-859425a3aef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:54:23 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-fa853783-0e33-455b-ba7f-8dca00742551 tempest-GroupsTest-1295184119 None] Volume 1c9f181d-5ef7-425c-bd53-cbd671f775d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c9f181d-5ef7-425c-bd53-cbd671f775d5', 'volume_size': 1}
Nov 06 11:54:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-fa853783-0e33-455b-ba7f-8dca00742551 tempest-GroupsTest-1295184119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:54:23 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa729d4c-c9be-4251-9d58-d009af50e2ac]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:54:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b.2ec83545-b071-44d5-b360-8f63161a55fb {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:54:23 devstack sudo[101158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b.2ec83545-b071-44d5-b360-8f63161a55fb
Nov 06 11:54:23 devstack sudo[101158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:54:23 devstack sudo[101158]: pam_unix(sudo:session): session closed for user root
Nov 06 11:54:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b.2ec83545-b071-44d5-b360-8f63161a55fb" returned: 0 in 0.508s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:54:23 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b294b1d2-5006-4243-9a13-b1aeb251204b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:54:23 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64a887d-98fe-4dcf-b8da-38f6bb589036]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:54:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:54:23 devstack sudo[101163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b
Nov 06 11:54:23 devstack sudo[101163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:54:24 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-7295c18a-84ab-4584-94be-0bbfcbf82fcd tempest-VolumesNegativeTest-512062815 None] Acquiring lock "cinder-4ecf4559-5fda-4555-bba3-e4ef0f5cb0e5-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:54:24 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-7295c18a-84ab-4584-94be-0bbfcbf82fcd tempest-VolumesNegativeTest-512062815 None] Lock "cinder-4ecf4559-5fda-4555-bba3-e4ef0f5cb0e5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:54:24 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-7295c18a-84ab-4584-94be-0bbfcbf82fcd tempest-VolumesNegativeTest-512062815 None] Acquiring lock "cinder-quobyte-4ecf4559-5fda-4555-bba3-e4ef0f5cb0e5" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:54:24 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-7295c18a-84ab-4584-94be-0bbfcbf82fcd tempest-VolumesNegativeTest-512062815 None] Lock "cinder-quobyte-4ecf4559-5fda-4555-bba3-e4ef0f5cb0e5" acquired by "delete_volume" :: waited 0.024s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:54:24 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ca3bd3-f277-421c-8fc1-2014ccfc44d0]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:54:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7295c18a-84ab-4584-94be-0bbfcbf82fcd tempest-VolumesNegativeTest-512062815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4ecf4559-5fda-4555-bba3-e4ef0f5cb0e5 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:54:24 devstack sudo[101163]: pam_unix(sudo:session): session closed for user root
Nov 06 11:54:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b" returned: 0 in 0.700s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:54:24 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b {{(pid=87165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 06 11:54:24 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] Creating direct copy from snapshot {{(pid=87165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 06 11:54:24 devstack cinder-volume[87165]: DEBUG cinder.utils [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] Path /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c19d6592-0185-4480-8990-0d64bc712712 not found in is_blk_device check {{(pid=87165) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 06 11:54:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c19d6592-0185-4480-8990-0d64bc712712 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:54:24 devstack sudo[101172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c19d6592-0185-4480-8990-0d64bc712712
Nov 06 11:54:24 devstack sudo[101172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:54:24 devstack sudo[101171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4ecf4559-5fda-4555-bba3-e4ef0f5cb0e5
Nov 06 11:54:24 devstack sudo[101171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:54:24 devstack sudo[101171]: pam_unix(sudo:session): session closed for user root
Nov 06 11:54:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7295c18a-84ab-4584-94be-0bbfcbf82fcd tempest-VolumesNegativeTest-512062815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4ecf4559-5fda-4555-bba3-e4ef0f5cb0e5" returned: 0 in 0.419s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:54:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7295c18a-84ab-4584-94be-0bbfcbf82fcd tempest-VolumesNegativeTest-512062815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4ecf4559-5fda-4555-bba3-e4ef0f5cb0e5 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:54:24 devstack sudo[101183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4ecf4559-5fda-4555-bba3-e4ef0f5cb0e5
Nov 06 11:54:24 devstack sudo[101183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:54:25 devstack sudo[101183]: pam_unix(sudo:session): session closed for user root
Nov 06 11:54:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7295c18a-84ab-4584-94be-0bbfcbf82fcd tempest-VolumesNegativeTest-512062815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4ecf4559-5fda-4555-bba3-e4ef0f5cb0e5" returned: 0 in 0.474s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:54:25 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-7295c18a-84ab-4584-94be-0bbfcbf82fcd tempest-VolumesNegativeTest-512062815 None] Lock "cinder-quobyte-4ecf4559-5fda-4555-bba3-e4ef0f5cb0e5" released by "delete_volume" :: held 0.981s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:54:25 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-7295c18a-84ab-4584-94be-0bbfcbf82fcd tempest-VolumesNegativeTest-512062815 None] Created reservations ['49170916-c05b-4a8a-b784-9633be9d66de', '7d49cf6e-80b9-4745-93c4-b05912143f70', '0976b9bf-fab2-4f39-85b0-f14692242dfd', 'd9acdf6e-9d4f-4080-948d-db4aa89d16f8'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:54:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-7295c18a-84ab-4584-94be-0bbfcbf82fcd tempest-VolumesNegativeTest-512062815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:54:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-7295c18a-84ab-4584-94be-0bbfcbf82fcd tempest-VolumesNegativeTest-512062815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:54:25 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-7295c18a-84ab-4584-94be-0bbfcbf82fcd tempest-VolumesNegativeTest-512062815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:54:25 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-7295c18a-84ab-4584-94be-0bbfcbf82fcd tempest-VolumesNegativeTest-512062815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:54:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-7295c18a-84ab-4584-94be-0bbfcbf82fcd tempest-VolumesNegativeTest-512062815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:54:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7295c18a-84ab-4584-94be-0bbfcbf82fcd tempest-VolumesNegativeTest-512062815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:54:25 devstack sudo[101194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:54:25 devstack sudo[101194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:54:26 devstack sudo[101194]: pam_unix(sudo:session): session closed for user root
Nov 06 11:54:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7295c18a-84ab-4584-94be-0bbfcbf82fcd tempest-VolumesNegativeTest-512062815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.503s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:54:26 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-7295c18a-84ab-4584-94be-0bbfcbf82fcd tempest-VolumesNegativeTest-512062815 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:54:26 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-7295c18a-84ab-4584-94be-0bbfcbf82fcd tempest-VolumesNegativeTest-512062815 None] Deleted volume successfully.
Nov 06 11:54:26 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-7295c18a-84ab-4584-94be-0bbfcbf82fcd tempest-VolumesNegativeTest-512062815 None] Lock "cinder-4ecf4559-5fda-4555-bba3-e4ef0f5cb0e5-delete_volume" released by "delete_volume" :: held 1.997s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:54:35 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:SELECT=42,cinder:INSERT=10,cinder:UPDATE=38,cinder:DELETE=5 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 11:54:35 devstack sudo[101172]: pam_unix(sudo:session): session closed for user root
Nov 06 11:54:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c19d6592-0185-4480-8990-0d64bc712712" returned: 0 in 11.464s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:54:35 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] Image conversion details: src /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b, size 1024.00 MB, duration 11.47 sec, destination /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c19d6592-0185-4480-8990-0d64bc712712 {{(pid=87165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 11:54:35 devstack cinder-volume[87165]: INFO cinder.image.image_utils [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] Converted 1024.00 MB image at 89.31 MB/s
Nov 06 11:54:35 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c19d6592-0185-4480-8990-0d64bc712712 is being set with open permissions: ugo+rw
Nov 06 11:54:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c19d6592-0185-4480-8990-0d64bc712712 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:54:35 devstack sudo[101284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c19d6592-0185-4480-8990-0d64bc712712
Nov 06 11:54:35 devstack sudo[101284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:54:36 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:INSERT=7,cinder:UPDATE=45,cinder:SELECT=35,cinder:DELETE=3 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 11:54:36 devstack sudo[101284]: pam_unix(sudo:session): session closed for user root
Nov 06 11:54:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c19d6592-0185-4480-8990-0d64bc712712" returned: 0 in 0.372s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:54:36 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] Lock "cinder-quobyte-c19d6592-0185-4480-8990-0d64bc712712" released by "_copy_volume_from_snapshot" :: held 13.314s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:54:36 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] Lock "cinder-quobyte-2ec83545-b071-44d5-b360-8f63161a55fb-c19d6592-0185-4480-8990-0d64bc712712" released by "_create_volume_from_snapshot" :: held 13.473s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:54:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.634s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:54:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-fa853783-0e33-455b-ba7f-8dca00742551 tempest-GroupsTest-1295184119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.174s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:54:36 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-fa853783-0e33-455b-ba7f-8dca00742551 tempest-GroupsTest-1295184119 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=8dfd70e4-ed9d-4c45-8439-510e2c2b993d,created_at=2026-11-06T10:54:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-831407019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8dfd70e4-ed9d-4c45-8439-510e2c2b993d,host='devstack@QuobyteHD#QuobyteHD',id=1c9f181d-5ef7-425c-bd53-cbd671f775d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a98a11bb54834d6a838492f213fb6f44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:54:23Z,use_quota=True,user_id='e27a35124d6742a5bc8dbef323910b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(008db8c0-9731-47f0-8b25-3e724bae6490),volume_type_id=008db8c0-9731-47f0-8b25-3e724bae6490)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:54:36 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-fa853783-0e33-455b-ba7f-8dca00742551 tempest-GroupsTest-1295184119 None] Creating volume 1c9f181d-5ef7-425c-bd53-cbd671f775d5 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:54:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-fa853783-0e33-455b-ba7f-8dca00742551 tempest-GroupsTest-1295184119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:54:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-fa853783-0e33-455b-ba7f-8dca00742551 tempest-GroupsTest-1295184119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:54:36 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-fa853783-0e33-455b-ba7f-8dca00742551 tempest-GroupsTest-1295184119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:54:36 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-fa853783-0e33-455b-ba7f-8dca00742551 tempest-GroupsTest-1295184119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:54:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-fa853783-0e33-455b-ba7f-8dca00742551 tempest-GroupsTest-1295184119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:54:36 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-fa853783-0e33-455b-ba7f-8dca00742551 tempest-GroupsTest-1295184119 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:54:36 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-fa853783-0e33-455b-ba7f-8dca00742551 tempest-GroupsTest-1295184119 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:54:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-fa853783-0e33-455b-ba7f-8dca00742551 tempest-GroupsTest-1295184119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1c9f181d-5ef7-425c-bd53-cbd671f775d5 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:54:36 devstack sudo[101287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1c9f181d-5ef7-425c-bd53-cbd671f775d5 1073741824
Nov 06 11:54:36 devstack sudo[101287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:54:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a054d7f-2cea-4dae-aba2-f9df5d15fd2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c19d6592-0185-4480-8990-0d64bc712712', 'volume_size': 1, 'snapshot_id': '2ec83545-b071-44d5-b360-8f63161a55fb'}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:54:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa22d947-8cbc-403d-8d07-401811139757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:54:36 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] Volume volume-c19d6592-0185-4480-8990-0d64bc712712 (c19d6592-0185-4480-8990-0d64bc712712): created successfully
Nov 06 11:54:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa22d947-8cbc-403d-8d07-401811139757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:54:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] Flow 'volume_create_manager' (fc71cfc2-f5b2-4b85-b82d-b2d3d489d2e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:54:36 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-b7a5b04c-3015-405a-995e-533b84955dde tempest-TestStampPattern-1153361119 None] Created volume successfully.
Nov 06 11:54:37 devstack sudo[101287]: pam_unix(sudo:session): session closed for user root
Nov 06 11:54:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-fa853783-0e33-455b-ba7f-8dca00742551 tempest-GroupsTest-1295184119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1c9f181d-5ef7-425c-bd53-cbd671f775d5 1073741824" returned: 0 in 0.967s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:54:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-fa853783-0e33-455b-ba7f-8dca00742551 tempest-GroupsTest-1295184119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1c9f181d-5ef7-425c-bd53-cbd671f775d5 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:54:37 devstack sudo[101295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1c9f181d-5ef7-425c-bd53-cbd671f775d5
Nov 06 11:54:37 devstack sudo[101295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:54:37 devstack sudo[101295]: pam_unix(sudo:session): session closed for user root
Nov 06 11:54:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-fa853783-0e33-455b-ba7f-8dca00742551 tempest-GroupsTest-1295184119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1c9f181d-5ef7-425c-bd53-cbd671f775d5" returned: 0 in 0.469s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:54:37 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-fa853783-0e33-455b-ba7f-8dca00742551 tempest-GroupsTest-1295184119 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:54:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-fa853783-0e33-455b-ba7f-8dca00742551 tempest-GroupsTest-1295184119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:54:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-fa853783-0e33-455b-ba7f-8dca00742551 tempest-GroupsTest-1295184119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e93665b-105d-4ada-9f57-859425a3aef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c9f181d-5ef7-425c-bd53-cbd671f775d5', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:54:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-fa853783-0e33-455b-ba7f-8dca00742551 tempest-GroupsTest-1295184119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9915436c-50ef-42f0-b51e-f6ecffa4d738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:54:37 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-fa853783-0e33-455b-ba7f-8dca00742551 tempest-GroupsTest-1295184119 None] Volume volume-1c9f181d-5ef7-425c-bd53-cbd671f775d5 (1c9f181d-5ef7-425c-bd53-cbd671f775d5): created successfully
Nov 06 11:54:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-fa853783-0e33-455b-ba7f-8dca00742551 tempest-GroupsTest-1295184119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9915436c-50ef-42f0-b51e-f6ecffa4d738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:54:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-fa853783-0e33-455b-ba7f-8dca00742551 tempest-GroupsTest-1295184119 None] Flow 'volume_create_manager' (48a96cc9-9bc4-4ee2-9c7a-fc29829254fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:54:38 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-fa853783-0e33-455b-ba7f-8dca00742551 tempest-GroupsTest-1295184119 None] Created volume successfully.
Nov 06 11:54:40 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0e2acf2c-aa90-4fc9-8f37-903c234085ea tempest-GroupsTest-1295184119 None] Acquiring lock "cinder-quobyte-1c9f181d-5ef7-425c-bd53-cbd671f775d5" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:54:40 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0e2acf2c-aa90-4fc9-8f37-903c234085ea tempest-GroupsTest-1295184119 None] Lock "cinder-quobyte-1c9f181d-5ef7-425c-bd53-cbd671f775d5" acquired by "delete_volume" :: waited 0.034s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:54:40 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a003594b-a57b-451c-a4b3-b7e6e0aface3]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:54:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0e2acf2c-aa90-4fc9-8f37-903c234085ea tempest-GroupsTest-1295184119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1c9f181d-5ef7-425c-bd53-cbd671f775d5 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:54:40 devstack sudo[101300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1c9f181d-5ef7-425c-bd53-cbd671f775d5
Nov 06 11:54:40 devstack sudo[101300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:54:41 devstack sudo[101300]: pam_unix(sudo:session): session closed for user root
Nov 06 11:54:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0e2acf2c-aa90-4fc9-8f37-903c234085ea tempest-GroupsTest-1295184119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1c9f181d-5ef7-425c-bd53-cbd671f775d5" returned: 0 in 0.601s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:54:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0e2acf2c-aa90-4fc9-8f37-903c234085ea tempest-GroupsTest-1295184119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1c9f181d-5ef7-425c-bd53-cbd671f775d5 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:54:41 devstack sudo[101305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1c9f181d-5ef7-425c-bd53-cbd671f775d5
Nov 06 11:54:41 devstack sudo[101305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:54:41 devstack sudo[101305]: pam_unix(sudo:session): session closed for user root
Nov 06 11:54:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0e2acf2c-aa90-4fc9-8f37-903c234085ea tempest-GroupsTest-1295184119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1c9f181d-5ef7-425c-bd53-cbd671f775d5" returned: 0 in 0.306s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:54:41 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0e2acf2c-aa90-4fc9-8f37-903c234085ea tempest-GroupsTest-1295184119 None] Lock "cinder-quobyte-1c9f181d-5ef7-425c-bd53-cbd671f775d5" released by "delete_volume" :: held 1.023s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:54:41 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-0e2acf2c-aa90-4fc9-8f37-903c234085ea tempest-GroupsTest-1295184119 None] Created reservations ['a320aab0-b659-4773-a8f1-d3ece75f4141'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:54:41 devstack cinder-volume[87165]: WARNING cinder.quota [None req-0e2acf2c-aa90-4fc9-8f37-903c234085ea tempest-GroupsTest-1295184119 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1274731946 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1274731946, it is now deprecated. Please use the default quota class for default quota.
Nov 06 11:54:41 devstack cinder-volume[87165]: WARNING cinder.quota [None req-0e2acf2c-aa90-4fc9-8f37-903c234085ea tempest-GroupsTest-1295184119 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1274731946 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1274731946, it is now deprecated. Please use the default quota class for default quota.
Nov 06 11:54:41 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-0e2acf2c-aa90-4fc9-8f37-903c234085ea tempest-GroupsTest-1295184119 None] Created reservations ['f52d2a1a-7e45-4943-98d4-e52f07eab384', 'ea2719b1-9209-410d-a6ac-1d0a3902dee6', 'a6488c4e-1ab1-4893-a8ad-81b7cea9f65d', '36ebd40e-2d89-4f8e-938c-95fb01a2868d'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:54:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-0e2acf2c-aa90-4fc9-8f37-903c234085ea tempest-GroupsTest-1295184119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:54:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-0e2acf2c-aa90-4fc9-8f37-903c234085ea tempest-GroupsTest-1295184119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:54:42 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-0e2acf2c-aa90-4fc9-8f37-903c234085ea tempest-GroupsTest-1295184119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:54:42 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-0e2acf2c-aa90-4fc9-8f37-903c234085ea tempest-GroupsTest-1295184119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:54:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-0e2acf2c-aa90-4fc9-8f37-903c234085ea tempest-GroupsTest-1295184119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:54:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0e2acf2c-aa90-4fc9-8f37-903c234085ea tempest-GroupsTest-1295184119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:54:42 devstack sudo[101308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:54:42 devstack sudo[101308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:54:42 devstack sudo[101308]: pam_unix(sudo:session): session closed for user root
Nov 06 11:54:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0e2acf2c-aa90-4fc9-8f37-903c234085ea tempest-GroupsTest-1295184119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.410s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:54:42 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-0e2acf2c-aa90-4fc9-8f37-903c234085ea tempest-GroupsTest-1295184119 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:54:42 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-0e2acf2c-aa90-4fc9-8f37-903c234085ea tempest-GroupsTest-1295184119 None] Delete group completed successfully.
Nov 06 11:54:42 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-72894937-9404-4ed5-a8bb-36f8b9c941a4 tempest-GroupsTest-1295184119 None] Created reservations ['56e19ee3-7520-4889-a1e8-93bbd2104985'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:54:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-72894937-9404-4ed5-a8bb-36f8b9c941a4 tempest-GroupsTest-1295184119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:54:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-72894937-9404-4ed5-a8bb-36f8b9c941a4 tempest-GroupsTest-1295184119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:54:42 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-72894937-9404-4ed5-a8bb-36f8b9c941a4 tempest-GroupsTest-1295184119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:54:42 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-72894937-9404-4ed5-a8bb-36f8b9c941a4 tempest-GroupsTest-1295184119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:54:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-72894937-9404-4ed5-a8bb-36f8b9c941a4 tempest-GroupsTest-1295184119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:54:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-72894937-9404-4ed5-a8bb-36f8b9c941a4 tempest-GroupsTest-1295184119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:54:42 devstack sudo[101311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:54:42 devstack sudo[101311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:54:42 devstack sudo[101311]: pam_unix(sudo:session): session closed for user root
Nov 06 11:54:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-72894937-9404-4ed5-a8bb-36f8b9c941a4 tempest-GroupsTest-1295184119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.371s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:54:42 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-72894937-9404-4ed5-a8bb-36f8b9c941a4 tempest-GroupsTest-1295184119 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:54:42 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-72894937-9404-4ed5-a8bb-36f8b9c941a4 tempest-GroupsTest-1295184119 None] Delete group completed successfully.
Nov 06 11:54:44 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-81ce68e7-ada1-49d5-bdca-41d7ae57ae96 tempest-GroupsTest-1295184119 None] Group tempest-GroupsTest-Group-722780438: creating
Nov 06 11:54:45 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-81ce68e7-ada1-49d5-bdca-41d7ae57ae96 tempest-GroupsTest-1295184119 None] Group tempest-GroupsTest-Group-722780438: created successfully
Nov 06 11:54:45 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-81ce68e7-ada1-49d5-bdca-41d7ae57ae96 tempest-GroupsTest-1295184119 None] Create group completed successfully.
Nov 06 11:54:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-743a295d-9f5c-41a0-8f47-401ed0d0167b req-6b4246fa-7654-43f0-a88e-de5203358606 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:54:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-743a295d-9f5c-41a0-8f47-401ed0d0167b req-6b4246fa-7654-43f0-a88e-de5203358606 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:54:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-743a295d-9f5c-41a0-8f47-401ed0d0167b req-6b4246fa-7654-43f0-a88e-de5203358606 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:54:46 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-743a295d-9f5c-41a0-8f47-401ed0d0167b req-6b4246fa-7654-43f0-a88e-de5203358606 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50', 'name': 'volume-97d975a0-f59a-486b-a027-06eaab867f79', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '90f2cdf9-ffea-4c51-9228-f4a5a3ff7139', 'enforce_multipath': True} {{(pid=87165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 11:54:46 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-743a295d-9f5c-41a0-8f47-401ed0d0167b req-6b4246fa-7654-43f0-a88e-de5203358606 tempest-TestServerVolumeAttachmentScenario-1119344216 None] attachment_update completed successfully.
Nov 06 11:54:47 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-757f81f3-19a0-400d-8f81-5a7ae75099d1 tempest-GroupsTest-1295184119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:54:47 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-757f81f3-19a0-400d-8f81-5a7ae75099d1 tempest-GroupsTest-1295184119 None] Flow 'volume_create_manager' (19697c66-72f6-49d2-b347-bfde5fc3b6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:54:47 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-757f81f3-19a0-400d-8f81-5a7ae75099d1 tempest-GroupsTest-1295184119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96470baa-6573-47df-95d6-21dd684bda94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:54:47 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-757f81f3-19a0-400d-8f81-5a7ae75099d1 tempest-GroupsTest-1295184119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96470baa-6573-47df-95d6-21dd684bda94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2113116144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d8ddb121-afc4-45ef-884d-fb9a52ea4861,host='devstack@QuobyteHD#QuobyteHD',id=1f77e1b1-49db-4c3a-b1f4-17e19ea68504,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a98a11bb54834d6a838492f213fb6f44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:54:47Z,use_quota=True,user_id='e27a35124d6742a5bc8dbef323910b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0dafc61-9924-4f37-b499-2c1cc7a4e238),volume_type_id=f0dafc61-9924-4f37-b499-2c1cc7a4e238)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:54:47 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-757f81f3-19a0-400d-8f81-5a7ae75099d1 tempest-GroupsTest-1295184119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8cbd4bd-dd8f-4a81-a328-86cab3f4f18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:54:47 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-757f81f3-19a0-400d-8f81-5a7ae75099d1 tempest-GroupsTest-1295184119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8cbd4bd-dd8f-4a81-a328-86cab3f4f18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:54:47 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-757f81f3-19a0-400d-8f81-5a7ae75099d1 tempest-GroupsTest-1295184119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7232547-0721-4fcc-b886-6b7d2d0bed7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:54:47 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-757f81f3-19a0-400d-8f81-5a7ae75099d1 tempest-GroupsTest-1295184119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7232547-0721-4fcc-b886-6b7d2d0bed7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f77e1b1-49db-4c3a-b1f4-17e19ea68504', 'volume_name': 'volume-1f77e1b1-49db-4c3a-b1f4-17e19ea68504', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:54:47 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-757f81f3-19a0-400d-8f81-5a7ae75099d1 tempest-GroupsTest-1295184119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be4b124e-a4bc-4569-84e5-f40204e0554b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:54:47 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-757f81f3-19a0-400d-8f81-5a7ae75099d1 tempest-GroupsTest-1295184119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be4b124e-a4bc-4569-84e5-f40204e0554b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:54:47 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-757f81f3-19a0-400d-8f81-5a7ae75099d1 tempest-GroupsTest-1295184119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94ca633d-f9e6-4419-9c99-b11f84b93e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:54:47 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-757f81f3-19a0-400d-8f81-5a7ae75099d1 tempest-GroupsTest-1295184119 None] Volume 1f77e1b1-49db-4c3a-b1f4-17e19ea68504: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f77e1b1-49db-4c3a-b1f4-17e19ea68504', 'volume_size': 1}
Nov 06 11:54:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-757f81f3-19a0-400d-8f81-5a7ae75099d1 tempest-GroupsTest-1295184119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:54:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-757f81f3-19a0-400d-8f81-5a7ae75099d1 tempest-GroupsTest-1295184119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:54:47 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-757f81f3-19a0-400d-8f81-5a7ae75099d1 tempest-GroupsTest-1295184119 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d8ddb121-afc4-45ef-884d-fb9a52ea4861,created_at=2026-11-06T10:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2113116144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d8ddb121-afc4-45ef-884d-fb9a52ea4861,host='devstack@QuobyteHD#QuobyteHD',id=1f77e1b1-49db-4c3a-b1f4-17e19ea68504,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a98a11bb54834d6a838492f213fb6f44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:54:47Z,use_quota=True,user_id='e27a35124d6742a5bc8dbef323910b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0dafc61-9924-4f37-b499-2c1cc7a4e238),volume_type_id=f0dafc61-9924-4f37-b499-2c1cc7a4e238)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:54:47 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-757f81f3-19a0-400d-8f81-5a7ae75099d1 tempest-GroupsTest-1295184119 None] Creating volume 1f77e1b1-49db-4c3a-b1f4-17e19ea68504 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:54:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-757f81f3-19a0-400d-8f81-5a7ae75099d1 tempest-GroupsTest-1295184119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:54:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-757f81f3-19a0-400d-8f81-5a7ae75099d1 tempest-GroupsTest-1295184119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:54:47 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-757f81f3-19a0-400d-8f81-5a7ae75099d1 tempest-GroupsTest-1295184119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:54:47 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-757f81f3-19a0-400d-8f81-5a7ae75099d1 tempest-GroupsTest-1295184119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:54:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-757f81f3-19a0-400d-8f81-5a7ae75099d1 tempest-GroupsTest-1295184119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:54:47 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-757f81f3-19a0-400d-8f81-5a7ae75099d1 tempest-GroupsTest-1295184119 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:54:47 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-757f81f3-19a0-400d-8f81-5a7ae75099d1 tempest-GroupsTest-1295184119 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:54:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-757f81f3-19a0-400d-8f81-5a7ae75099d1 tempest-GroupsTest-1295184119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1f77e1b1-49db-4c3a-b1f4-17e19ea68504 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:54:47 devstack sudo[101746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1f77e1b1-49db-4c3a-b1f4-17e19ea68504 1073741824
Nov 06 11:54:47 devstack sudo[101746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:54:48 devstack sudo[101746]: pam_unix(sudo:session): session closed for user root
Nov 06 11:54:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-757f81f3-19a0-400d-8f81-5a7ae75099d1 tempest-GroupsTest-1295184119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1f77e1b1-49db-4c3a-b1f4-17e19ea68504 1073741824" returned: 0 in 0.712s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:54:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-757f81f3-19a0-400d-8f81-5a7ae75099d1 tempest-GroupsTest-1295184119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1f77e1b1-49db-4c3a-b1f4-17e19ea68504 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:54:48 devstack sudo[101752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1f77e1b1-49db-4c3a-b1f4-17e19ea68504
Nov 06 11:54:48 devstack sudo[101752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:54:48 devstack sudo[101752]: pam_unix(sudo:session): session closed for user root
Nov 06 11:54:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-757f81f3-19a0-400d-8f81-5a7ae75099d1 tempest-GroupsTest-1295184119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1f77e1b1-49db-4c3a-b1f4-17e19ea68504" returned: 0 in 0.680s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:54:48 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-757f81f3-19a0-400d-8f81-5a7ae75099d1 tempest-GroupsTest-1295184119 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:54:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-757f81f3-19a0-400d-8f81-5a7ae75099d1 tempest-GroupsTest-1295184119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:54:49 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-757f81f3-19a0-400d-8f81-5a7ae75099d1 tempest-GroupsTest-1295184119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94ca633d-f9e6-4419-9c99-b11f84b93e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f77e1b1-49db-4c3a-b1f4-17e19ea68504', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:54:49 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-757f81f3-19a0-400d-8f81-5a7ae75099d1 tempest-GroupsTest-1295184119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b4d1b8b-b367-4e54-ae06-969229dfa28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:54:49 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-757f81f3-19a0-400d-8f81-5a7ae75099d1 tempest-GroupsTest-1295184119 None] Volume volume-1f77e1b1-49db-4c3a-b1f4-17e19ea68504 (1f77e1b1-49db-4c3a-b1f4-17e19ea68504): created successfully
Nov 06 11:54:49 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-757f81f3-19a0-400d-8f81-5a7ae75099d1 tempest-GroupsTest-1295184119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b4d1b8b-b367-4e54-ae06-969229dfa28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:54:49 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-757f81f3-19a0-400d-8f81-5a7ae75099d1 tempest-GroupsTest-1295184119 None] Flow 'volume_create_manager' (19697c66-72f6-49d2-b347-bfde5fc3b6b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:54:49 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-757f81f3-19a0-400d-8f81-5a7ae75099d1 tempest-GroupsTest-1295184119 None] Created volume successfully.
Nov 06 11:54:50 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-983f1a87-1475-4741-8523-5bb31324dff9 tempest-GroupsTest-1295184119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-983f1a87-1475-4741-8523-5bb31324dff9 tempest-GroupsTest-1295184119 None] Flow 'volume_create_manager' (68942c7d-45f6-4962-b37a-f2498b862aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-983f1a87-1475-4741-8523-5bb31324dff9 tempest-GroupsTest-1295184119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (284ee741-d4ff-4c0d-92d1-9484fc818c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-983f1a87-1475-4741-8523-5bb31324dff9 tempest-GroupsTest-1295184119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (284ee741-d4ff-4c0d-92d1-9484fc818c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-805164912',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d8ddb121-afc4-45ef-884d-fb9a52ea4861,host='devstack@QuobyteHD#QuobyteHD',id=8733c8aa-291d-41d8-845a-a489692afa59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a98a11bb54834d6a838492f213fb6f44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:54:51Z,use_quota=True,user_id='e27a35124d6742a5bc8dbef323910b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0dafc61-9924-4f37-b499-2c1cc7a4e238),volume_type_id=f0dafc61-9924-4f37-b499-2c1cc7a4e238)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-983f1a87-1475-4741-8523-5bb31324dff9 tempest-GroupsTest-1295184119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f863058-5a0b-42b9-8dd9-59c8de30d931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-983f1a87-1475-4741-8523-5bb31324dff9 tempest-GroupsTest-1295184119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f863058-5a0b-42b9-8dd9-59c8de30d931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-983f1a87-1475-4741-8523-5bb31324dff9 tempest-GroupsTest-1295184119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ffba02a-96e1-4c9a-9015-9fca65c7f6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-983f1a87-1475-4741-8523-5bb31324dff9 tempest-GroupsTest-1295184119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ffba02a-96e1-4c9a-9015-9fca65c7f6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8733c8aa-291d-41d8-845a-a489692afa59', 'volume_name': 'volume-8733c8aa-291d-41d8-845a-a489692afa59', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-983f1a87-1475-4741-8523-5bb31324dff9 tempest-GroupsTest-1295184119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df769644-edf8-4af3-82f2-3bd40c06cce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-983f1a87-1475-4741-8523-5bb31324dff9 tempest-GroupsTest-1295184119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df769644-edf8-4af3-82f2-3bd40c06cce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-983f1a87-1475-4741-8523-5bb31324dff9 tempest-GroupsTest-1295184119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32cd1928-13db-4b11-bc56-293e4e31e61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:54:51 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-983f1a87-1475-4741-8523-5bb31324dff9 tempest-GroupsTest-1295184119 None] Volume 8733c8aa-291d-41d8-845a-a489692afa59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8733c8aa-291d-41d8-845a-a489692afa59', 'volume_size': 1}
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-983f1a87-1475-4741-8523-5bb31324dff9 tempest-GroupsTest-1295184119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-983f1a87-1475-4741-8523-5bb31324dff9 tempest-GroupsTest-1295184119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-983f1a87-1475-4741-8523-5bb31324dff9 tempest-GroupsTest-1295184119 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d8ddb121-afc4-45ef-884d-fb9a52ea4861,created_at=2026-11-06T10:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-805164912',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d8ddb121-afc4-45ef-884d-fb9a52ea4861,host='devstack@QuobyteHD#QuobyteHD',id=8733c8aa-291d-41d8-845a-a489692afa59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a98a11bb54834d6a838492f213fb6f44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:54:51Z,use_quota=True,user_id='e27a35124d6742a5bc8dbef323910b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0dafc61-9924-4f37-b499-2c1cc7a4e238),volume_type_id=f0dafc61-9924-4f37-b499-2c1cc7a4e238)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-983f1a87-1475-4741-8523-5bb31324dff9 tempest-GroupsTest-1295184119 None] Creating volume 8733c8aa-291d-41d8-845a-a489692afa59 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-983f1a87-1475-4741-8523-5bb31324dff9 tempest-GroupsTest-1295184119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-983f1a87-1475-4741-8523-5bb31324dff9 tempest-GroupsTest-1295184119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-983f1a87-1475-4741-8523-5bb31324dff9 tempest-GroupsTest-1295184119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-983f1a87-1475-4741-8523-5bb31324dff9 tempest-GroupsTest-1295184119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-983f1a87-1475-4741-8523-5bb31324dff9 tempest-GroupsTest-1295184119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-983f1a87-1475-4741-8523-5bb31324dff9 tempest-GroupsTest-1295184119 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:54:51 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-983f1a87-1475-4741-8523-5bb31324dff9 tempest-GroupsTest-1295184119 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-983f1a87-1475-4741-8523-5bb31324dff9 tempest-GroupsTest-1295184119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8733c8aa-291d-41d8-845a-a489692afa59 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:54:51 devstack sudo[101766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8733c8aa-291d-41d8-845a-a489692afa59 1073741824
Nov 06 11:54:51 devstack sudo[101766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-69231a1d-fb24-441e-ace6-a2e43cda2505 tempest-VolumesSnapshotTestJSON-647850410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-69231a1d-fb24-441e-ace6-a2e43cda2505 tempest-VolumesSnapshotTestJSON-647850410 None] Flow 'volume_create_manager' (3f6288ec-11c5-4f59-b1cf-e5e936d5d508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-69231a1d-fb24-441e-ace6-a2e43cda2505 tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31da04e8-57fc-438c-96b3-105e5fefd9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-69231a1d-fb24-441e-ace6-a2e43cda2505 tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31da04e8-57fc-438c-96b3-105e5fefd9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-276606241',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11719517-67f7-4340-9d5a-5b1514400f36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f11fff5588b439f948dd78ef71e0501',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:54:51Z,use_quota=True,user_id='bebe3e8017604b2481907f107f937beb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-69231a1d-fb24-441e-ace6-a2e43cda2505 tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f38c8e85-8b8f-40f1-8dcb-7bfb26c35d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-69231a1d-fb24-441e-ace6-a2e43cda2505 tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f38c8e85-8b8f-40f1-8dcb-7bfb26c35d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-69231a1d-fb24-441e-ace6-a2e43cda2505 tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad47d619-4b8b-46de-af5f-5031ee15453b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-69231a1d-fb24-441e-ace6-a2e43cda2505 tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad47d619-4b8b-46de-af5f-5031ee15453b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11719517-67f7-4340-9d5a-5b1514400f36', 'volume_name': 'volume-11719517-67f7-4340-9d5a-5b1514400f36', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-69231a1d-fb24-441e-ace6-a2e43cda2505 tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f50fab8-28e6-494f-90aa-073011d40bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-69231a1d-fb24-441e-ace6-a2e43cda2505 tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f50fab8-28e6-494f-90aa-073011d40bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-69231a1d-fb24-441e-ace6-a2e43cda2505 tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95644394-d180-4372-9845-2f130a654c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:54:51 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-69231a1d-fb24-441e-ace6-a2e43cda2505 tempest-VolumesSnapshotTestJSON-647850410 None] Volume 11719517-67f7-4340-9d5a-5b1514400f36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11719517-67f7-4340-9d5a-5b1514400f36', 'volume_size': 1}
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-69231a1d-fb24-441e-ace6-a2e43cda2505 tempest-VolumesSnapshotTestJSON-647850410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:54:51 devstack sudo[101766]: pam_unix(sudo:session): session closed for user root
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-983f1a87-1475-4741-8523-5bb31324dff9 tempest-GroupsTest-1295184119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8733c8aa-291d-41d8-845a-a489692afa59 1073741824" returned: 0 in 0.456s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-983f1a87-1475-4741-8523-5bb31324dff9 tempest-GroupsTest-1295184119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8733c8aa-291d-41d8-845a-a489692afa59 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:54:51 devstack sudo[101772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8733c8aa-291d-41d8-845a-a489692afa59
Nov 06 11:54:51 devstack sudo[101772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:54:51 devstack sudo[101772]: pam_unix(sudo:session): session closed for user root
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-983f1a87-1475-4741-8523-5bb31324dff9 tempest-GroupsTest-1295184119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8733c8aa-291d-41d8-845a-a489692afa59" returned: 0 in 0.261s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-983f1a87-1475-4741-8523-5bb31324dff9 tempest-GroupsTest-1295184119 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-983f1a87-1475-4741-8523-5bb31324dff9 tempest-GroupsTest-1295184119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-69231a1d-fb24-441e-ace6-a2e43cda2505 tempest-VolumesSnapshotTestJSON-647850410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.637s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-69231a1d-fb24-441e-ace6-a2e43cda2505 tempest-VolumesSnapshotTestJSON-647850410 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-276606241',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11719517-67f7-4340-9d5a-5b1514400f36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f11fff5588b439f948dd78ef71e0501',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:54:51Z,use_quota=True,user_id='bebe3e8017604b2481907f107f937beb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-69231a1d-fb24-441e-ace6-a2e43cda2505 tempest-VolumesSnapshotTestJSON-647850410 None] Creating volume 11719517-67f7-4340-9d5a-5b1514400f36 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-69231a1d-fb24-441e-ace6-a2e43cda2505 tempest-VolumesSnapshotTestJSON-647850410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-69231a1d-fb24-441e-ace6-a2e43cda2505 tempest-VolumesSnapshotTestJSON-647850410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-69231a1d-fb24-441e-ace6-a2e43cda2505 tempest-VolumesSnapshotTestJSON-647850410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-69231a1d-fb24-441e-ace6-a2e43cda2505 tempest-VolumesSnapshotTestJSON-647850410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-69231a1d-fb24-441e-ace6-a2e43cda2505 tempest-VolumesSnapshotTestJSON-647850410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-69231a1d-fb24-441e-ace6-a2e43cda2505 tempest-VolumesSnapshotTestJSON-647850410 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:54:51 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-69231a1d-fb24-441e-ace6-a2e43cda2505 tempest-VolumesSnapshotTestJSON-647850410 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-69231a1d-fb24-441e-ace6-a2e43cda2505 tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-11719517-67f7-4340-9d5a-5b1514400f36 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-983f1a87-1475-4741-8523-5bb31324dff9 tempest-GroupsTest-1295184119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32cd1928-13db-4b11-bc56-293e4e31e61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8733c8aa-291d-41d8-845a-a489692afa59', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-983f1a87-1475-4741-8523-5bb31324dff9 tempest-GroupsTest-1295184119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da206212-0f79-46d1-9f42-51e73576cf6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:54:51 devstack sudo[101778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-11719517-67f7-4340-9d5a-5b1514400f36 1073741824
Nov 06 11:54:51 devstack sudo[101778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:54:51 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-983f1a87-1475-4741-8523-5bb31324dff9 tempest-GroupsTest-1295184119 None] Volume volume-8733c8aa-291d-41d8-845a-a489692afa59 (8733c8aa-291d-41d8-845a-a489692afa59): created successfully
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-983f1a87-1475-4741-8523-5bb31324dff9 tempest-GroupsTest-1295184119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da206212-0f79-46d1-9f42-51e73576cf6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:54:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-983f1a87-1475-4741-8523-5bb31324dff9 tempest-GroupsTest-1295184119 None] Flow 'volume_create_manager' (68942c7d-45f6-4962-b37a-f2498b862aec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:54:51 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-983f1a87-1475-4741-8523-5bb31324dff9 tempest-GroupsTest-1295184119 None] Created volume successfully.
Nov 06 11:54:52 devstack sudo[101778]: pam_unix(sudo:session): session closed for user root
Nov 06 11:54:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-69231a1d-fb24-441e-ace6-a2e43cda2505 tempest-VolumesSnapshotTestJSON-647850410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-11719517-67f7-4340-9d5a-5b1514400f36 1073741824" returned: 0 in 0.527s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:54:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-7d0ab83b-0ab6-4883-bd83-1a18b5ef28b4 req-92e7cc11-2435-435f-97aa-e96c5ff8e916 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:54:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-69231a1d-fb24-441e-ace6-a2e43cda2505 tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-11719517-67f7-4340-9d5a-5b1514400f36 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:54:52 devstack sudo[101792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-11719517-67f7-4340-9d5a-5b1514400f36
Nov 06 11:54:52 devstack sudo[101792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:54:52 devstack sudo[101792]: pam_unix(sudo:session): session closed for user root
Nov 06 11:54:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-69231a1d-fb24-441e-ace6-a2e43cda2505 tempest-VolumesSnapshotTestJSON-647850410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-11719517-67f7-4340-9d5a-5b1514400f36" returned: 0 in 0.242s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:54:52 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-69231a1d-fb24-441e-ace6-a2e43cda2505 tempest-VolumesSnapshotTestJSON-647850410 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:54:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-69231a1d-fb24-441e-ace6-a2e43cda2505 tempest-VolumesSnapshotTestJSON-647850410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:54:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-7d0ab83b-0ab6-4883-bd83-1a18b5ef28b4 req-92e7cc11-2435-435f-97aa-e96c5ff8e916 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.264s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:54:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-7d0ab83b-0ab6-4883-bd83-1a18b5ef28b4 req-92e7cc11-2435-435f-97aa-e96c5ff8e916 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:54:52 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-69231a1d-fb24-441e-ace6-a2e43cda2505 tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95644394-d180-4372-9845-2f130a654c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11719517-67f7-4340-9d5a-5b1514400f36', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:54:52 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-69231a1d-fb24-441e-ace6-a2e43cda2505 tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f468eae-1808-48d3-a9a2-6157949f634e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:54:52 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-69231a1d-fb24-441e-ace6-a2e43cda2505 tempest-VolumesSnapshotTestJSON-647850410 None] Volume volume-11719517-67f7-4340-9d5a-5b1514400f36 (11719517-67f7-4340-9d5a-5b1514400f36): created successfully
Nov 06 11:54:52 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-69231a1d-fb24-441e-ace6-a2e43cda2505 tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f468eae-1808-48d3-a9a2-6157949f634e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:54:52 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-69231a1d-fb24-441e-ace6-a2e43cda2505 tempest-VolumesSnapshotTestJSON-647850410 None] Flow 'volume_create_manager' (3f6288ec-11c5-4f59-b1cf-e5e936d5d508) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:54:52 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-7d0ab83b-0ab6-4883-bd83-1a18b5ef28b4 req-92e7cc11-2435-435f-97aa-e96c5ff8e916 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50', 'name': 'volume-3e9b0588-c5fd-4d84-830a-bf081c2d7260', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9a3bcc52-761e-4837-97bc-2aa835016b98', 'enforce_multipath': True} {{(pid=87165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 11:54:52 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-69231a1d-fb24-441e-ace6-a2e43cda2505 tempest-VolumesSnapshotTestJSON-647850410 None] Created volume successfully.
Nov 06 11:54:52 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-7d0ab83b-0ab6-4883-bd83-1a18b5ef28b4 req-92e7cc11-2435-435f-97aa-e96c5ff8e916 tempest-TestServerVolumeAttachmentScenario-1119344216 None] attachment_update completed successfully.
Nov 06 11:54:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-bc4fa0f3-fd49-4494-8192-6a8761583335 tempest-VolumesSnapshotTestJSON-647850410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:54:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-bc4fa0f3-fd49-4494-8192-6a8761583335 tempest-VolumesSnapshotTestJSON-647850410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:54:53 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-bc4fa0f3-fd49-4494-8192-6a8761583335 tempest-VolumesSnapshotTestJSON-647850410 None] Creating offline snapshot 2361f033-388a-46a5-885a-4acb5d50164a of volume 11719517-67f7-4340-9d5a-5b1514400f36 {{(pid=87165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 11:54:53 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da0c433-418d-4154-af65-b962e27aa093]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:54:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bc4fa0f3-fd49-4494-8192-6a8761583335 tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-11719517-67f7-4340-9d5a-5b1514400f36 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:54:53 devstack sudo[101797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-11719517-67f7-4340-9d5a-5b1514400f36
Nov 06 11:54:53 devstack sudo[101797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:54:53 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-1ae19c37-bd41-45eb-a1c8-d3da44c15122 tempest-GroupsTest-1295184119 None] Update group completed successfully.
Nov 06 11:54:53 devstack sudo[101797]: pam_unix(sudo:session): session closed for user root
Nov 06 11:54:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bc4fa0f3-fd49-4494-8192-6a8761583335 tempest-VolumesSnapshotTestJSON-647850410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-11719517-67f7-4340-9d5a-5b1514400f36" returned: 0 in 0.366s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:54:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bc4fa0f3-fd49-4494-8192-6a8761583335 tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-11719517-67f7-4340-9d5a-5b1514400f36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-11719517-67f7-4340-9d5a-5b1514400f36.2361f033-388a-46a5-885a-4acb5d50164a 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:54:53 devstack sudo[101802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-11719517-67f7-4340-9d5a-5b1514400f36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-11719517-67f7-4340-9d5a-5b1514400f36.2361f033-388a-46a5-885a-4acb5d50164a 1G
Nov 06 11:54:53 devstack sudo[101802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:54:54 devstack sudo[101802]: pam_unix(sudo:session): session closed for user root
Nov 06 11:54:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bc4fa0f3-fd49-4494-8192-6a8761583335 tempest-VolumesSnapshotTestJSON-647850410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-11719517-67f7-4340-9d5a-5b1514400f36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-11719517-67f7-4340-9d5a-5b1514400f36.2361f033-388a-46a5-885a-4acb5d50164a 1G" returned: 0 in 0.437s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:54:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bc4fa0f3-fd49-4494-8192-6a8761583335 tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11719517-67f7-4340-9d5a-5b1514400f36 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-11719517-67f7-4340-9d5a-5b1514400f36.2361f033-388a-46a5-885a-4acb5d50164a {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:54:54 devstack sudo[101808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11719517-67f7-4340-9d5a-5b1514400f36 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-11719517-67f7-4340-9d5a-5b1514400f36.2361f033-388a-46a5-885a-4acb5d50164a
Nov 06 11:54:54 devstack sudo[101808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:54:54 devstack sudo[101808]: pam_unix(sudo:session): session closed for user root
Nov 06 11:54:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bc4fa0f3-fd49-4494-8192-6a8761583335 tempest-VolumesSnapshotTestJSON-647850410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11719517-67f7-4340-9d5a-5b1514400f36 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-11719517-67f7-4340-9d5a-5b1514400f36.2361f033-388a-46a5-885a-4acb5d50164a" returned: 0 in 0.334s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:54:54 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-bc4fa0f3-fd49-4494-8192-6a8761583335 tempest-VolumesSnapshotTestJSON-647850410 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-11719517-67f7-4340-9d5a-5b1514400f36.2361f033-388a-46a5-885a-4acb5d50164a is being set with open permissions: ugo+rw
Nov 06 11:54:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bc4fa0f3-fd49-4494-8192-6a8761583335 tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-11719517-67f7-4340-9d5a-5b1514400f36.2361f033-388a-46a5-885a-4acb5d50164a {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:54:54 devstack sudo[101818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-11719517-67f7-4340-9d5a-5b1514400f36.2361f033-388a-46a5-885a-4acb5d50164a
Nov 06 11:54:54 devstack sudo[101818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:54:54 devstack sudo[101818]: pam_unix(sudo:session): session closed for user root
Nov 06 11:54:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bc4fa0f3-fd49-4494-8192-6a8761583335 tempest-VolumesSnapshotTestJSON-647850410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-11719517-67f7-4340-9d5a-5b1514400f36.2361f033-388a-46a5-885a-4acb5d50164a" returned: 0 in 0.325s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:54:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bc4fa0f3-fd49-4494-8192-6a8761583335 tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-11719517-67f7-4340-9d5a-5b1514400f36.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:54:54 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-c9ecc238-2680-499e-bcd8-023d2e7d93e2 tempest-GroupsTest-1295184119 None] Update group completed successfully.
Nov 06 11:54:54 devstack sudo[101830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-11719517-67f7-4340-9d5a-5b1514400f36.info
Nov 06 11:54:54 devstack sudo[101830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:54:55 devstack sudo[101830]: pam_unix(sudo:session): session closed for user root
Nov 06 11:54:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bc4fa0f3-fd49-4494-8192-6a8761583335 tempest-VolumesSnapshotTestJSON-647850410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-11719517-67f7-4340-9d5a-5b1514400f36.info" returned: 0 in 0.272s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:54:55 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-bc4fa0f3-fd49-4494-8192-6a8761583335 tempest-VolumesSnapshotTestJSON-647850410 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-11719517-67f7-4340-9d5a-5b1514400f36.info is being set with open permissions: ugo+rw
Nov 06 11:54:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bc4fa0f3-fd49-4494-8192-6a8761583335 tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-11719517-67f7-4340-9d5a-5b1514400f36.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:54:55 devstack sudo[101837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-11719517-67f7-4340-9d5a-5b1514400f36.info
Nov 06 11:54:55 devstack sudo[101837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:54:55 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-47308aca-2a17-4ff6-9014-204b9779c576 req-cdcf2937-43ef-4674-ab22-d41494bd4a77 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Terminate volume connection completed successfully.
Nov 06 11:54:55 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-47308aca-2a17-4ff6-9014-204b9779c576 req-cdcf2937-43ef-4674-ab22-d41494bd4a77 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Deleting attachment 9a3bcc52-761e-4837-97bc-2aa835016b98. {{(pid=87165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 11:54:55 devstack sudo[101837]: pam_unix(sudo:session): session closed for user root
Nov 06 11:54:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bc4fa0f3-fd49-4494-8192-6a8761583335 tempest-VolumesSnapshotTestJSON-647850410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-11719517-67f7-4340-9d5a-5b1514400f36.info" returned: 0 in 0.274s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:54:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-bc4fa0f3-fd49-4494-8192-6a8761583335 tempest-VolumesSnapshotTestJSON-647850410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.163s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:54:55 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-bc4fa0f3-fd49-4494-8192-6a8761583335 tempest-VolumesSnapshotTestJSON-647850410 None] Create snapshot completed successfully
Nov 06 11:54:56 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-bbceaefa-a2c7-4400-a6f9-fddb42de7439 tempest-GroupsTest-1295184119 None] Acquiring lock "cinder-quobyte-1f77e1b1-49db-4c3a-b1f4-17e19ea68504" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:54:56 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-bbceaefa-a2c7-4400-a6f9-fddb42de7439 tempest-GroupsTest-1295184119 None] Lock "cinder-quobyte-1f77e1b1-49db-4c3a-b1f4-17e19ea68504" acquired by "delete_volume" :: waited 0.029s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:54:56 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[41661d18-4e49-4394-aee6-c79f4c84a3fb]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:54:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bbceaefa-a2c7-4400-a6f9-fddb42de7439 tempest-GroupsTest-1295184119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1f77e1b1-49db-4c3a-b1f4-17e19ea68504 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:54:56 devstack sudo[101845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1f77e1b1-49db-4c3a-b1f4-17e19ea68504
Nov 06 11:54:56 devstack sudo[101845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:54:56 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a6119622-b933-4474-a139-bde01af3fa77 tempest-VolumesSnapshotTestJSON-647850410 None] Acquiring lock "cinder-2361f033-388a-46a5-885a-4acb5d50164a-delete_snapshot" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:54:56 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a6119622-b933-4474-a139-bde01af3fa77 tempest-VolumesSnapshotTestJSON-647850410 None] Lock "cinder-2361f033-388a-46a5-885a-4acb5d50164a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:54:56 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a6119622-b933-4474-a139-bde01af3fa77 tempest-VolumesSnapshotTestJSON-647850410 None] Acquiring lock "cinder-quobyte-11719517-67f7-4340-9d5a-5b1514400f36" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:54:56 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a6119622-b933-4474-a139-bde01af3fa77 tempest-VolumesSnapshotTestJSON-647850410 None] Lock "cinder-quobyte-11719517-67f7-4340-9d5a-5b1514400f36" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:54:56 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a6119622-b933-4474-a139-bde01af3fa77 tempest-VolumesSnapshotTestJSON-647850410 None] Acquiring lock "cinder-quobyte-2361f033-388a-46a5-885a-4acb5d50164a" by "_delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:54:56 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a6119622-b933-4474-a139-bde01af3fa77 tempest-VolumesSnapshotTestJSON-647850410 None] Lock "cinder-quobyte-2361f033-388a-46a5-885a-4acb5d50164a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:54:56 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-a6119622-b933-4474-a139-bde01af3fa77 tempest-VolumesSnapshotTestJSON-647850410 None] Deleting offline snapshot 2361f033-388a-46a5-885a-4acb5d50164a of volume 11719517-67f7-4340-9d5a-5b1514400f36 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 11:54:56 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-a6119622-b933-4474-a139-bde01af3fa77 tempest-VolumesSnapshotTestJSON-647850410 None] snapshot_file for this snap is: volume-11719517-67f7-4340-9d5a-5b1514400f36.2361f033-388a-46a5-885a-4acb5d50164a {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 11:54:56 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1482db-64f3-438d-9caa-94f4e249d7a3]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:54:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a6119622-b933-4474-a139-bde01af3fa77 tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-11719517-67f7-4340-9d5a-5b1514400f36.2361f033-388a-46a5-885a-4acb5d50164a {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:54:56 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-2cdfa61e-aa2f-4816-bf8c-e1c502548bb6 req-9dbc7925-0147-4d5e-89a6-51d53ee01270 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Terminate volume connection completed successfully.
Nov 06 11:54:56 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-2cdfa61e-aa2f-4816-bf8c-e1c502548bb6 req-9dbc7925-0147-4d5e-89a6-51d53ee01270 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Deleting attachment 90f2cdf9-ffea-4c51-9228-f4a5a3ff7139. {{(pid=87165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 11:54:56 devstack sudo[101848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-11719517-67f7-4340-9d5a-5b1514400f36.2361f033-388a-46a5-885a-4acb5d50164a
Nov 06 11:54:56 devstack sudo[101848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:54:57 devstack sudo[101845]: pam_unix(sudo:session): session closed for user root
Nov 06 11:54:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bbceaefa-a2c7-4400-a6f9-fddb42de7439 tempest-GroupsTest-1295184119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1f77e1b1-49db-4c3a-b1f4-17e19ea68504" returned: 0 in 0.508s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:54:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bbceaefa-a2c7-4400-a6f9-fddb42de7439 tempest-GroupsTest-1295184119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1f77e1b1-49db-4c3a-b1f4-17e19ea68504 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:54:57 devstack sudo[101879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1f77e1b1-49db-4c3a-b1f4-17e19ea68504
Nov 06 11:54:57 devstack sudo[101879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:54:57 devstack sudo[101848]: pam_unix(sudo:session): session closed for user root
Nov 06 11:54:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a6119622-b933-4474-a139-bde01af3fa77 tempest-VolumesSnapshotTestJSON-647850410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-11719517-67f7-4340-9d5a-5b1514400f36.2361f033-388a-46a5-885a-4acb5d50164a" returned: 0 in 0.420s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:54:57 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-a6119622-b933-4474-a139-bde01af3fa77 tempest-VolumesSnapshotTestJSON-647850410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11719517-67f7-4340-9d5a-5b1514400f36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:54:57 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2283e775-6adf-4192-b286-78bb6575384b]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:54:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a6119622-b933-4474-a139-bde01af3fa77 tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-11719517-67f7-4340-9d5a-5b1514400f36 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:54:57 devstack sudo[101879]: pam_unix(sudo:session): session closed for user root
Nov 06 11:54:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bbceaefa-a2c7-4400-a6f9-fddb42de7439 tempest-GroupsTest-1295184119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1f77e1b1-49db-4c3a-b1f4-17e19ea68504" returned: 0 in 0.288s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:54:57 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-bbceaefa-a2c7-4400-a6f9-fddb42de7439 tempest-GroupsTest-1295184119 None] Lock "cinder-quobyte-1f77e1b1-49db-4c3a-b1f4-17e19ea68504" released by "delete_volume" :: held 0.850s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:54:57 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-bbceaefa-a2c7-4400-a6f9-fddb42de7439 tempest-GroupsTest-1295184119 None] Acquiring lock "cinder-quobyte-8733c8aa-291d-41d8-845a-a489692afa59" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:54:57 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-bbceaefa-a2c7-4400-a6f9-fddb42de7439 tempest-GroupsTest-1295184119 None] Lock "cinder-quobyte-8733c8aa-291d-41d8-845a-a489692afa59" acquired by "delete_volume" :: waited 0.015s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:54:57 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed3d5e4-45d9-45ec-a472-eee1be036e02]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:54:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bbceaefa-a2c7-4400-a6f9-fddb42de7439 tempest-GroupsTest-1295184119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8733c8aa-291d-41d8-845a-a489692afa59 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:54:57 devstack sudo[101884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-11719517-67f7-4340-9d5a-5b1514400f36
Nov 06 11:54:57 devstack sudo[101884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:54:57 devstack sudo[101887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8733c8aa-291d-41d8-845a-a489692afa59
Nov 06 11:54:57 devstack sudo[101887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:54:57 devstack sudo[101884]: pam_unix(sudo:session): session closed for user root
Nov 06 11:54:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a6119622-b933-4474-a139-bde01af3fa77 tempest-VolumesSnapshotTestJSON-647850410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-11719517-67f7-4340-9d5a-5b1514400f36" returned: 0 in 0.398s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:54:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a6119622-b933-4474-a139-bde01af3fa77 tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-11719517-67f7-4340-9d5a-5b1514400f36.2361f033-388a-46a5-885a-4acb5d50164a {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:54:57 devstack sudo[101892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-11719517-67f7-4340-9d5a-5b1514400f36.2361f033-388a-46a5-885a-4acb5d50164a
Nov 06 11:54:57 devstack sudo[101892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:54:57 devstack sudo[101887]: pam_unix(sudo:session): session closed for user root
Nov 06 11:54:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bbceaefa-a2c7-4400-a6f9-fddb42de7439 tempest-GroupsTest-1295184119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8733c8aa-291d-41d8-845a-a489692afa59" returned: 0 in 0.426s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:54:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bbceaefa-a2c7-4400-a6f9-fddb42de7439 tempest-GroupsTest-1295184119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8733c8aa-291d-41d8-845a-a489692afa59 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:54:57 devstack sudo[101899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8733c8aa-291d-41d8-845a-a489692afa59
Nov 06 11:54:57 devstack sudo[101899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:54:58 devstack sudo[101892]: pam_unix(sudo:session): session closed for user root
Nov 06 11:54:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a6119622-b933-4474-a139-bde01af3fa77 tempest-VolumesSnapshotTestJSON-647850410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-11719517-67f7-4340-9d5a-5b1514400f36.2361f033-388a-46a5-885a-4acb5d50164a" returned: 0 in 0.448s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:54:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a6119622-b933-4474-a139-bde01af3fa77 tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-11719517-67f7-4340-9d5a-5b1514400f36.2361f033-388a-46a5-885a-4acb5d50164a {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:54:58 devstack sudo[101899]: pam_unix(sudo:session): session closed for user root
Nov 06 11:54:58 devstack sudo[101907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-11719517-67f7-4340-9d5a-5b1514400f36.2361f033-388a-46a5-885a-4acb5d50164a
Nov 06 11:54:58 devstack sudo[101907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:54:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bbceaefa-a2c7-4400-a6f9-fddb42de7439 tempest-GroupsTest-1295184119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8733c8aa-291d-41d8-845a-a489692afa59" returned: 0 in 0.337s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:54:58 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-bbceaefa-a2c7-4400-a6f9-fddb42de7439 tempest-GroupsTest-1295184119 None] Lock "cinder-quobyte-8733c8aa-291d-41d8-845a-a489692afa59" released by "delete_volume" :: held 0.806s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:54:58 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-bbceaefa-a2c7-4400-a6f9-fddb42de7439 tempest-GroupsTest-1295184119 None] Created reservations ['47245681-3184-4131-983f-a4a84b12f4e9'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:54:58 devstack cinder-volume[87165]: WARNING cinder.quota [None req-bbceaefa-a2c7-4400-a6f9-fddb42de7439 tempest-GroupsTest-1295184119 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-180908558 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-180908558, it is now deprecated. Please use the default quota class for default quota.
Nov 06 11:54:58 devstack cinder-volume[87165]: WARNING cinder.quota [None req-bbceaefa-a2c7-4400-a6f9-fddb42de7439 tempest-GroupsTest-1295184119 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-180908558 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-180908558, it is now deprecated. Please use the default quota class for default quota.
Nov 06 11:54:58 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-bbceaefa-a2c7-4400-a6f9-fddb42de7439 tempest-GroupsTest-1295184119 None] Created reservations ['0df2dd76-ccc5-467e-875a-f0410fb884b9', '9818973f-c207-4095-8fd4-878011d75085', 'b7a89fe5-a567-4e34-9742-5fd843815ca1', '3244270f-d09c-42e6-a13d-35f07bf36b46'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:54:58 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-bbceaefa-a2c7-4400-a6f9-fddb42de7439 tempest-GroupsTest-1295184119 None] Created reservations ['273fe6a4-52da-4c7c-85a2-b1e34ecbd8b3', 'b42ff804-2667-4e08-be67-c5eb86d4dc4f', 'c4e78295-40c5-43ea-bd82-3eb81654c737', '19e98812-37dd-4e1c-9750-cc2653cc8922'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:54:58 devstack sudo[101907]: pam_unix(sudo:session): session closed for user root
Nov 06 11:54:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a6119622-b933-4474-a139-bde01af3fa77 tempest-VolumesSnapshotTestJSON-647850410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-11719517-67f7-4340-9d5a-5b1514400f36.2361f033-388a-46a5-885a-4acb5d50164a" returned: 0 in 0.456s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:54:58 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a6119622-b933-4474-a139-bde01af3fa77 tempest-VolumesSnapshotTestJSON-647850410 None] Lock "cinder-quobyte-2361f033-388a-46a5-885a-4acb5d50164a" released by "_delete_snapshot" :: held 1.845s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:54:58 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a6119622-b933-4474-a139-bde01af3fa77 tempest-VolumesSnapshotTestJSON-647850410 None] Lock "cinder-quobyte-11719517-67f7-4340-9d5a-5b1514400f36" released by "delete_snapshot" :: held 1.875s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:54:58 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-a6119622-b933-4474-a139-bde01af3fa77 tempest-VolumesSnapshotTestJSON-647850410 None] Created reservations ['4eeddd9e-61ef-4545-8d66-e31faf5a7879', '7a598b5f-5f18-4622-8af5-5f613290954e', '4c63bc4c-68ce-49eb-bdcc-e19e47731c2b', 'b8775280-f834-41a5-a615-25443b7b484a'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:54:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-bbceaefa-a2c7-4400-a6f9-fddb42de7439 tempest-GroupsTest-1295184119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:54:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-bbceaefa-a2c7-4400-a6f9-fddb42de7439 tempest-GroupsTest-1295184119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:54:58 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-bbceaefa-a2c7-4400-a6f9-fddb42de7439 tempest-GroupsTest-1295184119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:54:58 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-bbceaefa-a2c7-4400-a6f9-fddb42de7439 tempest-GroupsTest-1295184119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:54:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-bbceaefa-a2c7-4400-a6f9-fddb42de7439 tempest-GroupsTest-1295184119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:54:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bbceaefa-a2c7-4400-a6f9-fddb42de7439 tempest-GroupsTest-1295184119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:54:58 devstack sudo[101930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:54:58 devstack sudo[101930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:54:58 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-a6119622-b933-4474-a139-bde01af3fa77 tempest-VolumesSnapshotTestJSON-647850410 None] Delete snapshot completed successfully.
Nov 06 11:54:58 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a6119622-b933-4474-a139-bde01af3fa77 tempest-VolumesSnapshotTestJSON-647850410 None] Lock "cinder-2361f033-388a-46a5-885a-4acb5d50164a-delete_snapshot" released by "delete_snapshot" :: held 2.198s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:54:59 devstack sudo[101930]: pam_unix(sudo:session): session closed for user root
Nov 06 11:54:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-bbceaefa-a2c7-4400-a6f9-fddb42de7439 tempest-GroupsTest-1295184119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.415s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:54:59 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-bbceaefa-a2c7-4400-a6f9-fddb42de7439 tempest-GroupsTest-1295184119 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:54:59 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-bbceaefa-a2c7-4400-a6f9-fddb42de7439 tempest-GroupsTest-1295184119 None] Delete group completed successfully.
Nov 06 11:54:59 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c6e597a-c497-4e0d-b9b1-bca750934a0b tempest-VolumesSnapshotTestJSON-647850410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:54:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7c6e597a-c497-4e0d-b9b1-bca750934a0b tempest-VolumesSnapshotTestJSON-647850410 None] Flow 'volume_create_manager' (2f564cd0-687b-4671-b1e8-0fba2e5ae4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:54:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7c6e597a-c497-4e0d-b9b1-bca750934a0b tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0cad505-077c-4b57-8a09-f9826f40092c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:54:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7c6e597a-c497-4e0d-b9b1-bca750934a0b tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0cad505-077c-4b57-8a09-f9826f40092c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1896881034',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=563a5cbf-21fe-4a81-8006-775d7bee67bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f11fff5588b439f948dd78ef71e0501',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:55:00Z,use_quota=True,user_id='bebe3e8017604b2481907f107f937beb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:54:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7c6e597a-c497-4e0d-b9b1-bca750934a0b tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1147f0a-dd92-45f2-8d2f-7f565e4f7c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:54:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7c6e597a-c497-4e0d-b9b1-bca750934a0b tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1147f0a-dd92-45f2-8d2f-7f565e4f7c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:54:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7c6e597a-c497-4e0d-b9b1-bca750934a0b tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (881fdef9-5d84-462f-8769-80aea535a560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:54:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7c6e597a-c497-4e0d-b9b1-bca750934a0b tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (881fdef9-5d84-462f-8769-80aea535a560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '563a5cbf-21fe-4a81-8006-775d7bee67bc', 'volume_name': 'volume-563a5cbf-21fe-4a81-8006-775d7bee67bc', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:54:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7c6e597a-c497-4e0d-b9b1-bca750934a0b tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e342f78-6b20-49e9-86d3-8cdfb9fcefbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:54:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7c6e597a-c497-4e0d-b9b1-bca750934a0b tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e342f78-6b20-49e9-86d3-8cdfb9fcefbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:54:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7c6e597a-c497-4e0d-b9b1-bca750934a0b tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f71e1b6-93eb-44db-8449-d5c3d65f5fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:54:59 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-7c6e597a-c497-4e0d-b9b1-bca750934a0b tempest-VolumesSnapshotTestJSON-647850410 None] Volume 563a5cbf-21fe-4a81-8006-775d7bee67bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-563a5cbf-21fe-4a81-8006-775d7bee67bc', 'volume_size': 1}
Nov 06 11:54:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-7c6e597a-c497-4e0d-b9b1-bca750934a0b tempest-VolumesSnapshotTestJSON-647850410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:54:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-7c6e597a-c497-4e0d-b9b1-bca750934a0b tempest-VolumesSnapshotTestJSON-647850410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:54:59 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-7c6e597a-c497-4e0d-b9b1-bca750934a0b tempest-VolumesSnapshotTestJSON-647850410 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1896881034',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=563a5cbf-21fe-4a81-8006-775d7bee67bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f11fff5588b439f948dd78ef71e0501',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:55:00Z,use_quota=True,user_id='bebe3e8017604b2481907f107f937beb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:54:59 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-7c6e597a-c497-4e0d-b9b1-bca750934a0b tempest-VolumesSnapshotTestJSON-647850410 None] Creating volume 563a5cbf-21fe-4a81-8006-775d7bee67bc {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:54:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-7c6e597a-c497-4e0d-b9b1-bca750934a0b tempest-VolumesSnapshotTestJSON-647850410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:54:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-7c6e597a-c497-4e0d-b9b1-bca750934a0b tempest-VolumesSnapshotTestJSON-647850410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:54:59 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-7c6e597a-c497-4e0d-b9b1-bca750934a0b tempest-VolumesSnapshotTestJSON-647850410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:54:59 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-7c6e597a-c497-4e0d-b9b1-bca750934a0b tempest-VolumesSnapshotTestJSON-647850410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:54:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-7c6e597a-c497-4e0d-b9b1-bca750934a0b tempest-VolumesSnapshotTestJSON-647850410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:54:59 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-7c6e597a-c497-4e0d-b9b1-bca750934a0b tempest-VolumesSnapshotTestJSON-647850410 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:54:59 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-7c6e597a-c497-4e0d-b9b1-bca750934a0b tempest-VolumesSnapshotTestJSON-647850410 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:54:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7c6e597a-c497-4e0d-b9b1-bca750934a0b tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:54:59 devstack sudo[101935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc 1073741824
Nov 06 11:54:59 devstack sudo[101935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:00 devstack sudo[101935]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7c6e597a-c497-4e0d-b9b1-bca750934a0b tempest-VolumesSnapshotTestJSON-647850410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc 1073741824" returned: 0 in 0.638s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7c6e597a-c497-4e0d-b9b1-bca750934a0b tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:00 devstack sudo[101941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc
Nov 06 11:55:00 devstack sudo[101941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:00 devstack sudo[101941]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7c6e597a-c497-4e0d-b9b1-bca750934a0b tempest-VolumesSnapshotTestJSON-647850410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc" returned: 0 in 0.308s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:00 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-7c6e597a-c497-4e0d-b9b1-bca750934a0b tempest-VolumesSnapshotTestJSON-647850410 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:55:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-7c6e597a-c497-4e0d-b9b1-bca750934a0b tempest-VolumesSnapshotTestJSON-647850410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:55:00 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7c6e597a-c497-4e0d-b9b1-bca750934a0b tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f71e1b6-93eb-44db-8449-d5c3d65f5fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-563a5cbf-21fe-4a81-8006-775d7bee67bc', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:55:00 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7c6e597a-c497-4e0d-b9b1-bca750934a0b tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed265b6f-339e-46d3-9e47-9a4c30aaf165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:55:00 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-7c6e597a-c497-4e0d-b9b1-bca750934a0b tempest-VolumesSnapshotTestJSON-647850410 None] Volume volume-563a5cbf-21fe-4a81-8006-775d7bee67bc (563a5cbf-21fe-4a81-8006-775d7bee67bc): created successfully
Nov 06 11:55:00 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7c6e597a-c497-4e0d-b9b1-bca750934a0b tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed265b6f-339e-46d3-9e47-9a4c30aaf165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:55:00 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7c6e597a-c497-4e0d-b9b1-bca750934a0b tempest-VolumesSnapshotTestJSON-647850410 None] Flow 'volume_create_manager' (2f564cd0-687b-4671-b1e8-0fba2e5ae4a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:55:00 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-7c6e597a-c497-4e0d-b9b1-bca750934a0b tempest-VolumesSnapshotTestJSON-647850410 None] Created volume successfully.
Nov 06 11:55:02 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-fdb0804f-6684-4cf6-81c2-b481ac9d60ab tempest-TestServerVolumeAttachmentScenario-1119344216 None] Acquiring lock "cinder-3e9b0588-c5fd-4d84-830a-bf081c2d7260-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:55:02 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-fdb0804f-6684-4cf6-81c2-b481ac9d60ab tempest-TestServerVolumeAttachmentScenario-1119344216 None] Lock "cinder-3e9b0588-c5fd-4d84-830a-bf081c2d7260-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:55:02 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-fdb0804f-6684-4cf6-81c2-b481ac9d60ab tempest-TestServerVolumeAttachmentScenario-1119344216 None] Acquiring lock "cinder-quobyte-3e9b0588-c5fd-4d84-830a-bf081c2d7260" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:55:02 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-fdb0804f-6684-4cf6-81c2-b481ac9d60ab tempest-TestServerVolumeAttachmentScenario-1119344216 None] Lock "cinder-quobyte-3e9b0588-c5fd-4d84-830a-bf081c2d7260" acquired by "delete_volume" :: waited 0.018s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:55:02 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[46af6f17-8095-4399-ae73-bcf080bbcf64]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:55:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-fdb0804f-6684-4cf6-81c2-b481ac9d60ab tempest-TestServerVolumeAttachmentScenario-1119344216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3e9b0588-c5fd-4d84-830a-bf081c2d7260 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-52b95137-6bed-4a62-a4cd-ebd02bc88fd4 tempest-VolumesSnapshotTestJSON-647850410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:55:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-52b95137-6bed-4a62-a4cd-ebd02bc88fd4 tempest-VolumesSnapshotTestJSON-647850410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:55:02 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-52b95137-6bed-4a62-a4cd-ebd02bc88fd4 tempest-VolumesSnapshotTestJSON-647850410 None] Creating offline snapshot 79a423ea-b00d-4dc2-a262-5100492c1ca6 of volume 563a5cbf-21fe-4a81-8006-775d7bee67bc {{(pid=87165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 11:55:02 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8a48ec-d014-426c-8a0e-26f5915c6d4b]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:55:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-52b95137-6bed-4a62-a4cd-ebd02bc88fd4 tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:02 devstack sudo[101947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3e9b0588-c5fd-4d84-830a-bf081c2d7260
Nov 06 11:55:02 devstack sudo[101947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:02 devstack sudo[101948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc
Nov 06 11:55:02 devstack sudo[101948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:02 devstack sudo[101947]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-fdb0804f-6684-4cf6-81c2-b481ac9d60ab tempest-TestServerVolumeAttachmentScenario-1119344216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3e9b0588-c5fd-4d84-830a-bf081c2d7260" returned: 0 in 0.455s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-fdb0804f-6684-4cf6-81c2-b481ac9d60ab tempest-TestServerVolumeAttachmentScenario-1119344216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3e9b0588-c5fd-4d84-830a-bf081c2d7260 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:02 devstack sudo[101954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3e9b0588-c5fd-4d84-830a-bf081c2d7260
Nov 06 11:55:02 devstack sudo[101954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:02 devstack sudo[101948]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-52b95137-6bed-4a62-a4cd-ebd02bc88fd4 tempest-VolumesSnapshotTestJSON-647850410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc" returned: 0 in 0.555s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-52b95137-6bed-4a62-a4cd-ebd02bc88fd4 tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc.79a423ea-b00d-4dc2-a262-5100492c1ca6 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:02 devstack sudo[101959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc.79a423ea-b00d-4dc2-a262-5100492c1ca6 1G
Nov 06 11:55:02 devstack sudo[101959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:03 devstack sudo[101954]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-fdb0804f-6684-4cf6-81c2-b481ac9d60ab tempest-TestServerVolumeAttachmentScenario-1119344216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3e9b0588-c5fd-4d84-830a-bf081c2d7260" returned: 0 in 0.351s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:03 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-fdb0804f-6684-4cf6-81c2-b481ac9d60ab tempest-TestServerVolumeAttachmentScenario-1119344216 None] Lock "cinder-quobyte-3e9b0588-c5fd-4d84-830a-bf081c2d7260" released by "delete_volume" :: held 0.903s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:55:03 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-fdb0804f-6684-4cf6-81c2-b481ac9d60ab tempest-TestServerVolumeAttachmentScenario-1119344216 None] Created reservations ['0b7364ea-4dff-493c-805e-d6b802499ebe', 'ca6fec83-f2e6-49c1-89de-fdeec8f6a392', '8c495f79-677f-4fd8-b378-db642a123c03', '9b49cd12-d593-4539-a113-66de7bcc748a'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:55:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-fdb0804f-6684-4cf6-81c2-b481ac9d60ab tempest-TestServerVolumeAttachmentScenario-1119344216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:55:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-fdb0804f-6684-4cf6-81c2-b481ac9d60ab tempest-TestServerVolumeAttachmentScenario-1119344216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:55:03 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-fdb0804f-6684-4cf6-81c2-b481ac9d60ab tempest-TestServerVolumeAttachmentScenario-1119344216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:55:03 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-fdb0804f-6684-4cf6-81c2-b481ac9d60ab tempest-TestServerVolumeAttachmentScenario-1119344216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:55:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-fdb0804f-6684-4cf6-81c2-b481ac9d60ab tempest-TestServerVolumeAttachmentScenario-1119344216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:55:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-fdb0804f-6684-4cf6-81c2-b481ac9d60ab tempest-TestServerVolumeAttachmentScenario-1119344216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:03 devstack sudo[101970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:55:03 devstack sudo[101970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:03 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b13bf51f-cd33-490f-af9a-785d6fa96a67 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Acquiring lock "cinder-97d975a0-f59a-486b-a027-06eaab867f79-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:55:03 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b13bf51f-cd33-490f-af9a-785d6fa96a67 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Lock "cinder-97d975a0-f59a-486b-a027-06eaab867f79-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:55:03 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b13bf51f-cd33-490f-af9a-785d6fa96a67 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Acquiring lock "cinder-quobyte-97d975a0-f59a-486b-a027-06eaab867f79" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:55:03 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b13bf51f-cd33-490f-af9a-785d6fa96a67 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Lock "cinder-quobyte-97d975a0-f59a-486b-a027-06eaab867f79" acquired by "delete_volume" :: waited 0.018s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:55:03 devstack sudo[101959]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-52b95137-6bed-4a62-a4cd-ebd02bc88fd4 tempest-VolumesSnapshotTestJSON-647850410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc.79a423ea-b00d-4dc2-a262-5100492c1ca6 1G" returned: 0 in 0.717s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-52b95137-6bed-4a62-a4cd-ebd02bc88fd4 tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-563a5cbf-21fe-4a81-8006-775d7bee67bc -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc.79a423ea-b00d-4dc2-a262-5100492c1ca6 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:03 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6a0258-5586-4321-a43f-6a9728c8c038]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:55:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b13bf51f-cd33-490f-af9a-785d6fa96a67 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-97d975a0-f59a-486b-a027-06eaab867f79 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:03 devstack sudo[101972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-563a5cbf-21fe-4a81-8006-775d7bee67bc -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc.79a423ea-b00d-4dc2-a262-5100492c1ca6
Nov 06 11:55:03 devstack sudo[101972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:03 devstack sudo[101970]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-fdb0804f-6684-4cf6-81c2-b481ac9d60ab tempest-TestServerVolumeAttachmentScenario-1119344216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.396s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:03 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-fdb0804f-6684-4cf6-81c2-b481ac9d60ab tempest-TestServerVolumeAttachmentScenario-1119344216 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:55:03 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-fdb0804f-6684-4cf6-81c2-b481ac9d60ab tempest-TestServerVolumeAttachmentScenario-1119344216 None] Deleted volume successfully.
Nov 06 11:55:03 devstack sudo[101975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-97d975a0-f59a-486b-a027-06eaab867f79
Nov 06 11:55:03 devstack sudo[101975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:03 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-fdb0804f-6684-4cf6-81c2-b481ac9d60ab tempest-TestServerVolumeAttachmentScenario-1119344216 None] Lock "cinder-3e9b0588-c5fd-4d84-830a-bf081c2d7260-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:55:04 devstack sudo[101972]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-52b95137-6bed-4a62-a4cd-ebd02bc88fd4 tempest-VolumesSnapshotTestJSON-647850410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-563a5cbf-21fe-4a81-8006-775d7bee67bc -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc.79a423ea-b00d-4dc2-a262-5100492c1ca6" returned: 0 in 0.450s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:04 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-52b95137-6bed-4a62-a4cd-ebd02bc88fd4 tempest-VolumesSnapshotTestJSON-647850410 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc.79a423ea-b00d-4dc2-a262-5100492c1ca6 is being set with open permissions: ugo+rw
Nov 06 11:55:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-52b95137-6bed-4a62-a4cd-ebd02bc88fd4 tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc.79a423ea-b00d-4dc2-a262-5100492c1ca6 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:04 devstack sudo[101985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc.79a423ea-b00d-4dc2-a262-5100492c1ca6
Nov 06 11:55:04 devstack sudo[101985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:04 devstack sudo[101975]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b13bf51f-cd33-490f-af9a-785d6fa96a67 tempest-TestServerVolumeAttachmentScenario-1119344216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-97d975a0-f59a-486b-a027-06eaab867f79" returned: 0 in 0.513s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b13bf51f-cd33-490f-af9a-785d6fa96a67 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-97d975a0-f59a-486b-a027-06eaab867f79 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:04 devstack sudo[101988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-97d975a0-f59a-486b-a027-06eaab867f79
Nov 06 11:55:04 devstack sudo[101988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:04 devstack sudo[101985]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-52b95137-6bed-4a62-a4cd-ebd02bc88fd4 tempest-VolumesSnapshotTestJSON-647850410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc.79a423ea-b00d-4dc2-a262-5100492c1ca6" returned: 0 in 0.300s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-52b95137-6bed-4a62-a4cd-ebd02bc88fd4 tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:04 devstack sudo[101991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc.info
Nov 06 11:55:04 devstack sudo[101991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:04 devstack sudo[101988]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b13bf51f-cd33-490f-af9a-785d6fa96a67 tempest-TestServerVolumeAttachmentScenario-1119344216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-97d975a0-f59a-486b-a027-06eaab867f79" returned: 0 in 0.382s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:04 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b13bf51f-cd33-490f-af9a-785d6fa96a67 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Lock "cinder-quobyte-97d975a0-f59a-486b-a027-06eaab867f79" released by "delete_volume" :: held 0.977s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:55:04 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-b13bf51f-cd33-490f-af9a-785d6fa96a67 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Created reservations ['b1a12bba-dd7f-4bf8-a18c-3337141b7205', '3b775170-78b5-4f49-82de-3e9ea4947949', '5de69dcb-319f-4bc4-8921-7704bdcdca5a', '6e9fb826-096b-459f-ad92-3e17c660b31c'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:55:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b13bf51f-cd33-490f-af9a-785d6fa96a67 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:55:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b13bf51f-cd33-490f-af9a-785d6fa96a67 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:55:04 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b13bf51f-cd33-490f-af9a-785d6fa96a67 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:55:04 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b13bf51f-cd33-490f-af9a-785d6fa96a67 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:55:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b13bf51f-cd33-490f-af9a-785d6fa96a67 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:55:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b13bf51f-cd33-490f-af9a-785d6fa96a67 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:04 devstack sudo[102004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:55:04 devstack sudo[102004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:04 devstack sudo[101991]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-52b95137-6bed-4a62-a4cd-ebd02bc88fd4 tempest-VolumesSnapshotTestJSON-647850410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc.info" returned: 0 in 0.406s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:04 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-52b95137-6bed-4a62-a4cd-ebd02bc88fd4 tempest-VolumesSnapshotTestJSON-647850410 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc.info is being set with open permissions: ugo+rw
Nov 06 11:55:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-52b95137-6bed-4a62-a4cd-ebd02bc88fd4 tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:04 devstack sudo[102006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc.info
Nov 06 11:55:04 devstack sudo[102006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-02587514-e4a5-4cf3-bed9-c7365672022e req-43edb2fb-4d04-4d8f-85a8-8887b68de270 tempest-TestStampPattern-1153361119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:55:05 devstack sudo[102004]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b13bf51f-cd33-490f-af9a-785d6fa96a67 tempest-TestServerVolumeAttachmentScenario-1119344216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.283s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:05 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-b13bf51f-cd33-490f-af9a-785d6fa96a67 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:55:05 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-b13bf51f-cd33-490f-af9a-785d6fa96a67 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Deleted volume successfully.
Nov 06 11:55:05 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b13bf51f-cd33-490f-af9a-785d6fa96a67 tempest-TestServerVolumeAttachmentScenario-1119344216 None] Lock "cinder-97d975a0-f59a-486b-a027-06eaab867f79-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:55:05 devstack sudo[102006]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-52b95137-6bed-4a62-a4cd-ebd02bc88fd4 tempest-VolumesSnapshotTestJSON-647850410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc.info" returned: 0 in 0.277s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-52b95137-6bed-4a62-a4cd-ebd02bc88fd4 tempest-VolumesSnapshotTestJSON-647850410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.845s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:55:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-02587514-e4a5-4cf3-bed9-c7365672022e req-43edb2fb-4d04-4d8f-85a8-8887b68de270 tempest-TestStampPattern-1153361119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.249s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:55:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-02587514-e4a5-4cf3-bed9-c7365672022e req-43edb2fb-4d04-4d8f-85a8-8887b68de270 tempest-TestStampPattern-1153361119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:55:05 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-52b95137-6bed-4a62-a4cd-ebd02bc88fd4 tempest-VolumesSnapshotTestJSON-647850410 None] Create snapshot completed successfully
Nov 06 11:55:05 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-02587514-e4a5-4cf3-bed9-c7365672022e req-43edb2fb-4d04-4d8f-85a8-8887b68de270 tempest-TestStampPattern-1153361119 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50', 'name': 'volume-c19d6592-0185-4480-8990-0d64bc712712', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6dc55015-b5f8-410e-9f73-1c365f0dcb73', 'enforce_multipath': True} {{(pid=87165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 11:55:05 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-02587514-e4a5-4cf3-bed9-c7365672022e req-43edb2fb-4d04-4d8f-85a8-8887b68de270 tempest-TestStampPattern-1153361119 None] attachment_update completed successfully.
Nov 06 11:55:06 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:55:06 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] Flow 'volume_create_manager' (77d04bbb-a2a0-41b8-84d2-69d47cdaeee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:55:06 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32175ba6-b6ca-4b91-bccd-769111cfd061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:55:06 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32175ba6-b6ca-4b91-bccd-769111cfd061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-371350675',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aca665ac-ea77-45fb-b691-5032a4249dff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f11fff5588b439f948dd78ef71e0501',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:55:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=79a423ea-b00d-4dc2-a262-5100492c1ca6,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:55:06Z,use_quota=True,user_id='bebe3e8017604b2481907f107f937beb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:55:06 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7abf6a1d-258f-40a2-a050-810f6a304f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:55:06 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7abf6a1d-258f-40a2-a050-810f6a304f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:55:06 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85e248b6-4432-4b3a-9881-9dd8a1b6278f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:55:06 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85e248b6-4432-4b3a-9881-9dd8a1b6278f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'aca665ac-ea77-45fb-b691-5032a4249dff', 'volume_name': 'volume-aca665ac-ea77-45fb-b691-5032a4249dff', 'volume_size': 2, 'snapshot_id': '79a423ea-b00d-4dc2-a262-5100492c1ca6'}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:55:06 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5baed19c-6100-4d3b-83bf-d7549d217c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:55:06 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5baed19c-6100-4d3b-83bf-d7549d217c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:55:06 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd7ff656-c22b-4b94-b337-75469707a2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:55:06 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] Volume aca665ac-ea77-45fb-b691-5032a4249dff: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-aca665ac-ea77-45fb-b691-5032a4249dff', 'volume_size': 2, 'snapshot_id': '79a423ea-b00d-4dc2-a262-5100492c1ca6'}
Nov 06 11:55:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:55:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:55:06 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] Acquiring lock "cinder-quobyte-79a423ea-b00d-4dc2-a262-5100492c1ca6-aca665ac-ea77-45fb-b691-5032a4249dff" by "_create_volume_from_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:55:06 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] Lock "cinder-quobyte-79a423ea-b00d-4dc2-a262-5100492c1ca6-aca665ac-ea77-45fb-b691-5032a4249dff" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:55:06 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] Creating volume aca665ac-ea77-45fb-b691-5032a4249dff from snapshot 79a423ea-b00d-4dc2-a262-5100492c1ca6 {{(pid=87165) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 06 11:55:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:55:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:55:06 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:55:06 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:55:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:55:06 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:55:06 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] Acquiring lock "cinder-quobyte-aca665ac-ea77-45fb-b691-5032a4249dff" by "_copy_volume_from_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:55:06 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] Lock "cinder-quobyte-aca665ac-ea77-45fb-b691-5032a4249dff" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:55:06 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] snapshot: 79a423ea-b00d-4dc2-a262-5100492c1ca6, volume: aca665ac-ea77-45fb-b691-5032a4249dff,  {{(pid=87165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 06 11:55:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:55:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:55:06 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:55:06 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:55:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:55:06 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e346cf5-d011-4093-baf0-8b989332010d]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:55:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc.79a423ea-b00d-4dc2-a262-5100492c1ca6 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:06 devstack sudo[102755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc.79a423ea-b00d-4dc2-a262-5100492c1ca6
Nov 06 11:55:06 devstack sudo[102755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:07 devstack sudo[102755]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc.79a423ea-b00d-4dc2-a262-5100492c1ca6" returned: 0 in 0.533s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:07 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-563a5cbf-21fe-4a81-8006-775d7bee67bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:55:07 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eff16cd-9450-4dc6-b7ed-9d35694eec3e]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:55:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:07 devstack sudo[102779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc
Nov 06 11:55:07 devstack sudo[102779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:07 devstack sudo[102779]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc" returned: 0 in 0.482s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:07 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc {{(pid=87165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 06 11:55:07 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] Creating direct copy from snapshot {{(pid=87165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 06 11:55:07 devstack cinder-volume[87165]: DEBUG cinder.utils [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] Path /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-aca665ac-ea77-45fb-b691-5032a4249dff not found in is_blk_device check {{(pid=87165) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 06 11:55:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-aca665ac-ea77-45fb-b691-5032a4249dff {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:07 devstack sudo[102819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-aca665ac-ea77-45fb-b691-5032a4249dff
Nov 06 11:55:07 devstack sudo[102819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:08 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-494252ee-dab8-42f9-adbc-c7d8b207d717 req-e5e93773-3b28-4ec5-bfd9-cfe9db4366df tempest-TestStampPattern-1153361119 None] Terminate volume connection completed successfully.
Nov 06 11:55:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-494252ee-dab8-42f9-adbc-c7d8b207d717 req-e5e93773-3b28-4ec5-bfd9-cfe9db4366df tempest-TestStampPattern-1153361119 None] Deleting attachment 6dc55015-b5f8-410e-9f73-1c365f0dcb73. {{(pid=87165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 11:55:17 devstack sudo[102819]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:17 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a8c417d1-b093-44db-919d-21dab7cfa482 tempest-TestStampPattern-1153361119 None] Acquiring lock "cinder-c19d6592-0185-4480-8990-0d64bc712712-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:55:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-aca665ac-ea77-45fb-b691-5032a4249dff" returned: 0 in 9.404s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:17 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] Image conversion details: src /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc, size 1024.00 MB, duration 9.41 sec, destination /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-aca665ac-ea77-45fb-b691-5032a4249dff {{(pid=87165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 11:55:17 devstack cinder-volume[87165]: INFO cinder.image.image_utils [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] Converted 1024.00 MB image at 108.85 MB/s
Nov 06 11:55:17 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-aca665ac-ea77-45fb-b691-5032a4249dff is being set with open permissions: ugo+rw
Nov 06 11:55:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-aca665ac-ea77-45fb-b691-5032a4249dff {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:17 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a8c417d1-b093-44db-919d-21dab7cfa482 tempest-TestStampPattern-1153361119 None] Lock "cinder-c19d6592-0185-4480-8990-0d64bc712712-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:55:17 devstack sudo[102980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-aca665ac-ea77-45fb-b691-5032a4249dff
Nov 06 11:55:17 devstack sudo[102980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:17 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a8c417d1-b093-44db-919d-21dab7cfa482 tempest-TestStampPattern-1153361119 None] Acquiring lock "cinder-quobyte-c19d6592-0185-4480-8990-0d64bc712712" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:55:17 devstack cinder-volume[87165]: DEBUG oslo_service.periodic_task [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 11:55:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:55:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:55:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:55:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:55:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:55:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:17 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a8c417d1-b093-44db-919d-21dab7cfa482 tempest-TestStampPattern-1153361119 None] Lock "cinder-quobyte-c19d6592-0185-4480-8990-0d64bc712712" acquired by "delete_volume" :: waited 0.059s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:55:17 devstack sudo[102982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:55:17 devstack sudo[102982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:17 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8aa2536-fd29-4f02-a40d-c2133a434b47]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:55:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a8c417d1-b093-44db-919d-21dab7cfa482 tempest-TestStampPattern-1153361119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c19d6592-0185-4480-8990-0d64bc712712 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:17 devstack sudo[102984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c19d6592-0185-4480-8990-0d64bc712712
Nov 06 11:55:17 devstack sudo[102984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:17 devstack sudo[102980]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-aca665ac-ea77-45fb-b691-5032a4249dff" returned: 0 in 0.360s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:17 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] Lock "cinder-quobyte-aca665ac-ea77-45fb-b691-5032a4249dff" released by "_copy_volume_from_snapshot" :: held 10.913s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:55:17 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] Lock "cinder-quobyte-79a423ea-b00d-4dc2-a262-5100492c1ca6-aca665ac-ea77-45fb-b691-5032a4249dff" released by "_create_volume_from_snapshot" :: held 11.039s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:55:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.056s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:55:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd7ff656-c22b-4b94-b337-75469707a2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aca665ac-ea77-45fb-b691-5032a4249dff', 'volume_size': 2, 'snapshot_id': '79a423ea-b00d-4dc2-a262-5100492c1ca6'}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:55:17 devstack sudo[102982]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e12dcd2a-4b22-4bd7-9f30-67136ff3579f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:55:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.426s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:17 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:55:17 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] Volume volume-aca665ac-ea77-45fb-b691-5032a4249dff (aca665ac-ea77-45fb-b691-5032a4249dff): created successfully
Nov 06 11:55:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e12dcd2a-4b22-4bd7-9f30-67136ff3579f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:55:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] Flow 'volume_create_manager' (77d04bbb-a2a0-41b8-84d2-69d47cdaeee6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:55:17 devstack cinder-volume[87165]: DEBUG oslo_service.periodic_task [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running periodic task VolumeManager._thread_info {{(pid=87165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 11:55:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] thread count: 29 {{(pid=87165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 11:55:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] thread info: [<_MainThread(MainThread, started 127732956901504)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127732842693056)>, <Thread(Thread-3 (stat_writer), started daemon 127732841891136)>, <Thread(Rabbit-heartbeat, started daemon 127732842515648)>, <Thread(Thread-5 (_runner), started daemon 127732840534464)>, <Thread(Thread-7 (_runner), started daemon 127732840636032)>, <Thread(fd_logger, started daemon 127732838664256)>, <Thread(privsep_reader, started daemon 127732838673408)>, <Thread(tpool_thread_0, started daemon 127732829828800)>, <Thread(tpool_thread_1, started daemon 127732821436096)>, <Thread(tpool_thread_2, started daemon 127732813043392)>, <Thread(tpool_thread_3, started daemon 127732804650688)>, <Thread(tpool_thread_4, started daemon 127732796257984)>, <Thread(tpool_thread_5, started daemon 127732787865280)>, <Thread(tpool_thread_6, started daemon 127732779456192)>, <Thread(tpool_thread_7, started daemon 127732771047104)>, <Thread(tpool_thread_8, started daemon 127732762638016)>, <Thread(tpool_thread_9, started daemon 127732754228928)>, <Thread(tpool_thread_10, started daemon 127732745819840)>, <Thread(tpool_thread_11, started daemon 127732737410752)>, <Thread(tpool_thread_12, started daemon 127732729001664)>, <Thread(tpool_thread_13, started daemon 127732720592576)>, <Thread(tpool_thread_14, started daemon 127732712183488)>, <Thread(tpool_thread_15, started daemon 127732703774400)>, <Thread(tpool_thread_16, started daemon 127732695365312)>, <Thread(tpool_thread_17, started daemon 127732686956224)>, <Thread(tpool_thread_18, started daemon 127732678547136)>, <Thread(tpool_thread_19, started daemon 127732670138048)>, <Thread(Rabbit-heartbeat, started daemon 127732832631296)>] {{(pid=87165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 11:55:17 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-2b5b2d28-7dc2-4d17-82e9-07503431d05e tempest-VolumesSnapshotTestJSON-647850410 None] Created volume successfully.
Nov 06 11:55:17 devstack sudo[102984]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a8c417d1-b093-44db-919d-21dab7cfa482 tempest-TestStampPattern-1153361119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c19d6592-0185-4480-8990-0d64bc712712" returned: 0 in 0.527s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a8c417d1-b093-44db-919d-21dab7cfa482 tempest-TestStampPattern-1153361119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c19d6592-0185-4480-8990-0d64bc712712 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:17 devstack sudo[102992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c19d6592-0185-4480-8990-0d64bc712712
Nov 06 11:55:17 devstack sudo[102992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:18 devstack sudo[102992]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a8c417d1-b093-44db-919d-21dab7cfa482 tempest-TestStampPattern-1153361119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c19d6592-0185-4480-8990-0d64bc712712" returned: 0 in 0.292s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:18 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a8c417d1-b093-44db-919d-21dab7cfa482 tempest-TestStampPattern-1153361119 None] Lock "cinder-quobyte-c19d6592-0185-4480-8990-0d64bc712712" released by "delete_volume" :: held 0.883s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:55:18 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-a8c417d1-b093-44db-919d-21dab7cfa482 tempest-TestStampPattern-1153361119 None] Created reservations ['2fe5d7c9-4539-4178-b99b-37cd82b9de24', '0892b3e8-21a7-47bd-bff4-37ba578e123e', '998b252b-a94b-4127-9b69-2a2d1f534dcb', '1554d112-7724-470a-a781-633729515c2c'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:55:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a8c417d1-b093-44db-919d-21dab7cfa482 tempest-TestStampPattern-1153361119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:55:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a8c417d1-b093-44db-919d-21dab7cfa482 tempest-TestStampPattern-1153361119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:55:18 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a8c417d1-b093-44db-919d-21dab7cfa482 tempest-TestStampPattern-1153361119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:55:18 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a8c417d1-b093-44db-919d-21dab7cfa482 tempest-TestStampPattern-1153361119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:55:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a8c417d1-b093-44db-919d-21dab7cfa482 tempest-TestStampPattern-1153361119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:55:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a8c417d1-b093-44db-919d-21dab7cfa482 tempest-TestStampPattern-1153361119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:18 devstack sudo[102995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:55:18 devstack sudo[102995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:18 devstack sudo[102995]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a8c417d1-b093-44db-919d-21dab7cfa482 tempest-TestStampPattern-1153361119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.319s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:18 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-a8c417d1-b093-44db-919d-21dab7cfa482 tempest-TestStampPattern-1153361119 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:55:18 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-a8c417d1-b093-44db-919d-21dab7cfa482 tempest-TestStampPattern-1153361119 None] Deleted volume successfully.
Nov 06 11:55:18 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a8c417d1-b093-44db-919d-21dab7cfa482 tempest-TestStampPattern-1153361119 None] Lock "cinder-c19d6592-0185-4480-8990-0d64bc712712-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:55:18 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-7567a874-2942-4bac-9101-8fd78e090bf0 tempest-TestStampPattern-1153361119 None] Acquiring lock "cinder-2ec83545-b071-44d5-b360-8f63161a55fb-delete_snapshot" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:55:18 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-7567a874-2942-4bac-9101-8fd78e090bf0 tempest-TestStampPattern-1153361119 None] Lock "cinder-2ec83545-b071-44d5-b360-8f63161a55fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:55:18 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-7567a874-2942-4bac-9101-8fd78e090bf0 tempest-TestStampPattern-1153361119 None] Acquiring lock "cinder-quobyte-b294b1d2-5006-4243-9a13-b1aeb251204b" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:55:18 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-7567a874-2942-4bac-9101-8fd78e090bf0 tempest-TestStampPattern-1153361119 None] Lock "cinder-quobyte-b294b1d2-5006-4243-9a13-b1aeb251204b" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:55:18 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-7567a874-2942-4bac-9101-8fd78e090bf0 tempest-TestStampPattern-1153361119 None] Acquiring lock "cinder-quobyte-2ec83545-b071-44d5-b360-8f63161a55fb" by "_delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:55:18 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-7567a874-2942-4bac-9101-8fd78e090bf0 tempest-TestStampPattern-1153361119 None] Lock "cinder-quobyte-2ec83545-b071-44d5-b360-8f63161a55fb" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:55:18 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-7567a874-2942-4bac-9101-8fd78e090bf0 tempest-TestStampPattern-1153361119 None] Deleting offline snapshot 2ec83545-b071-44d5-b360-8f63161a55fb of volume b294b1d2-5006-4243-9a13-b1aeb251204b {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 11:55:18 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-7567a874-2942-4bac-9101-8fd78e090bf0 tempest-TestStampPattern-1153361119 None] snapshot_file for this snap is: volume-b294b1d2-5006-4243-9a13-b1aeb251204b.2ec83545-b071-44d5-b360-8f63161a55fb {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 11:55:18 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef02c48-421b-4d9a-8b68-544b81746284]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:55:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7567a874-2942-4bac-9101-8fd78e090bf0 tempest-TestStampPattern-1153361119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b.2ec83545-b071-44d5-b360-8f63161a55fb {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:18 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-30bfb9a6-fa80-4d7d-b203-e52e3f342440 tempest-VolumesSnapshotTestJSON-647850410 None] Acquiring lock "cinder-aca665ac-ea77-45fb-b691-5032a4249dff-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:55:18 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-30bfb9a6-fa80-4d7d-b203-e52e3f342440 tempest-VolumesSnapshotTestJSON-647850410 None] Lock "cinder-aca665ac-ea77-45fb-b691-5032a4249dff-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:55:18 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-30bfb9a6-fa80-4d7d-b203-e52e3f342440 tempest-VolumesSnapshotTestJSON-647850410 None] Acquiring lock "cinder-quobyte-aca665ac-ea77-45fb-b691-5032a4249dff" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:55:18 devstack sudo[102998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b.2ec83545-b071-44d5-b360-8f63161a55fb
Nov 06 11:55:18 devstack sudo[102998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:18 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-30bfb9a6-fa80-4d7d-b203-e52e3f342440 tempest-VolumesSnapshotTestJSON-647850410 None] Lock "cinder-quobyte-aca665ac-ea77-45fb-b691-5032a4249dff" acquired by "delete_volume" :: waited 0.020s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:55:19 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eef0fe1-f2a5-4bb9-9f66-f19fd712b7e7]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:55:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-30bfb9a6-fa80-4d7d-b203-e52e3f342440 tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-aca665ac-ea77-45fb-b691-5032a4249dff {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:19 devstack sudo[103000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-aca665ac-ea77-45fb-b691-5032a4249dff
Nov 06 11:55:19 devstack sudo[103000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:19 devstack sudo[102998]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7567a874-2942-4bac-9101-8fd78e090bf0 tempest-TestStampPattern-1153361119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b.2ec83545-b071-44d5-b360-8f63161a55fb" returned: 0 in 0.503s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:19 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-7567a874-2942-4bac-9101-8fd78e090bf0 tempest-TestStampPattern-1153361119 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b294b1d2-5006-4243-9a13-b1aeb251204b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:55:19 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[77dec643-bc63-476c-9338-cecaec27c465]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:55:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7567a874-2942-4bac-9101-8fd78e090bf0 tempest-TestStampPattern-1153361119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:19 devstack sudo[103005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b
Nov 06 11:55:19 devstack sudo[103005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:19 devstack sudo[103000]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-30bfb9a6-fa80-4d7d-b203-e52e3f342440 tempest-VolumesSnapshotTestJSON-647850410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-aca665ac-ea77-45fb-b691-5032a4249dff" returned: 0 in 0.447s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-30bfb9a6-fa80-4d7d-b203-e52e3f342440 tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-aca665ac-ea77-45fb-b691-5032a4249dff {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:19 devstack sudo[103010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-aca665ac-ea77-45fb-b691-5032a4249dff
Nov 06 11:55:19 devstack sudo[103010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:19 devstack sudo[103010]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-30bfb9a6-fa80-4d7d-b203-e52e3f342440 tempest-VolumesSnapshotTestJSON-647850410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-aca665ac-ea77-45fb-b691-5032a4249dff" returned: 0 in 0.281s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:19 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-30bfb9a6-fa80-4d7d-b203-e52e3f342440 tempest-VolumesSnapshotTestJSON-647850410 None] Lock "cinder-quobyte-aca665ac-ea77-45fb-b691-5032a4249dff" released by "delete_volume" :: held 0.833s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:55:19 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-30bfb9a6-fa80-4d7d-b203-e52e3f342440 tempest-VolumesSnapshotTestJSON-647850410 None] Created reservations ['6246f9ad-74e7-47f2-a680-707489c465e0', 'ae493edd-f047-4fea-a3fb-228d8fcd0f07', '0793f66f-3bb3-474e-b191-f2ae10235eb5', '0232b025-51be-49b2-b6de-6173a39f0205'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:55:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-30bfb9a6-fa80-4d7d-b203-e52e3f342440 tempest-VolumesSnapshotTestJSON-647850410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:55:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-30bfb9a6-fa80-4d7d-b203-e52e3f342440 tempest-VolumesSnapshotTestJSON-647850410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:55:19 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-30bfb9a6-fa80-4d7d-b203-e52e3f342440 tempest-VolumesSnapshotTestJSON-647850410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:55:19 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-30bfb9a6-fa80-4d7d-b203-e52e3f342440 tempest-VolumesSnapshotTestJSON-647850410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:55:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-30bfb9a6-fa80-4d7d-b203-e52e3f342440 tempest-VolumesSnapshotTestJSON-647850410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:55:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-30bfb9a6-fa80-4d7d-b203-e52e3f342440 tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:19 devstack sudo[103016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:55:19 devstack sudo[103016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:19 devstack sudo[103005]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7567a874-2942-4bac-9101-8fd78e090bf0 tempest-TestStampPattern-1153361119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b" returned: 0 in 0.648s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7567a874-2942-4bac-9101-8fd78e090bf0 tempest-TestStampPattern-1153361119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b.2ec83545-b071-44d5-b360-8f63161a55fb {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:20 devstack sudo[103018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b.2ec83545-b071-44d5-b360-8f63161a55fb
Nov 06 11:55:20 devstack sudo[103018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:20 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b61b12ba-bd1c-4081-a86e-4bd4177f266c tempest-VolumesSnapshotTestJSON-647850410 None] Acquiring lock "cinder-79a423ea-b00d-4dc2-a262-5100492c1ca6-delete_snapshot" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:55:20 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b61b12ba-bd1c-4081-a86e-4bd4177f266c tempest-VolumesSnapshotTestJSON-647850410 None] Lock "cinder-79a423ea-b00d-4dc2-a262-5100492c1ca6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:55:20 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b61b12ba-bd1c-4081-a86e-4bd4177f266c tempest-VolumesSnapshotTestJSON-647850410 None] Acquiring lock "cinder-quobyte-563a5cbf-21fe-4a81-8006-775d7bee67bc" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:55:20 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b61b12ba-bd1c-4081-a86e-4bd4177f266c tempest-VolumesSnapshotTestJSON-647850410 None] Lock "cinder-quobyte-563a5cbf-21fe-4a81-8006-775d7bee67bc" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:55:20 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b61b12ba-bd1c-4081-a86e-4bd4177f266c tempest-VolumesSnapshotTestJSON-647850410 None] Acquiring lock "cinder-quobyte-79a423ea-b00d-4dc2-a262-5100492c1ca6" by "_delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:55:20 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b61b12ba-bd1c-4081-a86e-4bd4177f266c tempest-VolumesSnapshotTestJSON-647850410 None] Lock "cinder-quobyte-79a423ea-b00d-4dc2-a262-5100492c1ca6" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:55:20 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-b61b12ba-bd1c-4081-a86e-4bd4177f266c tempest-VolumesSnapshotTestJSON-647850410 None] Deleting offline snapshot 79a423ea-b00d-4dc2-a262-5100492c1ca6 of volume 563a5cbf-21fe-4a81-8006-775d7bee67bc {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 11:55:20 devstack sudo[103016]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:20 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-b61b12ba-bd1c-4081-a86e-4bd4177f266c tempest-VolumesSnapshotTestJSON-647850410 None] snapshot_file for this snap is: volume-563a5cbf-21fe-4a81-8006-775d7bee67bc.79a423ea-b00d-4dc2-a262-5100492c1ca6 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 11:55:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-30bfb9a6-fa80-4d7d-b203-e52e3f342440 tempest-VolumesSnapshotTestJSON-647850410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.478s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:20 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-30bfb9a6-fa80-4d7d-b203-e52e3f342440 tempest-VolumesSnapshotTestJSON-647850410 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:55:20 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-30bfb9a6-fa80-4d7d-b203-e52e3f342440 tempest-VolumesSnapshotTestJSON-647850410 None] Deleted volume successfully.
Nov 06 11:55:20 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee92532-9751-422e-8774-878333aed195]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:55:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b61b12ba-bd1c-4081-a86e-4bd4177f266c tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc.79a423ea-b00d-4dc2-a262-5100492c1ca6 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:20 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-30bfb9a6-fa80-4d7d-b203-e52e3f342440 tempest-VolumesSnapshotTestJSON-647850410 None] Lock "cinder-aca665ac-ea77-45fb-b691-5032a4249dff-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:55:20 devstack sudo[103018]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7567a874-2942-4bac-9101-8fd78e090bf0 tempest-TestStampPattern-1153361119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b.2ec83545-b071-44d5-b360-8f63161a55fb" returned: 0 in 0.622s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7567a874-2942-4bac-9101-8fd78e090bf0 tempest-TestStampPattern-1153361119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b.2ec83545-b071-44d5-b360-8f63161a55fb {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:20 devstack sudo[103023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc.79a423ea-b00d-4dc2-a262-5100492c1ca6
Nov 06 11:55:20 devstack sudo[103023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:20 devstack sudo[103026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b.2ec83545-b071-44d5-b360-8f63161a55fb
Nov 06 11:55:20 devstack sudo[103026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:21 devstack sudo[103023]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b61b12ba-bd1c-4081-a86e-4bd4177f266c tempest-VolumesSnapshotTestJSON-647850410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc.79a423ea-b00d-4dc2-a262-5100492c1ca6" returned: 0 in 0.628s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:21 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-b61b12ba-bd1c-4081-a86e-4bd4177f266c tempest-VolumesSnapshotTestJSON-647850410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-563a5cbf-21fe-4a81-8006-775d7bee67bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:55:21 devstack sudo[103026]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7567a874-2942-4bac-9101-8fd78e090bf0 tempest-TestStampPattern-1153361119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b.2ec83545-b071-44d5-b360-8f63161a55fb" returned: 0 in 0.489s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:21 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc921778-53c3-4ee5-9d25-86e3e72e9fa3]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:55:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b61b12ba-bd1c-4081-a86e-4bd4177f266c tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:21 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-7567a874-2942-4bac-9101-8fd78e090bf0 tempest-TestStampPattern-1153361119 None] Lock "cinder-quobyte-2ec83545-b071-44d5-b360-8f63161a55fb" released by "_delete_snapshot" :: held 2.469s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:55:21 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-7567a874-2942-4bac-9101-8fd78e090bf0 tempest-TestStampPattern-1153361119 None] Lock "cinder-quobyte-b294b1d2-5006-4243-9a13-b1aeb251204b" released by "delete_snapshot" :: held 2.505s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:55:21 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-7567a874-2942-4bac-9101-8fd78e090bf0 tempest-TestStampPattern-1153361119 None] Created reservations ['84bb0468-e07c-45b4-a4cb-e6c5e547defe', '6444e6a1-8c44-4286-b3d6-7b174bf9796d', '652f44a8-3868-4b48-9823-19df5520a9d5', '6389a3ab-ce75-40a4-9b66-7afa2b0de794'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:55:21 devstack sudo[103034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc
Nov 06 11:55:21 devstack sudo[103034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:21 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-7567a874-2942-4bac-9101-8fd78e090bf0 tempest-TestStampPattern-1153361119 None] Delete snapshot completed successfully.
Nov 06 11:55:21 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-7567a874-2942-4bac-9101-8fd78e090bf0 tempest-TestStampPattern-1153361119 None] Lock "cinder-2ec83545-b071-44d5-b360-8f63161a55fb-delete_snapshot" released by "delete_snapshot" :: held 2.765s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:55:21 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-99b79acf-4d44-4afb-b948-d63aa7fdf0c2 tempest-VolumeQuotasAdminTestJSON-1923193721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:55:21 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-99b79acf-4d44-4afb-b948-d63aa7fdf0c2 tempest-VolumeQuotasAdminTestJSON-1923193721 None] Flow 'volume_create_manager' (492faa36-4b9c-4219-a26a-bf29ab53e168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:55:21 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-99b79acf-4d44-4afb-b948-d63aa7fdf0c2 tempest-VolumeQuotasAdminTestJSON-1923193721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ecaaa4a-2d0b-4e01-b35f-21f464e748a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:55:21 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-99b79acf-4d44-4afb-b948-d63aa7fdf0c2 tempest-VolumeQuotasAdminTestJSON-1923193721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ecaaa4a-2d0b-4e01-b35f-21f464e748a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1909611241',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f9cb633-9485-422f-a552-6555adf8b2c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3573adb44a614099a76823130313877a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:55:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:55:22Z,use_quota=True,user_id='426a706dcb604d59a06f87b8f8178a23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:55:21 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-99b79acf-4d44-4afb-b948-d63aa7fdf0c2 tempest-VolumeQuotasAdminTestJSON-1923193721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de146893-902a-475b-a014-acb6980336ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:55:21 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-99b79acf-4d44-4afb-b948-d63aa7fdf0c2 tempest-VolumeQuotasAdminTestJSON-1923193721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de146893-902a-475b-a014-acb6980336ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:55:21 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-99b79acf-4d44-4afb-b948-d63aa7fdf0c2 tempest-VolumeQuotasAdminTestJSON-1923193721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e88a359f-a295-48c5-a584-7a7ab2da95f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:55:21 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-99b79acf-4d44-4afb-b948-d63aa7fdf0c2 tempest-VolumeQuotasAdminTestJSON-1923193721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e88a359f-a295-48c5-a584-7a7ab2da95f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f9cb633-9485-422f-a552-6555adf8b2c3', 'volume_name': 'volume-3f9cb633-9485-422f-a552-6555adf8b2c3', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:55:21 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-99b79acf-4d44-4afb-b948-d63aa7fdf0c2 tempest-VolumeQuotasAdminTestJSON-1923193721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91d0770b-fcfd-4e19-b2df-56ad860b1a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:55:21 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-99b79acf-4d44-4afb-b948-d63aa7fdf0c2 tempest-VolumeQuotasAdminTestJSON-1923193721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91d0770b-fcfd-4e19-b2df-56ad860b1a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:55:21 devstack sudo[103034]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:21 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-99b79acf-4d44-4afb-b948-d63aa7fdf0c2 tempest-VolumeQuotasAdminTestJSON-1923193721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80aaf9d1-419e-4a5f-8d35-b1ef80151448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:55:21 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-99b79acf-4d44-4afb-b948-d63aa7fdf0c2 tempest-VolumeQuotasAdminTestJSON-1923193721 None] Volume 3f9cb633-9485-422f-a552-6555adf8b2c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f9cb633-9485-422f-a552-6555adf8b2c3', 'volume_size': 1}
Nov 06 11:55:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-99b79acf-4d44-4afb-b948-d63aa7fdf0c2 tempest-VolumeQuotasAdminTestJSON-1923193721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:55:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-99b79acf-4d44-4afb-b948-d63aa7fdf0c2 tempest-VolumeQuotasAdminTestJSON-1923193721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:55:21 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-99b79acf-4d44-4afb-b948-d63aa7fdf0c2 tempest-VolumeQuotasAdminTestJSON-1923193721 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1909611241',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f9cb633-9485-422f-a552-6555adf8b2c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3573adb44a614099a76823130313877a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:55:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:55:22Z,use_quota=True,user_id='426a706dcb604d59a06f87b8f8178a23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:55:21 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-99b79acf-4d44-4afb-b948-d63aa7fdf0c2 tempest-VolumeQuotasAdminTestJSON-1923193721 None] Creating volume 3f9cb633-9485-422f-a552-6555adf8b2c3 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:55:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-99b79acf-4d44-4afb-b948-d63aa7fdf0c2 tempest-VolumeQuotasAdminTestJSON-1923193721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:55:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-99b79acf-4d44-4afb-b948-d63aa7fdf0c2 tempest-VolumeQuotasAdminTestJSON-1923193721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:55:21 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-99b79acf-4d44-4afb-b948-d63aa7fdf0c2 tempest-VolumeQuotasAdminTestJSON-1923193721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:55:21 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-99b79acf-4d44-4afb-b948-d63aa7fdf0c2 tempest-VolumeQuotasAdminTestJSON-1923193721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:55:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-99b79acf-4d44-4afb-b948-d63aa7fdf0c2 tempest-VolumeQuotasAdminTestJSON-1923193721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:55:21 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-99b79acf-4d44-4afb-b948-d63aa7fdf0c2 tempest-VolumeQuotasAdminTestJSON-1923193721 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:55:21 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-99b79acf-4d44-4afb-b948-d63aa7fdf0c2 tempest-VolumeQuotasAdminTestJSON-1923193721 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:55:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-99b79acf-4d44-4afb-b948-d63aa7fdf0c2 tempest-VolumeQuotasAdminTestJSON-1923193721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3f9cb633-9485-422f-a552-6555adf8b2c3 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b61b12ba-bd1c-4081-a86e-4bd4177f266c tempest-VolumesSnapshotTestJSON-647850410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc" returned: 0 in 0.822s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b61b12ba-bd1c-4081-a86e-4bd4177f266c tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc.79a423ea-b00d-4dc2-a262-5100492c1ca6 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:21 devstack sudo[103040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3f9cb633-9485-422f-a552-6555adf8b2c3 1073741824
Nov 06 11:55:21 devstack sudo[103040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:21 devstack sudo[103041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc.79a423ea-b00d-4dc2-a262-5100492c1ca6
Nov 06 11:55:21 devstack sudo[103041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:22 devstack sudo[103041]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b61b12ba-bd1c-4081-a86e-4bd4177f266c tempest-VolumesSnapshotTestJSON-647850410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc.79a423ea-b00d-4dc2-a262-5100492c1ca6" returned: 0 in 0.618s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b61b12ba-bd1c-4081-a86e-4bd4177f266c tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc.79a423ea-b00d-4dc2-a262-5100492c1ca6 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:22 devstack sudo[103051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc.79a423ea-b00d-4dc2-a262-5100492c1ca6
Nov 06 11:55:22 devstack sudo[103051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:22 devstack sudo[103040]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-99b79acf-4d44-4afb-b948-d63aa7fdf0c2 tempest-VolumeQuotasAdminTestJSON-1923193721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3f9cb633-9485-422f-a552-6555adf8b2c3 1073741824" returned: 0 in 0.715s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-99b79acf-4d44-4afb-b948-d63aa7fdf0c2 tempest-VolumeQuotasAdminTestJSON-1923193721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3f9cb633-9485-422f-a552-6555adf8b2c3 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:22 devstack sudo[103053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3f9cb633-9485-422f-a552-6555adf8b2c3
Nov 06 11:55:22 devstack sudo[103053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:22 devstack sudo[103051]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b61b12ba-bd1c-4081-a86e-4bd4177f266c tempest-VolumesSnapshotTestJSON-647850410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc.79a423ea-b00d-4dc2-a262-5100492c1ca6" returned: 0 in 0.339s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:23 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b61b12ba-bd1c-4081-a86e-4bd4177f266c tempest-VolumesSnapshotTestJSON-647850410 None] Lock "cinder-quobyte-79a423ea-b00d-4dc2-a262-5100492c1ca6" released by "_delete_snapshot" :: held 2.660s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:55:23 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b61b12ba-bd1c-4081-a86e-4bd4177f266c tempest-VolumesSnapshotTestJSON-647850410 None] Lock "cinder-quobyte-563a5cbf-21fe-4a81-8006-775d7bee67bc" released by "delete_snapshot" :: held 2.704s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:55:23 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-b61b12ba-bd1c-4081-a86e-4bd4177f266c tempest-VolumesSnapshotTestJSON-647850410 None] Created reservations ['23e56c0a-7191-48ef-90c8-2a90b0bceaaf', 'd85aadd9-4a13-458d-b184-1f44648a5aea', 'b98ddd26-e1e6-45b5-bda5-9ab598d6da31', 'bfcf3279-8322-4480-ae2d-55f9d5aa8bb6'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:55:23 devstack sudo[103053]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-99b79acf-4d44-4afb-b948-d63aa7fdf0c2 tempest-VolumeQuotasAdminTestJSON-1923193721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3f9cb633-9485-422f-a552-6555adf8b2c3" returned: 0 in 0.456s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:23 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-99b79acf-4d44-4afb-b948-d63aa7fdf0c2 tempest-VolumeQuotasAdminTestJSON-1923193721 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:55:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-99b79acf-4d44-4afb-b948-d63aa7fdf0c2 tempest-VolumeQuotasAdminTestJSON-1923193721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:55:23 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-99b79acf-4d44-4afb-b948-d63aa7fdf0c2 tempest-VolumeQuotasAdminTestJSON-1923193721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80aaf9d1-419e-4a5f-8d35-b1ef80151448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f9cb633-9485-422f-a552-6555adf8b2c3', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:55:23 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-99b79acf-4d44-4afb-b948-d63aa7fdf0c2 tempest-VolumeQuotasAdminTestJSON-1923193721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (451bf18c-4c21-4bd7-8f7e-5d6420d714de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:55:23 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-99b79acf-4d44-4afb-b948-d63aa7fdf0c2 tempest-VolumeQuotasAdminTestJSON-1923193721 None] Volume volume-3f9cb633-9485-422f-a552-6555adf8b2c3 (3f9cb633-9485-422f-a552-6555adf8b2c3): created successfully
Nov 06 11:55:23 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-99b79acf-4d44-4afb-b948-d63aa7fdf0c2 tempest-VolumeQuotasAdminTestJSON-1923193721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (451bf18c-4c21-4bd7-8f7e-5d6420d714de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:55:23 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-99b79acf-4d44-4afb-b948-d63aa7fdf0c2 tempest-VolumeQuotasAdminTestJSON-1923193721 None] Flow 'volume_create_manager' (492faa36-4b9c-4219-a26a-bf29ab53e168) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:55:23 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-99b79acf-4d44-4afb-b948-d63aa7fdf0c2 tempest-VolumeQuotasAdminTestJSON-1923193721 None] Created volume successfully.
Nov 06 11:55:23 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-b61b12ba-bd1c-4081-a86e-4bd4177f266c tempest-VolumesSnapshotTestJSON-647850410 None] Delete snapshot completed successfully.
Nov 06 11:55:23 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b61b12ba-bd1c-4081-a86e-4bd4177f266c tempest-VolumesSnapshotTestJSON-647850410 None] Lock "cinder-79a423ea-b00d-4dc2-a262-5100492c1ca6-delete_snapshot" released by "delete_snapshot" :: held 2.970s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:55:23 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a58dc3c3-f964-4d8a-9f88-a4efc5e84086 tempest-VolumesSnapshotTestJSON-647850410 None] Acquiring lock "cinder-563a5cbf-21fe-4a81-8006-775d7bee67bc-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:55:23 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a58dc3c3-f964-4d8a-9f88-a4efc5e84086 tempest-VolumesSnapshotTestJSON-647850410 None] Lock "cinder-563a5cbf-21fe-4a81-8006-775d7bee67bc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:55:23 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a58dc3c3-f964-4d8a-9f88-a4efc5e84086 tempest-VolumesSnapshotTestJSON-647850410 None] Acquiring lock "cinder-quobyte-563a5cbf-21fe-4a81-8006-775d7bee67bc" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:55:23 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a58dc3c3-f964-4d8a-9f88-a4efc5e84086 tempest-VolumesSnapshotTestJSON-647850410 None] Lock "cinder-quobyte-563a5cbf-21fe-4a81-8006-775d7bee67bc" acquired by "delete_volume" :: waited 0.031s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:55:24 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a29027-5f77-4e61-b334-7b8f5103a9e8]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:55:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a58dc3c3-f964-4d8a-9f88-a4efc5e84086 tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:24 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-12493bea-195d-42ce-9349-103b56eee38a tempest-VolumeQuotasAdminTestJSON-1923193721 None] Acquiring lock "cinder-3f9cb633-9485-422f-a552-6555adf8b2c3-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:55:24 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-12493bea-195d-42ce-9349-103b56eee38a tempest-VolumeQuotasAdminTestJSON-1923193721 None] Lock "cinder-3f9cb633-9485-422f-a552-6555adf8b2c3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:55:24 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-12493bea-195d-42ce-9349-103b56eee38a tempest-VolumeQuotasAdminTestJSON-1923193721 None] Acquiring lock "cinder-quobyte-3f9cb633-9485-422f-a552-6555adf8b2c3" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:55:24 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-12493bea-195d-42ce-9349-103b56eee38a tempest-VolumeQuotasAdminTestJSON-1923193721 None] Lock "cinder-quobyte-3f9cb633-9485-422f-a552-6555adf8b2c3" acquired by "delete_volume" :: waited 0.025s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:55:24 devstack sudo[103075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc
Nov 06 11:55:24 devstack sudo[103075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:24 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c656315-e5be-4f49-b20d-77795a894784]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:55:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-12493bea-195d-42ce-9349-103b56eee38a tempest-VolumeQuotasAdminTestJSON-1923193721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3f9cb633-9485-422f-a552-6555adf8b2c3 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:24 devstack sudo[103082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3f9cb633-9485-422f-a552-6555adf8b2c3
Nov 06 11:55:24 devstack sudo[103082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:24 devstack sudo[103075]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a58dc3c3-f964-4d8a-9f88-a4efc5e84086 tempest-VolumesSnapshotTestJSON-647850410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc" returned: 0 in 0.691s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a58dc3c3-f964-4d8a-9f88-a4efc5e84086 tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:24 devstack sudo[103092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc
Nov 06 11:55:24 devstack sudo[103092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:24 devstack sudo[103082]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-12493bea-195d-42ce-9349-103b56eee38a tempest-VolumeQuotasAdminTestJSON-1923193721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3f9cb633-9485-422f-a552-6555adf8b2c3" returned: 0 in 0.548s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-12493bea-195d-42ce-9349-103b56eee38a tempest-VolumeQuotasAdminTestJSON-1923193721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3f9cb633-9485-422f-a552-6555adf8b2c3 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:24 devstack sudo[103094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3f9cb633-9485-422f-a552-6555adf8b2c3
Nov 06 11:55:24 devstack sudo[103094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:25 devstack sudo[103092]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a58dc3c3-f964-4d8a-9f88-a4efc5e84086 tempest-VolumesSnapshotTestJSON-647850410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-563a5cbf-21fe-4a81-8006-775d7bee67bc" returned: 0 in 0.421s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:25 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a58dc3c3-f964-4d8a-9f88-a4efc5e84086 tempest-VolumesSnapshotTestJSON-647850410 None] Lock "cinder-quobyte-563a5cbf-21fe-4a81-8006-775d7bee67bc" released by "delete_volume" :: held 1.341s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:55:25 devstack sudo[103094]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-12493bea-195d-42ce-9349-103b56eee38a tempest-VolumeQuotasAdminTestJSON-1923193721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3f9cb633-9485-422f-a552-6555adf8b2c3" returned: 0 in 0.485s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:25 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-12493bea-195d-42ce-9349-103b56eee38a tempest-VolumeQuotasAdminTestJSON-1923193721 None] Lock "cinder-quobyte-3f9cb633-9485-422f-a552-6555adf8b2c3" released by "delete_volume" :: held 1.131s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:55:25 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-a58dc3c3-f964-4d8a-9f88-a4efc5e84086 tempest-VolumesSnapshotTestJSON-647850410 None] Created reservations ['c69aa538-9fc5-47a9-9f97-c4934381fe42', 'fc62232e-f96c-4122-8763-d5a47441d36a', '84d61a2f-4c85-4845-a923-2f72fbbe3788', '371b3202-1490-40d5-aaef-9dfbaf06787e'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:55:25 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-12493bea-195d-42ce-9349-103b56eee38a tempest-VolumeQuotasAdminTestJSON-1923193721 None] Created reservations ['591bd059-2d8e-4c46-b5ac-5850e43c89bb', 'df821d1c-4534-43a4-b6e7-67f5ee182fde', '553aa0d6-2e0b-40e5-af51-a43d4119addf', '1e091db0-d3fa-4eca-a1ae-182ad8750aef'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:55:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a58dc3c3-f964-4d8a-9f88-a4efc5e84086 tempest-VolumesSnapshotTestJSON-647850410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:55:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a58dc3c3-f964-4d8a-9f88-a4efc5e84086 tempest-VolumesSnapshotTestJSON-647850410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:55:25 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a58dc3c3-f964-4d8a-9f88-a4efc5e84086 tempest-VolumesSnapshotTestJSON-647850410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:55:25 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a58dc3c3-f964-4d8a-9f88-a4efc5e84086 tempest-VolumesSnapshotTestJSON-647850410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:55:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a58dc3c3-f964-4d8a-9f88-a4efc5e84086 tempest-VolumesSnapshotTestJSON-647850410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:55:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a58dc3c3-f964-4d8a-9f88-a4efc5e84086 tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:25 devstack sudo[103100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:55:25 devstack sudo[103100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-12493bea-195d-42ce-9349-103b56eee38a tempest-VolumeQuotasAdminTestJSON-1923193721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:55:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-12493bea-195d-42ce-9349-103b56eee38a tempest-VolumeQuotasAdminTestJSON-1923193721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:55:25 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-12493bea-195d-42ce-9349-103b56eee38a tempest-VolumeQuotasAdminTestJSON-1923193721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:55:25 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-12493bea-195d-42ce-9349-103b56eee38a tempest-VolumeQuotasAdminTestJSON-1923193721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:55:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-12493bea-195d-42ce-9349-103b56eee38a tempest-VolumeQuotasAdminTestJSON-1923193721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:55:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-12493bea-195d-42ce-9349-103b56eee38a tempest-VolumeQuotasAdminTestJSON-1923193721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:25 devstack sudo[103102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:55:25 devstack sudo[103102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:25 devstack sudo[103102]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-12493bea-195d-42ce-9349-103b56eee38a tempest-VolumeQuotasAdminTestJSON-1923193721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.295s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:25 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-12493bea-195d-42ce-9349-103b56eee38a tempest-VolumeQuotasAdminTestJSON-1923193721 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:55:25 devstack sudo[103100]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a58dc3c3-f964-4d8a-9f88-a4efc5e84086 tempest-VolumesSnapshotTestJSON-647850410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.359s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:25 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-a58dc3c3-f964-4d8a-9f88-a4efc5e84086 tempest-VolumesSnapshotTestJSON-647850410 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:55:25 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-12493bea-195d-42ce-9349-103b56eee38a tempest-VolumeQuotasAdminTestJSON-1923193721 None] Deleted volume successfully.
Nov 06 11:55:25 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-a58dc3c3-f964-4d8a-9f88-a4efc5e84086 tempest-VolumesSnapshotTestJSON-647850410 None] Deleted volume successfully.
Nov 06 11:55:25 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-12493bea-195d-42ce-9349-103b56eee38a tempest-VolumeQuotasAdminTestJSON-1923193721 None] Lock "cinder-3f9cb633-9485-422f-a552-6555adf8b2c3-delete_volume" released by "delete_volume" :: held 1.830s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:55:25 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a58dc3c3-f964-4d8a-9f88-a4efc5e84086 tempest-VolumesSnapshotTestJSON-647850410 None] Lock "cinder-563a5cbf-21fe-4a81-8006-775d7bee67bc-delete_volume" released by "delete_volume" :: held 2.255s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:55:26 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-af8e3e52-f90b-4dc0-bbd3-54c9ddb5b4cd tempest-VolumesSnapshotTestJSON-647850410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:55:26 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-af8e3e52-f90b-4dc0-bbd3-54c9ddb5b4cd tempest-VolumesSnapshotTestJSON-647850410 None] Flow 'volume_create_manager' (183d9135-aa65-47d5-8b8d-da043de5ff1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:55:26 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-af8e3e52-f90b-4dc0-bbd3-54c9ddb5b4cd tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b70ad7a-475e-417a-af92-939fc8bb093c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:55:26 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-af8e3e52-f90b-4dc0-bbd3-54c9ddb5b4cd tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b70ad7a-475e-417a-af92-939fc8bb093c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2054186526',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b345ebeb-d822-4626-8e8f-54c09bd8f701,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f11fff5588b439f948dd78ef71e0501',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:55:27Z,use_quota=True,user_id='bebe3e8017604b2481907f107f937beb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:55:26 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-af8e3e52-f90b-4dc0-bbd3-54c9ddb5b4cd tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2135f55f-6016-4271-ac97-b0d4e4b8fdde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:55:26 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-af8e3e52-f90b-4dc0-bbd3-54c9ddb5b4cd tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2135f55f-6016-4271-ac97-b0d4e4b8fdde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:55:26 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-af8e3e52-f90b-4dc0-bbd3-54c9ddb5b4cd tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7207931-4505-45dd-ad79-600548b40c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:55:26 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-af8e3e52-f90b-4dc0-bbd3-54c9ddb5b4cd tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7207931-4505-45dd-ad79-600548b40c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b345ebeb-d822-4626-8e8f-54c09bd8f701', 'volume_name': 'volume-b345ebeb-d822-4626-8e8f-54c09bd8f701', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:55:26 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-af8e3e52-f90b-4dc0-bbd3-54c9ddb5b4cd tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1684cb8b-ba06-4ca6-8a94-35c53958f65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:55:26 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-af8e3e52-f90b-4dc0-bbd3-54c9ddb5b4cd tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1684cb8b-ba06-4ca6-8a94-35c53958f65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:55:26 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-af8e3e52-f90b-4dc0-bbd3-54c9ddb5b4cd tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42588ab2-1df5-47df-a079-99969eb2bd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:55:26 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-af8e3e52-f90b-4dc0-bbd3-54c9ddb5b4cd tempest-VolumesSnapshotTestJSON-647850410 None] Volume b345ebeb-d822-4626-8e8f-54c09bd8f701: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b345ebeb-d822-4626-8e8f-54c09bd8f701', 'volume_size': 1}
Nov 06 11:55:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-af8e3e52-f90b-4dc0-bbd3-54c9ddb5b4cd tempest-VolumesSnapshotTestJSON-647850410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:55:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-af8e3e52-f90b-4dc0-bbd3-54c9ddb5b4cd tempest-VolumesSnapshotTestJSON-647850410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:55:26 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-af8e3e52-f90b-4dc0-bbd3-54c9ddb5b4cd tempest-VolumesSnapshotTestJSON-647850410 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2054186526',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b345ebeb-d822-4626-8e8f-54c09bd8f701,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f11fff5588b439f948dd78ef71e0501',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:55:27Z,use_quota=True,user_id='bebe3e8017604b2481907f107f937beb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:55:26 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-af8e3e52-f90b-4dc0-bbd3-54c9ddb5b4cd tempest-VolumesSnapshotTestJSON-647850410 None] Creating volume b345ebeb-d822-4626-8e8f-54c09bd8f701 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:55:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-af8e3e52-f90b-4dc0-bbd3-54c9ddb5b4cd tempest-VolumesSnapshotTestJSON-647850410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:55:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-af8e3e52-f90b-4dc0-bbd3-54c9ddb5b4cd tempest-VolumesSnapshotTestJSON-647850410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:55:26 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-af8e3e52-f90b-4dc0-bbd3-54c9ddb5b4cd tempest-VolumesSnapshotTestJSON-647850410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:55:26 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-af8e3e52-f90b-4dc0-bbd3-54c9ddb5b4cd tempest-VolumesSnapshotTestJSON-647850410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:55:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-af8e3e52-f90b-4dc0-bbd3-54c9ddb5b4cd tempest-VolumesSnapshotTestJSON-647850410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:55:26 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-af8e3e52-f90b-4dc0-bbd3-54c9ddb5b4cd tempest-VolumesSnapshotTestJSON-647850410 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:55:26 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-af8e3e52-f90b-4dc0-bbd3-54c9ddb5b4cd tempest-VolumesSnapshotTestJSON-647850410 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:55:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-af8e3e52-f90b-4dc0-bbd3-54c9ddb5b4cd tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:26 devstack sudo[103106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701 1073741824
Nov 06 11:55:26 devstack sudo[103106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:27 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-098cc016-6b6c-4970-8914-fbb1fa1b50cc tempest-VolumeQuotasAdminTestJSON-1923193721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:55:27 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-098cc016-6b6c-4970-8914-fbb1fa1b50cc tempest-VolumeQuotasAdminTestJSON-1923193721 None] Flow 'volume_create_manager' (0c8893c0-c800-4964-8496-fc9a6f671c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:55:27 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-098cc016-6b6c-4970-8914-fbb1fa1b50cc tempest-VolumeQuotasAdminTestJSON-1923193721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (938b6206-74fe-4d4c-a3fc-5100a0fb9cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:55:27 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-065e0262-52fc-4be8-b6cd-4fc052bfaa57 tempest-TestStampPattern-1153361119 None] Acquiring lock "cinder-b294b1d2-5006-4243-9a13-b1aeb251204b-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:55:27 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-098cc016-6b6c-4970-8914-fbb1fa1b50cc tempest-VolumeQuotasAdminTestJSON-1923193721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (938b6206-74fe-4d4c-a3fc-5100a0fb9cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2052193733',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee0a7c5e-51f7-4321-be32-b7cf1e581855,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3573adb44a614099a76823130313877a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:55:27Z,use_quota=True,user_id='426a706dcb604d59a06f87b8f8178a23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:55:27 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-098cc016-6b6c-4970-8914-fbb1fa1b50cc tempest-VolumeQuotasAdminTestJSON-1923193721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6af2028-558c-4c6d-a3d8-d81dc26d4fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:55:27 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-098cc016-6b6c-4970-8914-fbb1fa1b50cc tempest-VolumeQuotasAdminTestJSON-1923193721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6af2028-558c-4c6d-a3d8-d81dc26d4fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:55:27 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-098cc016-6b6c-4970-8914-fbb1fa1b50cc tempest-VolumeQuotasAdminTestJSON-1923193721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (232303e9-5695-4f3d-9950-a1c903d4563a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:55:27 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-098cc016-6b6c-4970-8914-fbb1fa1b50cc tempest-VolumeQuotasAdminTestJSON-1923193721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (232303e9-5695-4f3d-9950-a1c903d4563a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee0a7c5e-51f7-4321-be32-b7cf1e581855', 'volume_name': 'volume-ee0a7c5e-51f7-4321-be32-b7cf1e581855', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:55:27 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-098cc016-6b6c-4970-8914-fbb1fa1b50cc tempest-VolumeQuotasAdminTestJSON-1923193721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9b7afde-edbe-487d-9e88-384f8aa7606b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:55:27 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-098cc016-6b6c-4970-8914-fbb1fa1b50cc tempest-VolumeQuotasAdminTestJSON-1923193721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9b7afde-edbe-487d-9e88-384f8aa7606b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:55:27 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-098cc016-6b6c-4970-8914-fbb1fa1b50cc tempest-VolumeQuotasAdminTestJSON-1923193721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9becad10-c1c6-4ce3-ae9d-aa2eee1f705f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:55:27 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-098cc016-6b6c-4970-8914-fbb1fa1b50cc tempest-VolumeQuotasAdminTestJSON-1923193721 None] Volume ee0a7c5e-51f7-4321-be32-b7cf1e581855: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee0a7c5e-51f7-4321-be32-b7cf1e581855', 'volume_size': 1}
Nov 06 11:55:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-098cc016-6b6c-4970-8914-fbb1fa1b50cc tempest-VolumeQuotasAdminTestJSON-1923193721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:55:27 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-065e0262-52fc-4be8-b6cd-4fc052bfaa57 tempest-TestStampPattern-1153361119 None] Lock "cinder-b294b1d2-5006-4243-9a13-b1aeb251204b-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:55:27 devstack sudo[103106]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-af8e3e52-f90b-4dc0-bbd3-54c9ddb5b4cd tempest-VolumesSnapshotTestJSON-647850410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701 1073741824" returned: 0 in 0.663s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:27 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-065e0262-52fc-4be8-b6cd-4fc052bfaa57 tempest-TestStampPattern-1153361119 None] Acquiring lock "cinder-quobyte-b294b1d2-5006-4243-9a13-b1aeb251204b" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:55:27 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-065e0262-52fc-4be8-b6cd-4fc052bfaa57 tempest-TestStampPattern-1153361119 None] Lock "cinder-quobyte-b294b1d2-5006-4243-9a13-b1aeb251204b" acquired by "delete_volume" :: waited 0.035s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:55:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-af8e3e52-f90b-4dc0-bbd3-54c9ddb5b4cd tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:27 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c30b31-4594-4cf6-91b6-f0f710708d93]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:55:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-065e0262-52fc-4be8-b6cd-4fc052bfaa57 tempest-TestStampPattern-1153361119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:27 devstack sudo[103112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701
Nov 06 11:55:27 devstack sudo[103112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:27 devstack sudo[103113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b
Nov 06 11:55:27 devstack sudo[103113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:27 devstack sudo[103112]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-af8e3e52-f90b-4dc0-bbd3-54c9ddb5b4cd tempest-VolumesSnapshotTestJSON-647850410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701" returned: 0 in 0.251s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:27 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-af8e3e52-f90b-4dc0-bbd3-54c9ddb5b4cd tempest-VolumesSnapshotTestJSON-647850410 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:55:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-af8e3e52-f90b-4dc0-bbd3-54c9ddb5b4cd tempest-VolumesSnapshotTestJSON-647850410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:55:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-098cc016-6b6c-4970-8914-fbb1fa1b50cc tempest-VolumeQuotasAdminTestJSON-1923193721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.395s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:55:27 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-098cc016-6b6c-4970-8914-fbb1fa1b50cc tempest-VolumeQuotasAdminTestJSON-1923193721 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2052193733',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee0a7c5e-51f7-4321-be32-b7cf1e581855,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3573adb44a614099a76823130313877a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:55:27Z,use_quota=True,user_id='426a706dcb604d59a06f87b8f8178a23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:55:27 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-098cc016-6b6c-4970-8914-fbb1fa1b50cc tempest-VolumeQuotasAdminTestJSON-1923193721 None] Creating volume ee0a7c5e-51f7-4321-be32-b7cf1e581855 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:55:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-098cc016-6b6c-4970-8914-fbb1fa1b50cc tempest-VolumeQuotasAdminTestJSON-1923193721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:55:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-098cc016-6b6c-4970-8914-fbb1fa1b50cc tempest-VolumeQuotasAdminTestJSON-1923193721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:55:27 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-098cc016-6b6c-4970-8914-fbb1fa1b50cc tempest-VolumeQuotasAdminTestJSON-1923193721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:55:27 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-098cc016-6b6c-4970-8914-fbb1fa1b50cc tempest-VolumeQuotasAdminTestJSON-1923193721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:55:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-098cc016-6b6c-4970-8914-fbb1fa1b50cc tempest-VolumeQuotasAdminTestJSON-1923193721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:55:27 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-098cc016-6b6c-4970-8914-fbb1fa1b50cc tempest-VolumeQuotasAdminTestJSON-1923193721 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:55:27 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-098cc016-6b6c-4970-8914-fbb1fa1b50cc tempest-VolumeQuotasAdminTestJSON-1923193721 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:55:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-098cc016-6b6c-4970-8914-fbb1fa1b50cc tempest-VolumeQuotasAdminTestJSON-1923193721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ee0a7c5e-51f7-4321-be32-b7cf1e581855 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:27 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-af8e3e52-f90b-4dc0-bbd3-54c9ddb5b4cd tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42588ab2-1df5-47df-a079-99969eb2bd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b345ebeb-d822-4626-8e8f-54c09bd8f701', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:55:27 devstack sudo[103117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ee0a7c5e-51f7-4321-be32-b7cf1e581855 1073741824
Nov 06 11:55:27 devstack sudo[103117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:27 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-af8e3e52-f90b-4dc0-bbd3-54c9ddb5b4cd tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e0a2dae-919b-400b-91a2-756fc3fc451b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:55:27 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-af8e3e52-f90b-4dc0-bbd3-54c9ddb5b4cd tempest-VolumesSnapshotTestJSON-647850410 None] Volume volume-b345ebeb-d822-4626-8e8f-54c09bd8f701 (b345ebeb-d822-4626-8e8f-54c09bd8f701): created successfully
Nov 06 11:55:27 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-af8e3e52-f90b-4dc0-bbd3-54c9ddb5b4cd tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e0a2dae-919b-400b-91a2-756fc3fc451b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:55:27 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-af8e3e52-f90b-4dc0-bbd3-54c9ddb5b4cd tempest-VolumesSnapshotTestJSON-647850410 None] Flow 'volume_create_manager' (183d9135-aa65-47d5-8b8d-da043de5ff1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:55:27 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-af8e3e52-f90b-4dc0-bbd3-54c9ddb5b4cd tempest-VolumesSnapshotTestJSON-647850410 None] Created volume successfully.
Nov 06 11:55:27 devstack sudo[103113]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-065e0262-52fc-4be8-b6cd-4fc052bfaa57 tempest-TestStampPattern-1153361119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b" returned: 0 in 0.468s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-065e0262-52fc-4be8-b6cd-4fc052bfaa57 tempest-TestStampPattern-1153361119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:27 devstack sudo[103122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b
Nov 06 11:55:27 devstack sudo[103122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:28 devstack sudo[103122]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-065e0262-52fc-4be8-b6cd-4fc052bfaa57 tempest-TestStampPattern-1153361119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b294b1d2-5006-4243-9a13-b1aeb251204b" returned: 0 in 0.358s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:28 devstack sudo[103117]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:28 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-065e0262-52fc-4be8-b6cd-4fc052bfaa57 tempest-TestStampPattern-1153361119 None] Lock "cinder-quobyte-b294b1d2-5006-4243-9a13-b1aeb251204b" released by "delete_volume" :: held 0.916s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:55:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-098cc016-6b6c-4970-8914-fbb1fa1b50cc tempest-VolumeQuotasAdminTestJSON-1923193721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ee0a7c5e-51f7-4321-be32-b7cf1e581855 1073741824" returned: 0 in 0.612s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-098cc016-6b6c-4970-8914-fbb1fa1b50cc tempest-VolumeQuotasAdminTestJSON-1923193721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ee0a7c5e-51f7-4321-be32-b7cf1e581855 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:28 devstack sudo[103128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ee0a7c5e-51f7-4321-be32-b7cf1e581855
Nov 06 11:55:28 devstack sudo[103128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:28 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-065e0262-52fc-4be8-b6cd-4fc052bfaa57 tempest-TestStampPattern-1153361119 None] Created reservations ['30d4f096-c789-44c3-942c-32e23ca5e558', '9269545f-13b2-454a-adf0-48beb096fc47', 'a0455a0d-a18d-4a76-a78b-deebaf35bec8', '533cc58c-0ea7-43cf-96e9-1e75f27cd9f2'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:55:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-065e0262-52fc-4be8-b6cd-4fc052bfaa57 tempest-TestStampPattern-1153361119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:55:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-065e0262-52fc-4be8-b6cd-4fc052bfaa57 tempest-TestStampPattern-1153361119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:55:28 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-065e0262-52fc-4be8-b6cd-4fc052bfaa57 tempest-TestStampPattern-1153361119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:55:28 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-065e0262-52fc-4be8-b6cd-4fc052bfaa57 tempest-TestStampPattern-1153361119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:55:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-065e0262-52fc-4be8-b6cd-4fc052bfaa57 tempest-TestStampPattern-1153361119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:55:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-065e0262-52fc-4be8-b6cd-4fc052bfaa57 tempest-TestStampPattern-1153361119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:28 devstack sudo[103130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:55:28 devstack sudo[103130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:28 devstack sudo[103128]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-098cc016-6b6c-4970-8914-fbb1fa1b50cc tempest-VolumeQuotasAdminTestJSON-1923193721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ee0a7c5e-51f7-4321-be32-b7cf1e581855" returned: 0 in 0.291s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:28 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-098cc016-6b6c-4970-8914-fbb1fa1b50cc tempest-VolumeQuotasAdminTestJSON-1923193721 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:55:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-098cc016-6b6c-4970-8914-fbb1fa1b50cc tempest-VolumeQuotasAdminTestJSON-1923193721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:55:28 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-098cc016-6b6c-4970-8914-fbb1fa1b50cc tempest-VolumeQuotasAdminTestJSON-1923193721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9becad10-c1c6-4ce3-ae9d-aa2eee1f705f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee0a7c5e-51f7-4321-be32-b7cf1e581855', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:55:28 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-098cc016-6b6c-4970-8914-fbb1fa1b50cc tempest-VolumeQuotasAdminTestJSON-1923193721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b2418bc-ead1-4ec6-9367-99b651e7843b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:55:28 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-098cc016-6b6c-4970-8914-fbb1fa1b50cc tempest-VolumeQuotasAdminTestJSON-1923193721 None] Volume volume-ee0a7c5e-51f7-4321-be32-b7cf1e581855 (ee0a7c5e-51f7-4321-be32-b7cf1e581855): created successfully
Nov 06 11:55:28 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-098cc016-6b6c-4970-8914-fbb1fa1b50cc tempest-VolumeQuotasAdminTestJSON-1923193721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b2418bc-ead1-4ec6-9367-99b651e7843b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:55:28 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-098cc016-6b6c-4970-8914-fbb1fa1b50cc tempest-VolumeQuotasAdminTestJSON-1923193721 None] Flow 'volume_create_manager' (0c8893c0-c800-4964-8496-fc9a6f671c70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:55:28 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-098cc016-6b6c-4970-8914-fbb1fa1b50cc tempest-VolumeQuotasAdminTestJSON-1923193721 None] Created volume successfully.
Nov 06 11:55:28 devstack sudo[103130]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-065e0262-52fc-4be8-b6cd-4fc052bfaa57 tempest-TestStampPattern-1153361119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.306s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:28 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-065e0262-52fc-4be8-b6cd-4fc052bfaa57 tempest-TestStampPattern-1153361119 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:55:28 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-065e0262-52fc-4be8-b6cd-4fc052bfaa57 tempest-TestStampPattern-1153361119 None] Deleted volume successfully.
Nov 06 11:55:28 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-065e0262-52fc-4be8-b6cd-4fc052bfaa57 tempest-TestStampPattern-1153361119 None] Lock "cinder-b294b1d2-5006-4243-9a13-b1aeb251204b-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:55:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-56ec12da-f4ef-4108-8ecd-9368b6410422 tempest-VolumesSnapshotTestJSON-647850410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:55:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-56ec12da-f4ef-4108-8ecd-9368b6410422 tempest-VolumesSnapshotTestJSON-647850410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:55:28 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-56ec12da-f4ef-4108-8ecd-9368b6410422 tempest-VolumesSnapshotTestJSON-647850410 None] Creating offline snapshot 0321be96-e81c-4bf6-8ba7-9a9e7b91b870 of volume b345ebeb-d822-4626-8e8f-54c09bd8f701 {{(pid=87165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 11:55:28 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f266510a-aa8d-4f67-88ae-0a92799d9201]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:55:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-56ec12da-f4ef-4108-8ecd-9368b6410422 tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:29 devstack sudo[103134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701
Nov 06 11:55:29 devstack sudo[103134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:29 devstack sudo[103134]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-56ec12da-f4ef-4108-8ecd-9368b6410422 tempest-VolumesSnapshotTestJSON-647850410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701" returned: 0 in 0.430s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-56ec12da-f4ef-4108-8ecd-9368b6410422 tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701.0321be96-e81c-4bf6-8ba7-9a9e7b91b870 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:29 devstack sudo[103139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701.0321be96-e81c-4bf6-8ba7-9a9e7b91b870 1G
Nov 06 11:55:29 devstack sudo[103139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:29 devstack sudo[103139]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-56ec12da-f4ef-4108-8ecd-9368b6410422 tempest-VolumesSnapshotTestJSON-647850410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701.0321be96-e81c-4bf6-8ba7-9a9e7b91b870 1G" returned: 0 in 0.532s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-56ec12da-f4ef-4108-8ecd-9368b6410422 tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b345ebeb-d822-4626-8e8f-54c09bd8f701 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701.0321be96-e81c-4bf6-8ba7-9a9e7b91b870 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:29 devstack sudo[103144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b345ebeb-d822-4626-8e8f-54c09bd8f701 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701.0321be96-e81c-4bf6-8ba7-9a9e7b91b870
Nov 06 11:55:29 devstack sudo[103144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:30 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-48c16eea-4a52-4881-910c-4b0ce73a36e0 tempest-VolumeQuotasAdminTestJSON-129771077 None] Transfer volume completed successfully.
Nov 06 11:55:30 devstack sudo[103144]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-56ec12da-f4ef-4108-8ecd-9368b6410422 tempest-VolumesSnapshotTestJSON-647850410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b345ebeb-d822-4626-8e8f-54c09bd8f701 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701.0321be96-e81c-4bf6-8ba7-9a9e7b91b870" returned: 0 in 0.414s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:30 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-56ec12da-f4ef-4108-8ecd-9368b6410422 tempest-VolumesSnapshotTestJSON-647850410 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701.0321be96-e81c-4bf6-8ba7-9a9e7b91b870 is being set with open permissions: ugo+rw
Nov 06 11:55:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-56ec12da-f4ef-4108-8ecd-9368b6410422 tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701.0321be96-e81c-4bf6-8ba7-9a9e7b91b870 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:30 devstack sudo[103149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701.0321be96-e81c-4bf6-8ba7-9a9e7b91b870
Nov 06 11:55:30 devstack sudo[103149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:30 devstack sudo[103149]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-56ec12da-f4ef-4108-8ecd-9368b6410422 tempest-VolumesSnapshotTestJSON-647850410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701.0321be96-e81c-4bf6-8ba7-9a9e7b91b870" returned: 0 in 0.339s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-56ec12da-f4ef-4108-8ecd-9368b6410422 tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:30 devstack sudo[103152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701.info
Nov 06 11:55:30 devstack sudo[103152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:30 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-496ff4f2-d4a1-4eba-8b27-716727e5e9dd tempest-VolumeQuotasAdminTestJSON-1206037692 None] Acquiring lock "cinder-ee0a7c5e-51f7-4321-be32-b7cf1e581855-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:55:30 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-496ff4f2-d4a1-4eba-8b27-716727e5e9dd tempest-VolumeQuotasAdminTestJSON-1206037692 None] Lock "cinder-ee0a7c5e-51f7-4321-be32-b7cf1e581855-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:55:30 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-496ff4f2-d4a1-4eba-8b27-716727e5e9dd tempest-VolumeQuotasAdminTestJSON-1206037692 None] Acquiring lock "cinder-quobyte-ee0a7c5e-51f7-4321-be32-b7cf1e581855" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:55:30 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-496ff4f2-d4a1-4eba-8b27-716727e5e9dd tempest-VolumeQuotasAdminTestJSON-1206037692 None] Lock "cinder-quobyte-ee0a7c5e-51f7-4321-be32-b7cf1e581855" acquired by "delete_volume" :: waited 0.058s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:55:30 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5cec29-089b-4177-99dc-ebbad3ccfed7]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:55:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-496ff4f2-d4a1-4eba-8b27-716727e5e9dd tempest-VolumeQuotasAdminTestJSON-1206037692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ee0a7c5e-51f7-4321-be32-b7cf1e581855 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:31 devstack sudo[103154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ee0a7c5e-51f7-4321-be32-b7cf1e581855
Nov 06 11:55:31 devstack sudo[103154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:31 devstack sudo[103152]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-56ec12da-f4ef-4108-8ecd-9368b6410422 tempest-VolumesSnapshotTestJSON-647850410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701.info" returned: 0 in 0.514s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:31 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-56ec12da-f4ef-4108-8ecd-9368b6410422 tempest-VolumesSnapshotTestJSON-647850410 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701.info is being set with open permissions: ugo+rw
Nov 06 11:55:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-56ec12da-f4ef-4108-8ecd-9368b6410422 tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:31 devstack sudo[103157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701.info
Nov 06 11:55:31 devstack sudo[103157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:31 devstack sudo[103154]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-496ff4f2-d4a1-4eba-8b27-716727e5e9dd tempest-VolumeQuotasAdminTestJSON-1206037692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ee0a7c5e-51f7-4321-be32-b7cf1e581855" returned: 0 in 0.517s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-496ff4f2-d4a1-4eba-8b27-716727e5e9dd tempest-VolumeQuotasAdminTestJSON-1206037692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ee0a7c5e-51f7-4321-be32-b7cf1e581855 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:31 devstack sudo[103157]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:31 devstack sudo[103164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ee0a7c5e-51f7-4321-be32-b7cf1e581855
Nov 06 11:55:31 devstack sudo[103164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-56ec12da-f4ef-4108-8ecd-9368b6410422 tempest-VolumesSnapshotTestJSON-647850410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701.info" returned: 0 in 0.305s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-56ec12da-f4ef-4108-8ecd-9368b6410422 tempest-VolumesSnapshotTestJSON-647850410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.671s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:55:31 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-56ec12da-f4ef-4108-8ecd-9368b6410422 tempest-VolumesSnapshotTestJSON-647850410 None] Create snapshot completed successfully
Nov 06 11:55:31 devstack sudo[103164]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-496ff4f2-d4a1-4eba-8b27-716727e5e9dd tempest-VolumeQuotasAdminTestJSON-1206037692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ee0a7c5e-51f7-4321-be32-b7cf1e581855" returned: 0 in 0.276s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:31 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-496ff4f2-d4a1-4eba-8b27-716727e5e9dd tempest-VolumeQuotasAdminTestJSON-1206037692 None] Lock "cinder-quobyte-ee0a7c5e-51f7-4321-be32-b7cf1e581855" released by "delete_volume" :: held 0.872s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:55:31 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-496ff4f2-d4a1-4eba-8b27-716727e5e9dd tempest-VolumeQuotasAdminTestJSON-1206037692 None] Created reservations ['565188e8-474d-4e12-a49c-0855690be13a', '947e12a8-17f3-40b0-98d5-0e6e6dedfcb9', 'b0251ffe-a5b0-4571-bd6c-85accc57c133', 'ae1e108f-c1a8-476f-9165-4463de3114c9'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:55:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-496ff4f2-d4a1-4eba-8b27-716727e5e9dd tempest-VolumeQuotasAdminTestJSON-1206037692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:55:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-496ff4f2-d4a1-4eba-8b27-716727e5e9dd tempest-VolumeQuotasAdminTestJSON-1206037692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:55:31 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-496ff4f2-d4a1-4eba-8b27-716727e5e9dd tempest-VolumeQuotasAdminTestJSON-1206037692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:55:31 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-496ff4f2-d4a1-4eba-8b27-716727e5e9dd tempest-VolumeQuotasAdminTestJSON-1206037692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:55:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-496ff4f2-d4a1-4eba-8b27-716727e5e9dd tempest-VolumeQuotasAdminTestJSON-1206037692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:55:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-496ff4f2-d4a1-4eba-8b27-716727e5e9dd tempest-VolumeQuotasAdminTestJSON-1206037692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:31 devstack sudo[103168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:55:31 devstack sudo[103168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:32 devstack sudo[103168]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-496ff4f2-d4a1-4eba-8b27-716727e5e9dd tempest-VolumeQuotasAdminTestJSON-1206037692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.371s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:32 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-496ff4f2-d4a1-4eba-8b27-716727e5e9dd tempest-VolumeQuotasAdminTestJSON-1206037692 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:55:32 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-496ff4f2-d4a1-4eba-8b27-716727e5e9dd tempest-VolumeQuotasAdminTestJSON-1206037692 None] Deleted volume successfully.
Nov 06 11:55:32 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-496ff4f2-d4a1-4eba-8b27-716727e5e9dd tempest-VolumeQuotasAdminTestJSON-1206037692 None] Lock "cinder-ee0a7c5e-51f7-4321-be32-b7cf1e581855-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:55:33 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:55:33 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] Flow 'volume_create_manager' (e4684740-049d-4b77-bdf3-25b54c837d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:55:33 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f03467-6a9f-43e1-9936-cb1edc6a6fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:55:33 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f03467-6a9f-43e1-9936-cb1edc6a6fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-179925084',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3dba0fd-a364-4a20-90bb-cfeda37b0316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f11fff5588b439f948dd78ef71e0501',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0321be96-e81c-4bf6-8ba7-9a9e7b91b870,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:55:33Z,use_quota=True,user_id='bebe3e8017604b2481907f107f937beb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:55:33 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1722c2ea-949d-43c2-92d7-0cf06e772bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:55:33 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1722c2ea-949d-43c2-92d7-0cf06e772bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:55:33 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4344b8b7-d246-4345-b812-28368b1b20a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:55:33 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4344b8b7-d246-4345-b812-28368b1b20a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a3dba0fd-a364-4a20-90bb-cfeda37b0316', 'volume_name': 'volume-a3dba0fd-a364-4a20-90bb-cfeda37b0316', 'volume_size': 1, 'snapshot_id': '0321be96-e81c-4bf6-8ba7-9a9e7b91b870'}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:55:33 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24021e08-7a96-452f-8c2a-ac1b3cd8bf41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:55:33 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24021e08-7a96-452f-8c2a-ac1b3cd8bf41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:55:33 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (538c7a58-53c5-41db-bba0-f674d53a0637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:55:33 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] Volume a3dba0fd-a364-4a20-90bb-cfeda37b0316: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a3dba0fd-a364-4a20-90bb-cfeda37b0316', 'volume_size': 1, 'snapshot_id': '0321be96-e81c-4bf6-8ba7-9a9e7b91b870'}
Nov 06 11:55:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:55:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:55:33 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] Acquiring lock "cinder-quobyte-0321be96-e81c-4bf6-8ba7-9a9e7b91b870-a3dba0fd-a364-4a20-90bb-cfeda37b0316" by "_create_volume_from_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:55:33 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] Lock "cinder-quobyte-0321be96-e81c-4bf6-8ba7-9a9e7b91b870-a3dba0fd-a364-4a20-90bb-cfeda37b0316" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:55:33 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] Creating volume a3dba0fd-a364-4a20-90bb-cfeda37b0316 from snapshot 0321be96-e81c-4bf6-8ba7-9a9e7b91b870 {{(pid=87165) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 06 11:55:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:55:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:55:33 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:55:33 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:55:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:55:33 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:55:33 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] Acquiring lock "cinder-quobyte-a3dba0fd-a364-4a20-90bb-cfeda37b0316" by "_copy_volume_from_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:55:33 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] Lock "cinder-quobyte-a3dba0fd-a364-4a20-90bb-cfeda37b0316" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:55:33 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] snapshot: 0321be96-e81c-4bf6-8ba7-9a9e7b91b870, volume: a3dba0fd-a364-4a20-90bb-cfeda37b0316,  {{(pid=87165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 06 11:55:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:55:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:55:33 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:55:33 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:55:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:55:33 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11776a9-4a77-489d-902e-f05ab3531cdf]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:55:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701.0321be96-e81c-4bf6-8ba7-9a9e7b91b870 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:33 devstack sudo[103171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701.0321be96-e81c-4bf6-8ba7-9a9e7b91b870
Nov 06 11:55:33 devstack sudo[103171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:33 devstack sudo[103171]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701.0321be96-e81c-4bf6-8ba7-9a9e7b91b870" returned: 0 in 0.420s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:33 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b345ebeb-d822-4626-8e8f-54c09bd8f701(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:55:33 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8914b4-99a9-48a7-87a8-08fb9a7e909e]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:55:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:33 devstack sudo[103176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701
Nov 06 11:55:33 devstack sudo[103176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:34 devstack sudo[103176]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701" returned: 0 in 0.470s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:34 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701 {{(pid=87165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 06 11:55:34 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] Creating direct copy from snapshot {{(pid=87165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 06 11:55:34 devstack cinder-volume[87165]: DEBUG cinder.utils [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] Path /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a3dba0fd-a364-4a20-90bb-cfeda37b0316 not found in is_blk_device check {{(pid=87165) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 06 11:55:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a3dba0fd-a364-4a20-90bb-cfeda37b0316 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:34 devstack sudo[103181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a3dba0fd-a364-4a20-90bb-cfeda37b0316
Nov 06 11:55:34 devstack sudo[103181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:42 devstack sudo[103181]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a3dba0fd-a364-4a20-90bb-cfeda37b0316" returned: 0 in 8.724s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:42 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] Image conversion details: src /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701, size 1024.00 MB, duration 8.73 sec, destination /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a3dba0fd-a364-4a20-90bb-cfeda37b0316 {{(pid=87165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 11:55:42 devstack cinder-volume[87165]: INFO cinder.image.image_utils [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] Converted 1024.00 MB image at 117.36 MB/s
Nov 06 11:55:42 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a3dba0fd-a364-4a20-90bb-cfeda37b0316 is being set with open permissions: ugo+rw
Nov 06 11:55:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a3dba0fd-a364-4a20-90bb-cfeda37b0316 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:42 devstack sudo[103197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a3dba0fd-a364-4a20-90bb-cfeda37b0316
Nov 06 11:55:42 devstack sudo[103197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:43 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:UPDATE=158,cinder:SELECT=144,cinder:INSERT=35,cinder:DELETE=13 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 11:55:43 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:SELECT=156,cinder:INSERT=37,cinder:UPDATE=150,cinder:DELETE=8 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 11:55:43 devstack sudo[103197]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a3dba0fd-a364-4a20-90bb-cfeda37b0316" returned: 0 in 0.391s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:43 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] Lock "cinder-quobyte-a3dba0fd-a364-4a20-90bb-cfeda37b0316" released by "_copy_volume_from_snapshot" :: held 10.117s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:55:43 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] Lock "cinder-quobyte-0321be96-e81c-4bf6-8ba7-9a9e7b91b870-a3dba0fd-a364-4a20-90bb-cfeda37b0316" released by "_create_volume_from_snapshot" :: held 10.211s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:55:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.226s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:55:43 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (538c7a58-53c5-41db-bba0-f674d53a0637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3dba0fd-a364-4a20-90bb-cfeda37b0316', 'volume_size': 1, 'snapshot_id': '0321be96-e81c-4bf6-8ba7-9a9e7b91b870'}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:55:43 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (664d1db5-0335-4e9b-a6e4-6f3da4c7a2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:55:43 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] Volume volume-a3dba0fd-a364-4a20-90bb-cfeda37b0316 (a3dba0fd-a364-4a20-90bb-cfeda37b0316): created successfully
Nov 06 11:55:43 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (664d1db5-0335-4e9b-a6e4-6f3da4c7a2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:55:43 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] Flow 'volume_create_manager' (e4684740-049d-4b77-bdf3-25b54c837d09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:55:43 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-19dbb689-b0a2-4ded-8d25-ec59af7231c7 tempest-VolumesSnapshotTestJSON-647850410 None] Created volume successfully.
Nov 06 11:55:44 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-13a0481d-a8d4-4ed1-9d2c-e173b39a3c17 tempest-VolumesSnapshotTestJSON-647850410 None] Acquiring lock "cinder-a3dba0fd-a364-4a20-90bb-cfeda37b0316-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:55:44 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-13a0481d-a8d4-4ed1-9d2c-e173b39a3c17 tempest-VolumesSnapshotTestJSON-647850410 None] Lock "cinder-a3dba0fd-a364-4a20-90bb-cfeda37b0316-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:55:44 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-13a0481d-a8d4-4ed1-9d2c-e173b39a3c17 tempest-VolumesSnapshotTestJSON-647850410 None] Acquiring lock "cinder-quobyte-a3dba0fd-a364-4a20-90bb-cfeda37b0316" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:55:44 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-13a0481d-a8d4-4ed1-9d2c-e173b39a3c17 tempest-VolumesSnapshotTestJSON-647850410 None] Lock "cinder-quobyte-a3dba0fd-a364-4a20-90bb-cfeda37b0316" acquired by "delete_volume" :: waited 0.018s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:55:44 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37da6a7-8456-46cd-becd-76abe79a8b6a]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:55:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-13a0481d-a8d4-4ed1-9d2c-e173b39a3c17 tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a3dba0fd-a364-4a20-90bb-cfeda37b0316 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:44 devstack sudo[103200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a3dba0fd-a364-4a20-90bb-cfeda37b0316
Nov 06 11:55:44 devstack sudo[103200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:44 devstack sudo[103200]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-13a0481d-a8d4-4ed1-9d2c-e173b39a3c17 tempest-VolumesSnapshotTestJSON-647850410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a3dba0fd-a364-4a20-90bb-cfeda37b0316" returned: 0 in 0.387s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-13a0481d-a8d4-4ed1-9d2c-e173b39a3c17 tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a3dba0fd-a364-4a20-90bb-cfeda37b0316 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:44 devstack sudo[103206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a3dba0fd-a364-4a20-90bb-cfeda37b0316
Nov 06 11:55:44 devstack sudo[103206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:45 devstack sudo[103206]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-13a0481d-a8d4-4ed1-9d2c-e173b39a3c17 tempest-VolumesSnapshotTestJSON-647850410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a3dba0fd-a364-4a20-90bb-cfeda37b0316" returned: 0 in 0.274s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:45 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-13a0481d-a8d4-4ed1-9d2c-e173b39a3c17 tempest-VolumesSnapshotTestJSON-647850410 None] Lock "cinder-quobyte-a3dba0fd-a364-4a20-90bb-cfeda37b0316" released by "delete_volume" :: held 0.724s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:55:45 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-13a0481d-a8d4-4ed1-9d2c-e173b39a3c17 tempest-VolumesSnapshotTestJSON-647850410 None] Created reservations ['b1ee6dac-35ad-4a4f-9e6b-46503c4a8e2d', '0c3747e4-233b-4e3f-a545-b425cfaac45d', '0a029af1-7258-4e07-9414-7463100cb02b', '0d3dc442-4ef1-4b50-8a0c-cc6b328884bf'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:55:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-13a0481d-a8d4-4ed1-9d2c-e173b39a3c17 tempest-VolumesSnapshotTestJSON-647850410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:55:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-13a0481d-a8d4-4ed1-9d2c-e173b39a3c17 tempest-VolumesSnapshotTestJSON-647850410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:55:45 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-13a0481d-a8d4-4ed1-9d2c-e173b39a3c17 tempest-VolumesSnapshotTestJSON-647850410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:55:45 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-13a0481d-a8d4-4ed1-9d2c-e173b39a3c17 tempest-VolumesSnapshotTestJSON-647850410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:55:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-13a0481d-a8d4-4ed1-9d2c-e173b39a3c17 tempest-VolumesSnapshotTestJSON-647850410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:55:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-13a0481d-a8d4-4ed1-9d2c-e173b39a3c17 tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:45 devstack sudo[103210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:55:45 devstack sudo[103210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:45 devstack sudo[103210]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-13a0481d-a8d4-4ed1-9d2c-e173b39a3c17 tempest-VolumesSnapshotTestJSON-647850410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.296s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:45 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-13a0481d-a8d4-4ed1-9d2c-e173b39a3c17 tempest-VolumesSnapshotTestJSON-647850410 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:55:45 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-13a0481d-a8d4-4ed1-9d2c-e173b39a3c17 tempest-VolumesSnapshotTestJSON-647850410 None] Deleted volume successfully.
Nov 06 11:55:45 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-13a0481d-a8d4-4ed1-9d2c-e173b39a3c17 tempest-VolumesSnapshotTestJSON-647850410 None] Lock "cinder-a3dba0fd-a364-4a20-90bb-cfeda37b0316-delete_volume" released by "delete_volume" :: held 1.254s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:55:45 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c523017e-1fa4-4672-a007-becf1a53c22f tempest-VolumesSnapshotTestJSON-647850410 None] Acquiring lock "cinder-0321be96-e81c-4bf6-8ba7-9a9e7b91b870-delete_snapshot" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:55:45 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c523017e-1fa4-4672-a007-becf1a53c22f tempest-VolumesSnapshotTestJSON-647850410 None] Lock "cinder-0321be96-e81c-4bf6-8ba7-9a9e7b91b870-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:55:45 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c523017e-1fa4-4672-a007-becf1a53c22f tempest-VolumesSnapshotTestJSON-647850410 None] Acquiring lock "cinder-quobyte-b345ebeb-d822-4626-8e8f-54c09bd8f701" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:55:45 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c523017e-1fa4-4672-a007-becf1a53c22f tempest-VolumesSnapshotTestJSON-647850410 None] Lock "cinder-quobyte-b345ebeb-d822-4626-8e8f-54c09bd8f701" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:55:45 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c523017e-1fa4-4672-a007-becf1a53c22f tempest-VolumesSnapshotTestJSON-647850410 None] Acquiring lock "cinder-quobyte-0321be96-e81c-4bf6-8ba7-9a9e7b91b870" by "_delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:55:45 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c523017e-1fa4-4672-a007-becf1a53c22f tempest-VolumesSnapshotTestJSON-647850410 None] Lock "cinder-quobyte-0321be96-e81c-4bf6-8ba7-9a9e7b91b870" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:55:45 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-c523017e-1fa4-4672-a007-becf1a53c22f tempest-VolumesSnapshotTestJSON-647850410 None] Deleting offline snapshot 0321be96-e81c-4bf6-8ba7-9a9e7b91b870 of volume b345ebeb-d822-4626-8e8f-54c09bd8f701 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 11:55:45 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-c523017e-1fa4-4672-a007-becf1a53c22f tempest-VolumesSnapshotTestJSON-647850410 None] snapshot_file for this snap is: volume-b345ebeb-d822-4626-8e8f-54c09bd8f701.0321be96-e81c-4bf6-8ba7-9a9e7b91b870 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 11:55:45 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[295154e6-989a-4221-b148-43e8089feb0c]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:55:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c523017e-1fa4-4672-a007-becf1a53c22f tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701.0321be96-e81c-4bf6-8ba7-9a9e7b91b870 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:45 devstack sudo[103215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701.0321be96-e81c-4bf6-8ba7-9a9e7b91b870
Nov 06 11:55:45 devstack sudo[103215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:46 devstack sudo[103215]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c523017e-1fa4-4672-a007-becf1a53c22f tempest-VolumesSnapshotTestJSON-647850410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701.0321be96-e81c-4bf6-8ba7-9a9e7b91b870" returned: 0 in 0.500s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:46 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-c523017e-1fa4-4672-a007-becf1a53c22f tempest-VolumesSnapshotTestJSON-647850410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b345ebeb-d822-4626-8e8f-54c09bd8f701(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:55:46 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0de8ba1-8a54-44d6-a1b1-48370f0b129f]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:55:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c523017e-1fa4-4672-a007-becf1a53c22f tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:46 devstack sudo[103220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701
Nov 06 11:55:46 devstack sudo[103220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:46 devstack sudo[103220]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c523017e-1fa4-4672-a007-becf1a53c22f tempest-VolumesSnapshotTestJSON-647850410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701" returned: 0 in 0.587s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c523017e-1fa4-4672-a007-becf1a53c22f tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701.0321be96-e81c-4bf6-8ba7-9a9e7b91b870 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:46 devstack sudo[103225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701.0321be96-e81c-4bf6-8ba7-9a9e7b91b870
Nov 06 11:55:46 devstack sudo[103225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:47 devstack sudo[103225]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c523017e-1fa4-4672-a007-becf1a53c22f tempest-VolumesSnapshotTestJSON-647850410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701.0321be96-e81c-4bf6-8ba7-9a9e7b91b870" returned: 0 in 0.414s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c523017e-1fa4-4672-a007-becf1a53c22f tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701.0321be96-e81c-4bf6-8ba7-9a9e7b91b870 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:47 devstack sudo[103231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701.0321be96-e81c-4bf6-8ba7-9a9e7b91b870
Nov 06 11:55:47 devstack sudo[103231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:47 devstack sudo[103231]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c523017e-1fa4-4672-a007-becf1a53c22f tempest-VolumesSnapshotTestJSON-647850410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701.0321be96-e81c-4bf6-8ba7-9a9e7b91b870" returned: 0 in 0.263s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:47 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c523017e-1fa4-4672-a007-becf1a53c22f tempest-VolumesSnapshotTestJSON-647850410 None] Lock "cinder-quobyte-0321be96-e81c-4bf6-8ba7-9a9e7b91b870" released by "_delete_snapshot" :: held 1.928s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:55:47 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c523017e-1fa4-4672-a007-becf1a53c22f tempest-VolumesSnapshotTestJSON-647850410 None] Lock "cinder-quobyte-b345ebeb-d822-4626-8e8f-54c09bd8f701" released by "delete_snapshot" :: held 1.952s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:55:47 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-c523017e-1fa4-4672-a007-becf1a53c22f tempest-VolumesSnapshotTestJSON-647850410 None] Created reservations ['4e03e882-3c2d-487a-ad4b-1ec3991cba6f', '6dd44f60-0812-4160-b3c2-a2e01ff4246b', 'fcf34564-5795-4a57-814b-7d75e9a5efe8', '0c3b03e2-c3e9-4a86-8cf5-243d5cfc5e27'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:55:47 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-c523017e-1fa4-4672-a007-becf1a53c22f tempest-VolumesSnapshotTestJSON-647850410 None] Delete snapshot completed successfully.
Nov 06 11:55:47 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c523017e-1fa4-4672-a007-becf1a53c22f tempest-VolumesSnapshotTestJSON-647850410 None] Lock "cinder-0321be96-e81c-4bf6-8ba7-9a9e7b91b870-delete_snapshot" released by "delete_snapshot" :: held 2.129s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:55:48 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-78742012-6b80-46ae-938f-77b56b32156d tempest-VolumesSnapshotTestJSON-647850410 None] Acquiring lock "cinder-b345ebeb-d822-4626-8e8f-54c09bd8f701-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:55:48 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-78742012-6b80-46ae-938f-77b56b32156d tempest-VolumesSnapshotTestJSON-647850410 None] Lock "cinder-b345ebeb-d822-4626-8e8f-54c09bd8f701-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:55:48 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-78742012-6b80-46ae-938f-77b56b32156d tempest-VolumesSnapshotTestJSON-647850410 None] Acquiring lock "cinder-quobyte-b345ebeb-d822-4626-8e8f-54c09bd8f701" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:55:49 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-78742012-6b80-46ae-938f-77b56b32156d tempest-VolumesSnapshotTestJSON-647850410 None] Lock "cinder-quobyte-b345ebeb-d822-4626-8e8f-54c09bd8f701" acquired by "delete_volume" :: waited 0.038s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:55:49 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8a67ac-69fe-4aab-90ab-0b122a84f2a1]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:55:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-78742012-6b80-46ae-938f-77b56b32156d tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:49 devstack sudo[103234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701
Nov 06 11:55:49 devstack sudo[103234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:49 devstack sudo[103234]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-78742012-6b80-46ae-938f-77b56b32156d tempest-VolumesSnapshotTestJSON-647850410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701" returned: 0 in 0.501s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-78742012-6b80-46ae-938f-77b56b32156d tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:49 devstack sudo[103239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701
Nov 06 11:55:49 devstack sudo[103239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:49 devstack sudo[103239]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-78742012-6b80-46ae-938f-77b56b32156d tempest-VolumesSnapshotTestJSON-647850410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b345ebeb-d822-4626-8e8f-54c09bd8f701" returned: 0 in 0.329s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:49 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-78742012-6b80-46ae-938f-77b56b32156d tempest-VolumesSnapshotTestJSON-647850410 None] Lock "cinder-quobyte-b345ebeb-d822-4626-8e8f-54c09bd8f701" released by "delete_volume" :: held 0.917s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:55:50 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-78742012-6b80-46ae-938f-77b56b32156d tempest-VolumesSnapshotTestJSON-647850410 None] Created reservations ['e9f0e3f3-de00-4cce-b0d8-c0eb5b8c1967', 'cceb6e23-1afa-4b32-855c-eb4f090d350c', '7ed5926d-e763-49b3-b2fd-33a935f0dd71', '11eb2501-0371-4adc-a431-ed227d9131dc'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:55:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-78742012-6b80-46ae-938f-77b56b32156d tempest-VolumesSnapshotTestJSON-647850410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:55:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-78742012-6b80-46ae-938f-77b56b32156d tempest-VolumesSnapshotTestJSON-647850410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:55:50 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-78742012-6b80-46ae-938f-77b56b32156d tempest-VolumesSnapshotTestJSON-647850410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:55:50 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-78742012-6b80-46ae-938f-77b56b32156d tempest-VolumesSnapshotTestJSON-647850410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:55:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-78742012-6b80-46ae-938f-77b56b32156d tempest-VolumesSnapshotTestJSON-647850410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:55:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-78742012-6b80-46ae-938f-77b56b32156d tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:50 devstack sudo[103243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:55:50 devstack sudo[103243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:50 devstack sudo[103243]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-78742012-6b80-46ae-938f-77b56b32156d tempest-VolumesSnapshotTestJSON-647850410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.392s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:50 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-78742012-6b80-46ae-938f-77b56b32156d tempest-VolumesSnapshotTestJSON-647850410 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:55:50 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-78742012-6b80-46ae-938f-77b56b32156d tempest-VolumesSnapshotTestJSON-647850410 None] Deleted volume successfully.
Nov 06 11:55:50 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-78742012-6b80-46ae-938f-77b56b32156d tempest-VolumesSnapshotTestJSON-647850410 None] Lock "cinder-b345ebeb-d822-4626-8e8f-54c09bd8f701-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:55:51 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-97eee216-9b28-427a-9d41-35e2c3396173 tempest-VolumesSnapshotTestJSON-647850410 None] Acquiring lock "cinder-11719517-67f7-4340-9d5a-5b1514400f36-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:55:51 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-97eee216-9b28-427a-9d41-35e2c3396173 tempest-VolumesSnapshotTestJSON-647850410 None] Lock "cinder-11719517-67f7-4340-9d5a-5b1514400f36-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:55:51 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-97eee216-9b28-427a-9d41-35e2c3396173 tempest-VolumesSnapshotTestJSON-647850410 None] Acquiring lock "cinder-quobyte-11719517-67f7-4340-9d5a-5b1514400f36" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:55:51 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-97eee216-9b28-427a-9d41-35e2c3396173 tempest-VolumesSnapshotTestJSON-647850410 None] Lock "cinder-quobyte-11719517-67f7-4340-9d5a-5b1514400f36" acquired by "delete_volume" :: waited 0.023s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:55:51 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[947612a1-0c96-463a-b260-77e0063f7015]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:55:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-97eee216-9b28-427a-9d41-35e2c3396173 tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-11719517-67f7-4340-9d5a-5b1514400f36 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:51 devstack sudo[103246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-11719517-67f7-4340-9d5a-5b1514400f36
Nov 06 11:55:51 devstack sudo[103246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:52 devstack sudo[103246]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-97eee216-9b28-427a-9d41-35e2c3396173 tempest-VolumesSnapshotTestJSON-647850410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-11719517-67f7-4340-9d5a-5b1514400f36" returned: 0 in 0.526s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-97eee216-9b28-427a-9d41-35e2c3396173 tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-11719517-67f7-4340-9d5a-5b1514400f36 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:52 devstack sudo[103251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-11719517-67f7-4340-9d5a-5b1514400f36
Nov 06 11:55:52 devstack sudo[103251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:52 devstack sudo[103251]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-97eee216-9b28-427a-9d41-35e2c3396173 tempest-VolumesSnapshotTestJSON-647850410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-11719517-67f7-4340-9d5a-5b1514400f36" returned: 0 in 0.330s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:52 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-97eee216-9b28-427a-9d41-35e2c3396173 tempest-VolumesSnapshotTestJSON-647850410 None] Lock "cinder-quobyte-11719517-67f7-4340-9d5a-5b1514400f36" released by "delete_volume" :: held 0.974s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:55:52 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-97eee216-9b28-427a-9d41-35e2c3396173 tempest-VolumesSnapshotTestJSON-647850410 None] Created reservations ['c9a02579-785c-41bd-a8ab-458876e0fc4a', '33717e5a-35d0-4b13-9c56-fb0bc58062c6', 'e2d455bb-524c-4c84-846b-ddd57ef3f764', 'f7a89074-3611-45ab-8b77-ef8d5388d005'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:55:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-97eee216-9b28-427a-9d41-35e2c3396173 tempest-VolumesSnapshotTestJSON-647850410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:55:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-97eee216-9b28-427a-9d41-35e2c3396173 tempest-VolumesSnapshotTestJSON-647850410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:55:52 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-97eee216-9b28-427a-9d41-35e2c3396173 tempest-VolumesSnapshotTestJSON-647850410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:55:52 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-97eee216-9b28-427a-9d41-35e2c3396173 tempest-VolumesSnapshotTestJSON-647850410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:55:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-97eee216-9b28-427a-9d41-35e2c3396173 tempest-VolumesSnapshotTestJSON-647850410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:55:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-97eee216-9b28-427a-9d41-35e2c3396173 tempest-VolumesSnapshotTestJSON-647850410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:52 devstack sudo[103254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:55:52 devstack sudo[103254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:53 devstack sudo[103254]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-97eee216-9b28-427a-9d41-35e2c3396173 tempest-VolumesSnapshotTestJSON-647850410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.346s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:53 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-97eee216-9b28-427a-9d41-35e2c3396173 tempest-VolumesSnapshotTestJSON-647850410 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:55:53 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-97eee216-9b28-427a-9d41-35e2c3396173 tempest-VolumesSnapshotTestJSON-647850410 None] Deleted volume successfully.
Nov 06 11:55:53 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-97eee216-9b28-427a-9d41-35e2c3396173 tempest-VolumesSnapshotTestJSON-647850410 None] Lock "cinder-11719517-67f7-4340-9d5a-5b1514400f36-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:55:54 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b6fa0fb-c91b-4755-9342-a086ab38c095 tempest-VolumeQuotasNegativeTestJSON-665589788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:55:54 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8b6fa0fb-c91b-4755-9342-a086ab38c095 tempest-VolumeQuotasNegativeTestJSON-665589788 None] Flow 'volume_create_manager' (ab606bdc-fe7c-4978-9659-06d8ed29a41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:55:54 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8b6fa0fb-c91b-4755-9342-a086ab38c095 tempest-VolumeQuotasNegativeTestJSON-665589788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27c0dd59-a1fd-406b-87f1-e86cd8fb3083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:55:54 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8b6fa0fb-c91b-4755-9342-a086ab38c095 tempest-VolumeQuotasNegativeTestJSON-665589788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27c0dd59-a1fd-406b-87f1-e86cd8fb3083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-870784181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c7dcf13-0e79-4cd1-b921-f263fec47717,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd3c067f60d40dc8399e5615a6f6ecd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:55:54Z,use_quota=True,user_id='a2bac47a4b1e479593e5cf4570e25f0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:55:54 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8b6fa0fb-c91b-4755-9342-a086ab38c095 tempest-VolumeQuotasNegativeTestJSON-665589788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7df86468-6666-4036-9a7e-6e136c660632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:55:54 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8b6fa0fb-c91b-4755-9342-a086ab38c095 tempest-VolumeQuotasNegativeTestJSON-665589788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7df86468-6666-4036-9a7e-6e136c660632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:55:54 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8b6fa0fb-c91b-4755-9342-a086ab38c095 tempest-VolumeQuotasNegativeTestJSON-665589788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2edba589-2026-4fe8-aac2-4d93b141735a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:55:54 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8b6fa0fb-c91b-4755-9342-a086ab38c095 tempest-VolumeQuotasNegativeTestJSON-665589788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2edba589-2026-4fe8-aac2-4d93b141735a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c7dcf13-0e79-4cd1-b921-f263fec47717', 'volume_name': 'volume-0c7dcf13-0e79-4cd1-b921-f263fec47717', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:55:54 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8b6fa0fb-c91b-4755-9342-a086ab38c095 tempest-VolumeQuotasNegativeTestJSON-665589788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f70791c-4f4a-4e84-886c-2cf6e82bff22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:55:54 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8b6fa0fb-c91b-4755-9342-a086ab38c095 tempest-VolumeQuotasNegativeTestJSON-665589788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f70791c-4f4a-4e84-886c-2cf6e82bff22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:55:54 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8b6fa0fb-c91b-4755-9342-a086ab38c095 tempest-VolumeQuotasNegativeTestJSON-665589788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc4869d3-0689-4c14-9e79-d96609379afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:55:54 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-8b6fa0fb-c91b-4755-9342-a086ab38c095 tempest-VolumeQuotasNegativeTestJSON-665589788 None] Volume 0c7dcf13-0e79-4cd1-b921-f263fec47717: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c7dcf13-0e79-4cd1-b921-f263fec47717', 'volume_size': 1}
Nov 06 11:55:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-8b6fa0fb-c91b-4755-9342-a086ab38c095 tempest-VolumeQuotasNegativeTestJSON-665589788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:55:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-8b6fa0fb-c91b-4755-9342-a086ab38c095 tempest-VolumeQuotasNegativeTestJSON-665589788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:55:54 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-8b6fa0fb-c91b-4755-9342-a086ab38c095 tempest-VolumeQuotasNegativeTestJSON-665589788 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-870784181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c7dcf13-0e79-4cd1-b921-f263fec47717,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd3c067f60d40dc8399e5615a6f6ecd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:55:54Z,use_quota=True,user_id='a2bac47a4b1e479593e5cf4570e25f0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:55:54 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-8b6fa0fb-c91b-4755-9342-a086ab38c095 tempest-VolumeQuotasNegativeTestJSON-665589788 None] Creating volume 0c7dcf13-0e79-4cd1-b921-f263fec47717 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:55:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-8b6fa0fb-c91b-4755-9342-a086ab38c095 tempest-VolumeQuotasNegativeTestJSON-665589788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:55:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-8b6fa0fb-c91b-4755-9342-a086ab38c095 tempest-VolumeQuotasNegativeTestJSON-665589788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:55:54 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-8b6fa0fb-c91b-4755-9342-a086ab38c095 tempest-VolumeQuotasNegativeTestJSON-665589788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:55:54 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-8b6fa0fb-c91b-4755-9342-a086ab38c095 tempest-VolumeQuotasNegativeTestJSON-665589788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:55:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-8b6fa0fb-c91b-4755-9342-a086ab38c095 tempest-VolumeQuotasNegativeTestJSON-665589788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:55:54 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-8b6fa0fb-c91b-4755-9342-a086ab38c095 tempest-VolumeQuotasNegativeTestJSON-665589788 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:55:54 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-8b6fa0fb-c91b-4755-9342-a086ab38c095 tempest-VolumeQuotasNegativeTestJSON-665589788 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:55:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-8b6fa0fb-c91b-4755-9342-a086ab38c095 tempest-VolumeQuotasNegativeTestJSON-665589788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0c7dcf13-0e79-4cd1-b921-f263fec47717 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:54 devstack sudo[103257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0c7dcf13-0e79-4cd1-b921-f263fec47717 1073741824
Nov 06 11:55:54 devstack sudo[103257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:55 devstack sudo[103257]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-8b6fa0fb-c91b-4755-9342-a086ab38c095 tempest-VolumeQuotasNegativeTestJSON-665589788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0c7dcf13-0e79-4cd1-b921-f263fec47717 1073741824" returned: 0 in 0.728s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-8b6fa0fb-c91b-4755-9342-a086ab38c095 tempest-VolumeQuotasNegativeTestJSON-665589788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0c7dcf13-0e79-4cd1-b921-f263fec47717 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:55 devstack sudo[103264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0c7dcf13-0e79-4cd1-b921-f263fec47717
Nov 06 11:55:55 devstack sudo[103264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:55 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad7520e7-0cd0-40a3-8b79-67aae4a7e149 tempest-VolumeDependencyTests-665248495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:55:55 devstack sudo[103264]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:55 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ad7520e7-0cd0-40a3-8b79-67aae4a7e149 tempest-VolumeDependencyTests-665248495 None] Flow 'volume_create_manager' (68288507-83c5-4aa0-9740-521fef9e1b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:55:55 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ad7520e7-0cd0-40a3-8b79-67aae4a7e149 tempest-VolumeDependencyTests-665248495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8103673-660b-4075-a53f-5c624c04c948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:55:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-8b6fa0fb-c91b-4755-9342-a086ab38c095 tempest-VolumeQuotasNegativeTestJSON-665589788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0c7dcf13-0e79-4cd1-b921-f263fec47717" returned: 0 in 0.379s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:55 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-8b6fa0fb-c91b-4755-9342-a086ab38c095 tempest-VolumeQuotasNegativeTestJSON-665589788 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:55:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-8b6fa0fb-c91b-4755-9342-a086ab38c095 tempest-VolumeQuotasNegativeTestJSON-665589788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:55:55 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ad7520e7-0cd0-40a3-8b79-67aae4a7e149 tempest-VolumeDependencyTests-665248495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8103673-660b-4075-a53f-5c624c04c948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-934588822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4db9d4fa-55de-4223-9451-5cd5a9cef032,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='871f30b1bdd3476396e9f33772e13d1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:55:55Z,use_quota=True,user_id='a612380c298c4578849edf306c0b2e9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:55:55 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ad7520e7-0cd0-40a3-8b79-67aae4a7e149 tempest-VolumeDependencyTests-665248495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed51a784-2370-4614-81ea-657167f34516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:55:55 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ad7520e7-0cd0-40a3-8b79-67aae4a7e149 tempest-VolumeDependencyTests-665248495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed51a784-2370-4614-81ea-657167f34516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:55:55 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ad7520e7-0cd0-40a3-8b79-67aae4a7e149 tempest-VolumeDependencyTests-665248495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2ccc597-8488-4fc0-aa91-844352f10e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:55:55 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ad7520e7-0cd0-40a3-8b79-67aae4a7e149 tempest-VolumeDependencyTests-665248495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2ccc597-8488-4fc0-aa91-844352f10e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4db9d4fa-55de-4223-9451-5cd5a9cef032', 'volume_name': 'volume-4db9d4fa-55de-4223-9451-5cd5a9cef032', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:55:55 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ad7520e7-0cd0-40a3-8b79-67aae4a7e149 tempest-VolumeDependencyTests-665248495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (998b7d3b-9db7-44e7-b002-3d19ffe03807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:55:55 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ad7520e7-0cd0-40a3-8b79-67aae4a7e149 tempest-VolumeDependencyTests-665248495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (998b7d3b-9db7-44e7-b002-3d19ffe03807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:55:55 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ad7520e7-0cd0-40a3-8b79-67aae4a7e149 tempest-VolumeDependencyTests-665248495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0691ce9e-054c-47f7-88f9-baed0f47cbf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:55:55 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-ad7520e7-0cd0-40a3-8b79-67aae4a7e149 tempest-VolumeDependencyTests-665248495 None] Volume 4db9d4fa-55de-4223-9451-5cd5a9cef032: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4db9d4fa-55de-4223-9451-5cd5a9cef032', 'volume_size': 1}
Nov 06 11:55:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ad7520e7-0cd0-40a3-8b79-67aae4a7e149 tempest-VolumeDependencyTests-665248495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:55:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ad7520e7-0cd0-40a3-8b79-67aae4a7e149 tempest-VolumeDependencyTests-665248495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:55:55 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ad7520e7-0cd0-40a3-8b79-67aae4a7e149 tempest-VolumeDependencyTests-665248495 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-934588822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4db9d4fa-55de-4223-9451-5cd5a9cef032,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='871f30b1bdd3476396e9f33772e13d1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:55:55Z,use_quota=True,user_id='a612380c298c4578849edf306c0b2e9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:55:55 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-ad7520e7-0cd0-40a3-8b79-67aae4a7e149 tempest-VolumeDependencyTests-665248495 None] Creating volume 4db9d4fa-55de-4223-9451-5cd5a9cef032 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:55:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ad7520e7-0cd0-40a3-8b79-67aae4a7e149 tempest-VolumeDependencyTests-665248495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:55:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ad7520e7-0cd0-40a3-8b79-67aae4a7e149 tempest-VolumeDependencyTests-665248495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:55:55 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ad7520e7-0cd0-40a3-8b79-67aae4a7e149 tempest-VolumeDependencyTests-665248495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:55:55 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ad7520e7-0cd0-40a3-8b79-67aae4a7e149 tempest-VolumeDependencyTests-665248495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:55:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ad7520e7-0cd0-40a3-8b79-67aae4a7e149 tempest-VolumeDependencyTests-665248495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:55:55 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ad7520e7-0cd0-40a3-8b79-67aae4a7e149 tempest-VolumeDependencyTests-665248495 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:55:55 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-ad7520e7-0cd0-40a3-8b79-67aae4a7e149 tempest-VolumeDependencyTests-665248495 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:55:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ad7520e7-0cd0-40a3-8b79-67aae4a7e149 tempest-VolumeDependencyTests-665248495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:55 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8b6fa0fb-c91b-4755-9342-a086ab38c095 tempest-VolumeQuotasNegativeTestJSON-665589788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc4869d3-0689-4c14-9e79-d96609379afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c7dcf13-0e79-4cd1-b921-f263fec47717', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:55:55 devstack sudo[103269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032 1073741824
Nov 06 11:55:55 devstack sudo[103269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:55 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8b6fa0fb-c91b-4755-9342-a086ab38c095 tempest-VolumeQuotasNegativeTestJSON-665589788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b26e01a2-cb32-42ef-9678-63013dc86835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:55:55 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-8b6fa0fb-c91b-4755-9342-a086ab38c095 tempest-VolumeQuotasNegativeTestJSON-665589788 None] Volume volume-0c7dcf13-0e79-4cd1-b921-f263fec47717 (0c7dcf13-0e79-4cd1-b921-f263fec47717): created successfully
Nov 06 11:55:55 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8b6fa0fb-c91b-4755-9342-a086ab38c095 tempest-VolumeQuotasNegativeTestJSON-665589788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b26e01a2-cb32-42ef-9678-63013dc86835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:55:55 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8b6fa0fb-c91b-4755-9342-a086ab38c095 tempest-VolumeQuotasNegativeTestJSON-665589788 None] Flow 'volume_create_manager' (ab606bdc-fe7c-4978-9659-06d8ed29a41c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:55:55 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-8b6fa0fb-c91b-4755-9342-a086ab38c095 tempest-VolumeQuotasNegativeTestJSON-665589788 None] Created volume successfully.
Nov 06 11:55:56 devstack sudo[103269]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ad7520e7-0cd0-40a3-8b79-67aae4a7e149 tempest-VolumeDependencyTests-665248495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032 1073741824" returned: 0 in 0.608s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ad7520e7-0cd0-40a3-8b79-67aae4a7e149 tempest-VolumeDependencyTests-665248495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:56 devstack sudo[103276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032
Nov 06 11:55:56 devstack sudo[103276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:56 devstack sudo[103276]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ad7520e7-0cd0-40a3-8b79-67aae4a7e149 tempest-VolumeDependencyTests-665248495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032" returned: 0 in 0.377s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:56 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ad7520e7-0cd0-40a3-8b79-67aae4a7e149 tempest-VolumeDependencyTests-665248495 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:55:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ad7520e7-0cd0-40a3-8b79-67aae4a7e149 tempest-VolumeDependencyTests-665248495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:55:56 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ad7520e7-0cd0-40a3-8b79-67aae4a7e149 tempest-VolumeDependencyTests-665248495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0691ce9e-054c-47f7-88f9-baed0f47cbf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4db9d4fa-55de-4223-9451-5cd5a9cef032', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:55:56 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ad7520e7-0cd0-40a3-8b79-67aae4a7e149 tempest-VolumeDependencyTests-665248495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9586eed4-0817-4350-929a-1465606c9608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:55:56 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-ad7520e7-0cd0-40a3-8b79-67aae4a7e149 tempest-VolumeDependencyTests-665248495 None] Volume volume-4db9d4fa-55de-4223-9451-5cd5a9cef032 (4db9d4fa-55de-4223-9451-5cd5a9cef032): created successfully
Nov 06 11:55:56 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ad7520e7-0cd0-40a3-8b79-67aae4a7e149 tempest-VolumeDependencyTests-665248495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9586eed4-0817-4350-929a-1465606c9608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:55:56 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ad7520e7-0cd0-40a3-8b79-67aae4a7e149 tempest-VolumeDependencyTests-665248495 None] Flow 'volume_create_manager' (68288507-83c5-4aa0-9740-521fef9e1b6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:55:56 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-ad7520e7-0cd0-40a3-8b79-67aae4a7e149 tempest-VolumeDependencyTests-665248495 None] Created volume successfully.
Nov 06 11:55:57 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-3474b251-aa17-44ec-a1c4-77f4f9ea1249 tempest-TestImageHashVerification-1197010532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:55:57 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3474b251-aa17-44ec-a1c4-77f4f9ea1249 tempest-TestImageHashVerification-1197010532 None] Flow 'volume_create_manager' (eeff5217-cb78-4202-8d06-9cb5b26f611a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:55:57 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3474b251-aa17-44ec-a1c4-77f4f9ea1249 tempest-TestImageHashVerification-1197010532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa89ad8-7ce9-4dd8-a4a0-feb35f94afd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:55:57 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3474b251-aa17-44ec-a1c4-77f4f9ea1249 tempest-TestImageHashVerification-1197010532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa89ad8-7ce9-4dd8-a4a0-feb35f94afd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-610687801',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e783686-4a33-4281-ad36-218b0d1cd830,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='892344ebbaec463a87e953259d501e6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:55:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:55:58Z,use_quota=True,user_id='cb7cfee9584a47ff939f3f92ef94a5d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:55:57 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3474b251-aa17-44ec-a1c4-77f4f9ea1249 tempest-TestImageHashVerification-1197010532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (684ab5bb-e70b-4d51-9191-40e48b8fdd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:55:57 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3474b251-aa17-44ec-a1c4-77f4f9ea1249 tempest-TestImageHashVerification-1197010532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (684ab5bb-e70b-4d51-9191-40e48b8fdd38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:55:57 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3474b251-aa17-44ec-a1c4-77f4f9ea1249 tempest-TestImageHashVerification-1197010532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5586d080-2faf-473f-b0a7-0b847990e46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:55:57 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3474b251-aa17-44ec-a1c4-77f4f9ea1249 tempest-TestImageHashVerification-1197010532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5586d080-2faf-473f-b0a7-0b847990e46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e783686-4a33-4281-ad36-218b0d1cd830', 'volume_name': 'volume-4e783686-4a33-4281-ad36-218b0d1cd830', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:55:57 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3474b251-aa17-44ec-a1c4-77f4f9ea1249 tempest-TestImageHashVerification-1197010532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45aed499-ebab-4455-a85a-a22220cc5a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:55:57 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3474b251-aa17-44ec-a1c4-77f4f9ea1249 tempest-TestImageHashVerification-1197010532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45aed499-ebab-4455-a85a-a22220cc5a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:55:57 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3474b251-aa17-44ec-a1c4-77f4f9ea1249 tempest-TestImageHashVerification-1197010532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67a58de6-8ef0-4479-86e3-11cdddfaa39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:55:57 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-3474b251-aa17-44ec-a1c4-77f4f9ea1249 tempest-TestImageHashVerification-1197010532 None] Volume 4e783686-4a33-4281-ad36-218b0d1cd830: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e783686-4a33-4281-ad36-218b0d1cd830', 'volume_size': 1}
Nov 06 11:55:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3474b251-aa17-44ec-a1c4-77f4f9ea1249 tempest-TestImageHashVerification-1197010532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:55:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3474b251-aa17-44ec-a1c4-77f4f9ea1249 tempest-TestImageHashVerification-1197010532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:55:57 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-3474b251-aa17-44ec-a1c4-77f4f9ea1249 tempest-TestImageHashVerification-1197010532 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-610687801',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e783686-4a33-4281-ad36-218b0d1cd830,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='892344ebbaec463a87e953259d501e6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:55:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:55:58Z,use_quota=True,user_id='cb7cfee9584a47ff939f3f92ef94a5d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:55:57 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-3474b251-aa17-44ec-a1c4-77f4f9ea1249 tempest-TestImageHashVerification-1197010532 None] Creating volume 4e783686-4a33-4281-ad36-218b0d1cd830 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:55:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3474b251-aa17-44ec-a1c4-77f4f9ea1249 tempest-TestImageHashVerification-1197010532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:55:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3474b251-aa17-44ec-a1c4-77f4f9ea1249 tempest-TestImageHashVerification-1197010532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:55:57 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-3474b251-aa17-44ec-a1c4-77f4f9ea1249 tempest-TestImageHashVerification-1197010532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:55:57 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-3474b251-aa17-44ec-a1c4-77f4f9ea1249 tempest-TestImageHashVerification-1197010532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:55:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3474b251-aa17-44ec-a1c4-77f4f9ea1249 tempest-TestImageHashVerification-1197010532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:55:57 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-3474b251-aa17-44ec-a1c4-77f4f9ea1249 tempest-TestImageHashVerification-1197010532 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:55:57 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-3474b251-aa17-44ec-a1c4-77f4f9ea1249 tempest-TestImageHashVerification-1197010532 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:55:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3474b251-aa17-44ec-a1c4-77f4f9ea1249 tempest-TestImageHashVerification-1197010532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4e783686-4a33-4281-ad36-218b0d1cd830 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:57 devstack sudo[103279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4e783686-4a33-4281-ad36-218b0d1cd830 1073741824
Nov 06 11:55:57 devstack sudo[103279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f9ffc73e-28fb-4565-9d02-2cbb72834128 tempest-VolumeDependencyTests-665248495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:55:58 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-2712d80e-c594-40f9-b757-0df64649cc6f tempest-VolumeQuotasNegativeTestJSON-665589788 None] Acquiring lock "cinder-0c7dcf13-0e79-4cd1-b921-f263fec47717-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:55:58 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-2712d80e-c594-40f9-b757-0df64649cc6f tempest-VolumeQuotasNegativeTestJSON-665589788 None] Lock "cinder-0c7dcf13-0e79-4cd1-b921-f263fec47717-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:55:58 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-2712d80e-c594-40f9-b757-0df64649cc6f tempest-VolumeQuotasNegativeTestJSON-665589788 None] Acquiring lock "cinder-quobyte-0c7dcf13-0e79-4cd1-b921-f263fec47717" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:55:58 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-2712d80e-c594-40f9-b757-0df64649cc6f tempest-VolumeQuotasNegativeTestJSON-665589788 None] Lock "cinder-quobyte-0c7dcf13-0e79-4cd1-b921-f263fec47717" acquired by "delete_volume" :: waited 0.014s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:55:58 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[07faf8f9-2806-4f3f-969d-49e6f6fd1809]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:55:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2712d80e-c594-40f9-b757-0df64649cc6f tempest-VolumeQuotasNegativeTestJSON-665589788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0c7dcf13-0e79-4cd1-b921-f263fec47717 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:58 devstack sudo[103281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0c7dcf13-0e79-4cd1-b921-f263fec47717
Nov 06 11:55:58 devstack sudo[103281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:58 devstack sudo[103279]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3474b251-aa17-44ec-a1c4-77f4f9ea1249 tempest-TestImageHashVerification-1197010532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4e783686-4a33-4281-ad36-218b0d1cd830 1073741824" returned: 0 in 0.462s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3474b251-aa17-44ec-a1c4-77f4f9ea1249 tempest-TestImageHashVerification-1197010532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4e783686-4a33-4281-ad36-218b0d1cd830 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:58 devstack sudo[103288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4e783686-4a33-4281-ad36-218b0d1cd830
Nov 06 11:55:58 devstack sudo[103288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:58 devstack sudo[103281]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2712d80e-c594-40f9-b757-0df64649cc6f tempest-VolumeQuotasNegativeTestJSON-665589788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0c7dcf13-0e79-4cd1-b921-f263fec47717" returned: 0 in 0.427s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2712d80e-c594-40f9-b757-0df64649cc6f tempest-VolumeQuotasNegativeTestJSON-665589788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0c7dcf13-0e79-4cd1-b921-f263fec47717 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:58 devstack sudo[103293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0c7dcf13-0e79-4cd1-b921-f263fec47717
Nov 06 11:55:58 devstack sudo[103293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:58 devstack sudo[103288]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3474b251-aa17-44ec-a1c4-77f4f9ea1249 tempest-TestImageHashVerification-1197010532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4e783686-4a33-4281-ad36-218b0d1cd830" returned: 0 in 0.410s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:58 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-3474b251-aa17-44ec-a1c4-77f4f9ea1249 tempest-TestImageHashVerification-1197010532 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:55:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3474b251-aa17-44ec-a1c4-77f4f9ea1249 tempest-TestImageHashVerification-1197010532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:55:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f9ffc73e-28fb-4565-9d02-2cbb72834128 tempest-VolumeDependencyTests-665248495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.861s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:55:58 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-f9ffc73e-28fb-4565-9d02-2cbb72834128 tempest-VolumeDependencyTests-665248495 None] Creating offline snapshot a1b61434-9bf6-47a5-bd4f-344b8eab6a69 of volume 4db9d4fa-55de-4223-9451-5cd5a9cef032 {{(pid=87165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 11:55:58 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3474b251-aa17-44ec-a1c4-77f4f9ea1249 tempest-TestImageHashVerification-1197010532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67a58de6-8ef0-4479-86e3-11cdddfaa39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e783686-4a33-4281-ad36-218b0d1cd830', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:55:58 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3474b251-aa17-44ec-a1c4-77f4f9ea1249 tempest-TestImageHashVerification-1197010532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (887c4fc5-422a-4aae-9251-4f67e4895571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:55:58 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29f843b-3601-4fc2-ae61-0a376ead1e2f]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:55:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f9ffc73e-28fb-4565-9d02-2cbb72834128 tempest-VolumeDependencyTests-665248495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:58 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-3474b251-aa17-44ec-a1c4-77f4f9ea1249 tempest-TestImageHashVerification-1197010532 None] Volume volume-4e783686-4a33-4281-ad36-218b0d1cd830 (4e783686-4a33-4281-ad36-218b0d1cd830): created successfully
Nov 06 11:55:58 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3474b251-aa17-44ec-a1c4-77f4f9ea1249 tempest-TestImageHashVerification-1197010532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (887c4fc5-422a-4aae-9251-4f67e4895571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:55:58 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3474b251-aa17-44ec-a1c4-77f4f9ea1249 tempest-TestImageHashVerification-1197010532 None] Flow 'volume_create_manager' (eeff5217-cb78-4202-8d06-9cb5b26f611a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:55:58 devstack sudo[103293]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2712d80e-c594-40f9-b757-0df64649cc6f tempest-VolumeQuotasNegativeTestJSON-665589788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0c7dcf13-0e79-4cd1-b921-f263fec47717" returned: 0 in 0.366s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:58 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-3474b251-aa17-44ec-a1c4-77f4f9ea1249 tempest-TestImageHashVerification-1197010532 None] Created volume successfully.
Nov 06 11:55:58 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-2712d80e-c594-40f9-b757-0df64649cc6f tempest-VolumeQuotasNegativeTestJSON-665589788 None] Lock "cinder-quobyte-0c7dcf13-0e79-4cd1-b921-f263fec47717" released by "delete_volume" :: held 0.861s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:55:59 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-2712d80e-c594-40f9-b757-0df64649cc6f tempest-VolumeQuotasNegativeTestJSON-665589788 None] Created reservations ['b09604e8-210b-4bc0-b365-1b3791c60017', 'f316ee0d-0ff3-4f0c-98ae-467ee7fffd28', 'f9f84532-c017-4d6d-bb8e-7bbe1d73bbb8', '5fce503d-790c-42c9-bda7-2fb5e0cd6653'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:55:59 devstack sudo[103297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032
Nov 06 11:55:59 devstack sudo[103297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-2712d80e-c594-40f9-b757-0df64649cc6f tempest-VolumeQuotasNegativeTestJSON-665589788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:55:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-2712d80e-c594-40f9-b757-0df64649cc6f tempest-VolumeQuotasNegativeTestJSON-665589788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:55:59 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-2712d80e-c594-40f9-b757-0df64649cc6f tempest-VolumeQuotasNegativeTestJSON-665589788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:55:59 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-2712d80e-c594-40f9-b757-0df64649cc6f tempest-VolumeQuotasNegativeTestJSON-665589788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:55:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-2712d80e-c594-40f9-b757-0df64649cc6f tempest-VolumeQuotasNegativeTestJSON-665589788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:55:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2712d80e-c594-40f9-b757-0df64649cc6f tempest-VolumeQuotasNegativeTestJSON-665589788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:59 devstack sudo[103299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:55:59 devstack sudo[103299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:59 devstack sudo[103297]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f9ffc73e-28fb-4565-9d02-2cbb72834128 tempest-VolumeDependencyTests-665248495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032" returned: 0 in 0.538s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f9ffc73e-28fb-4565-9d02-2cbb72834128 tempest-VolumeDependencyTests-665248495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032.a1b61434-9bf6-47a5-bd4f-344b8eab6a69 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:55:59 devstack sudo[103304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032.a1b61434-9bf6-47a5-bd4f-344b8eab6a69 1G
Nov 06 11:55:59 devstack sudo[103304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:55:59 devstack sudo[103299]: pam_unix(sudo:session): session closed for user root
Nov 06 11:55:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2712d80e-c594-40f9-b757-0df64649cc6f tempest-VolumeQuotasNegativeTestJSON-665589788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.373s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:55:59 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-2712d80e-c594-40f9-b757-0df64649cc6f tempest-VolumeQuotasNegativeTestJSON-665589788 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:55:59 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-2712d80e-c594-40f9-b757-0df64649cc6f tempest-VolumeQuotasNegativeTestJSON-665589788 None] Deleted volume successfully.
Nov 06 11:55:59 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-2712d80e-c594-40f9-b757-0df64649cc6f tempest-VolumeQuotasNegativeTestJSON-665589788 None] Lock "cinder-0c7dcf13-0e79-4cd1-b921-f263fec47717-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:56:00 devstack sudo[103304]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f9ffc73e-28fb-4565-9d02-2cbb72834128 tempest-VolumeDependencyTests-665248495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032.a1b61434-9bf6-47a5-bd4f-344b8eab6a69 1G" returned: 0 in 0.613s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f9ffc73e-28fb-4565-9d02-2cbb72834128 tempest-VolumeDependencyTests-665248495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4db9d4fa-55de-4223-9451-5cd5a9cef032 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032.a1b61434-9bf6-47a5-bd4f-344b8eab6a69 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:00 devstack sudo[103311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4db9d4fa-55de-4223-9451-5cd5a9cef032 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032.a1b61434-9bf6-47a5-bd4f-344b8eab6a69
Nov 06 11:56:00 devstack sudo[103311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:00 devstack sudo[103311]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f9ffc73e-28fb-4565-9d02-2cbb72834128 tempest-VolumeDependencyTests-665248495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4db9d4fa-55de-4223-9451-5cd5a9cef032 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032.a1b61434-9bf6-47a5-bd4f-344b8eab6a69" returned: 0 in 0.394s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:00 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-f9ffc73e-28fb-4565-9d02-2cbb72834128 tempest-VolumeDependencyTests-665248495 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032.a1b61434-9bf6-47a5-bd4f-344b8eab6a69 is being set with open permissions: ugo+rw
Nov 06 11:56:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f9ffc73e-28fb-4565-9d02-2cbb72834128 tempest-VolumeDependencyTests-665248495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032.a1b61434-9bf6-47a5-bd4f-344b8eab6a69 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:00 devstack sudo[103317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032.a1b61434-9bf6-47a5-bd4f-344b8eab6a69
Nov 06 11:56:00 devstack sudo[103317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:00 devstack sudo[103317]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f9ffc73e-28fb-4565-9d02-2cbb72834128 tempest-VolumeDependencyTests-665248495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032.a1b61434-9bf6-47a5-bd4f-344b8eab6a69" returned: 0 in 0.267s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f9ffc73e-28fb-4565-9d02-2cbb72834128 tempest-VolumeDependencyTests-665248495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:00 devstack sudo[103320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032.info
Nov 06 11:56:00 devstack sudo[103320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:01 devstack sudo[103320]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f9ffc73e-28fb-4565-9d02-2cbb72834128 tempest-VolumeDependencyTests-665248495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032.info" returned: 0 in 0.275s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:01 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-f9ffc73e-28fb-4565-9d02-2cbb72834128 tempest-VolumeDependencyTests-665248495 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032.info is being set with open permissions: ugo+rw
Nov 06 11:56:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f9ffc73e-28fb-4565-9d02-2cbb72834128 tempest-VolumeDependencyTests-665248495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:01 devstack sudo[103323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032.info
Nov 06 11:56:01 devstack sudo[103323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-fc9945dd-fb2c-4063-a3eb-ee8feca7dad5 tempest-TestImageHashVerification-1197010532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:56:01 devstack sudo[103323]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f9ffc73e-28fb-4565-9d02-2cbb72834128 tempest-VolumeDependencyTests-665248495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032.info" returned: 0 in 0.337s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f9ffc73e-28fb-4565-9d02-2cbb72834128 tempest-VolumeDependencyTests-665248495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.537s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:56:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-fc9945dd-fb2c-4063-a3eb-ee8feca7dad5 tempest-TestImageHashVerification-1197010532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.069s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:56:01 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf4983f-eadb-48f5-93a8-11e220dc7847]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:56:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-fc9945dd-fb2c-4063-a3eb-ee8feca7dad5 tempest-TestImageHashVerification-1197010532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4e783686-4a33-4281-ad36-218b0d1cd830 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:01 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-f9ffc73e-28fb-4565-9d02-2cbb72834128 tempest-VolumeDependencyTests-665248495 None] Create snapshot completed successfully
Nov 06 11:56:01 devstack sudo[103326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4e783686-4a33-4281-ad36-218b0d1cd830
Nov 06 11:56:01 devstack sudo[103326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:01 devstack sudo[103326]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-fc9945dd-fb2c-4063-a3eb-ee8feca7dad5 tempest-TestImageHashVerification-1197010532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4e783686-4a33-4281-ad36-218b0d1cd830" returned: 0 in 0.446s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:01 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97c6b0f-e456-4bb7-b08d-edfc9355df6f]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:56:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-fc9945dd-fb2c-4063-a3eb-ee8feca7dad5 tempest-TestImageHashVerification-1197010532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4e783686-4a33-4281-ad36-218b0d1cd830 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:02 devstack sudo[103331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4e783686-4a33-4281-ad36-218b0d1cd830
Nov 06 11:56:02 devstack sudo[103331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:02 devstack sudo[103331]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-fc9945dd-fb2c-4063-a3eb-ee8feca7dad5 tempest-TestImageHashVerification-1197010532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4e783686-4a33-4281-ad36-218b0d1cd830" returned: 0 in 0.459s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-fc9945dd-fb2c-4063-a3eb-ee8feca7dad5 tempest-TestImageHashVerification-1197010532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4e783686-4a33-4281-ad36-218b0d1cd830 /opt/stack/data/cinder/conversion/4e783686-4a33-4281-ad36-218b0d1cd830.temp_image.0a742b6d-bcdf-4e51-a48b-23b610e2b7ffir8ung8t.img {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:02 devstack sudo[103336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4e783686-4a33-4281-ad36-218b0d1cd830 /opt/stack/data/cinder/conversion/4e783686-4a33-4281-ad36-218b0d1cd830.temp_image.0a742b6d-bcdf-4e51-a48b-23b610e2b7ffir8ung8t.img
Nov 06 11:56:02 devstack sudo[103336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:03 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:56:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] Flow 'volume_create_manager' (09c66621-9923-4adc-9434-af7af2a2ee83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:56:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0e666a5-126f-498c-b223-1214eaf7c269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0e666a5-126f-498c-b223-1214eaf7c269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:56:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-226956783',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85894f2e-26b8-4e32-97ff-c36167385581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='871f30b1bdd3476396e9f33772e13d1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a1b61434-9bf6-47a5-bd4f-344b8eab6a69,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:03Z,use_quota=True,user_id='a612380c298c4578849edf306c0b2e9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b470c5a-9982-41a2-82d6-149d27f278b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b470c5a-9982-41a2-82d6-149d27f278b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93a0b213-c624-41e0-8c34-a9aab252c1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93a0b213-c624-41e0-8c34-a9aab252c1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '85894f2e-26b8-4e32-97ff-c36167385581', 'volume_name': 'volume-85894f2e-26b8-4e32-97ff-c36167385581', 'volume_size': 1, 'snapshot_id': 'a1b61434-9bf6-47a5-bd4f-344b8eab6a69'}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2e7ce22-3df7-49d8-84bb-ab8a5068ff4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2e7ce22-3df7-49d8-84bb-ab8a5068ff4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df68c9fa-18a3-43e5-a4e5-ddc2b6c967de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:03 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] Volume 85894f2e-26b8-4e32-97ff-c36167385581: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-85894f2e-26b8-4e32-97ff-c36167385581', 'volume_size': 1, 'snapshot_id': 'a1b61434-9bf6-47a5-bd4f-344b8eab6a69'}
Nov 06 11:56:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:56:04 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-698390bc-8797-4794-953a-7f7bb52eee60 tempest-CreateVolumesFromImageTest-871768967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:56:04 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-698390bc-8797-4794-953a-7f7bb52eee60 tempest-CreateVolumesFromImageTest-871768967 None] Flow 'volume_create_manager' (76ca3d5e-0298-4fdf-ae36-e87069cba6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:56:04 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-698390bc-8797-4794-953a-7f7bb52eee60 tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eae473dc-9d7f-4f24-9e76-85863e81cc4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:04 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-698390bc-8797-4794-953a-7f7bb52eee60 tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eae473dc-9d7f-4f24-9e76-85863e81cc4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:56:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2081876147',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eea6afb-1cc7-4fb4-959d-8ee452313992,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='211b6c18a6894184bfc7b066b989e6aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:04Z,use_quota=True,user_id='1ae8dded83574c80ae67dca54ef88681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:04 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-698390bc-8797-4794-953a-7f7bb52eee60 tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (699b6b89-c4e2-4fa9-8c77-4942517e77fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:04 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-698390bc-8797-4794-953a-7f7bb52eee60 tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (699b6b89-c4e2-4fa9-8c77-4942517e77fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:04 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-698390bc-8797-4794-953a-7f7bb52eee60 tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee0267f6-b334-4f7f-bf5f-317f4732a966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:04 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-698390bc-8797-4794-953a-7f7bb52eee60 tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee0267f6-b334-4f7f-bf5f-317f4732a966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6eea6afb-1cc7-4fb4-959d-8ee452313992', 'volume_name': 'volume-6eea6afb-1cc7-4fb4-959d-8ee452313992', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:04 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-698390bc-8797-4794-953a-7f7bb52eee60 tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7a80dcc-87e4-4209-b5a7-fec57fca64fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:04 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-698390bc-8797-4794-953a-7f7bb52eee60 tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7a80dcc-87e4-4209-b5a7-fec57fca64fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:04 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-698390bc-8797-4794-953a-7f7bb52eee60 tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c198c2ef-c213-408e-849e-469ae2f5c976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:04 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-698390bc-8797-4794-953a-7f7bb52eee60 tempest-CreateVolumesFromImageTest-871768967 None] Volume 6eea6afb-1cc7-4fb4-959d-8ee452313992: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6eea6afb-1cc7-4fb4-959d-8ee452313992', 'volume_size': 1}
Nov 06 11:56:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-698390bc-8797-4794-953a-7f7bb52eee60 tempest-CreateVolumesFromImageTest-871768967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:56:04 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f737b54-82ea-46a0-bba5-30357349c149 tempest-CreateVolumesFromImageTest-871768967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:56:04 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-1f737b54-82ea-46a0-bba5-30357349c149 tempest-CreateVolumesFromImageTest-871768967 None] Flow 'volume_create_manager' (d35f8f3e-ae9c-47e9-a1cc-0f4c0879b2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:56:04 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-1f737b54-82ea-46a0-bba5-30357349c149 tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edad0975-802c-43ee-a0c5-612b053ad006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:04 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-1f737b54-82ea-46a0-bba5-30357349c149 tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edad0975-802c-43ee-a0c5-612b053ad006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:56:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-22171252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc65f4f9-674f-45d7-b10a-38b2c69cb056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='211b6c18a6894184bfc7b066b989e6aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:05Z,use_quota=True,user_id='1ae8dded83574c80ae67dca54ef88681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:04 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-1f737b54-82ea-46a0-bba5-30357349c149 tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70197bac-db62-4db8-b395-176f1a02f972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:04 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-1f737b54-82ea-46a0-bba5-30357349c149 tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70197bac-db62-4db8-b395-176f1a02f972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:05 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-1f737b54-82ea-46a0-bba5-30357349c149 tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77edc5b8-47ce-43fa-bc1c-309fb2198103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:05 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-1f737b54-82ea-46a0-bba5-30357349c149 tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77edc5b8-47ce-43fa-bc1c-309fb2198103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc65f4f9-674f-45d7-b10a-38b2c69cb056', 'volume_name': 'volume-cc65f4f9-674f-45d7-b10a-38b2c69cb056', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:05 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-1f737b54-82ea-46a0-bba5-30357349c149 tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d86a2e1d-3b74-4cd5-a681-aec8bae513ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:05 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-1f737b54-82ea-46a0-bba5-30357349c149 tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d86a2e1d-3b74-4cd5-a681-aec8bae513ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:05 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-1f737b54-82ea-46a0-bba5-30357349c149 tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (376dcd17-85d8-40b3-b3a7-e816630ec10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:05 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-1f737b54-82ea-46a0-bba5-30357349c149 tempest-CreateVolumesFromImageTest-871768967 None] Volume cc65f4f9-674f-45d7-b10a-38b2c69cb056: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc65f4f9-674f-45d7-b10a-38b2c69cb056', 'volume_size': 1}
Nov 06 11:56:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-1f737b54-82ea-46a0-bba5-30357349c149 tempest-CreateVolumesFromImageTest-871768967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:56:05 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-5acbec45-f036-4961-8373-36436b5fff21 tempest-CreateVolumesFromImageTest-871768967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:56:05 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5acbec45-f036-4961-8373-36436b5fff21 tempest-CreateVolumesFromImageTest-871768967 None] Flow 'volume_create_manager' (da6e2eec-1a36-4d1a-8fc5-91c3882c7eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:56:05 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5acbec45-f036-4961-8373-36436b5fff21 tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c6949e7-f34b-47f6-905a-b4f5afea5f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:05 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5acbec45-f036-4961-8373-36436b5fff21 tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c6949e7-f34b-47f6-905a-b4f5afea5f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-769731345',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b2d8407-7e14-416d-9fca-73d9df04de80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='211b6c18a6894184bfc7b066b989e6aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:05Z,use_quota=True,user_id='1ae8dded83574c80ae67dca54ef88681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:05 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5acbec45-f036-4961-8373-36436b5fff21 tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d4d538a-069d-4633-90d8-654f91b81204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:05 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5acbec45-f036-4961-8373-36436b5fff21 tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d4d538a-069d-4633-90d8-654f91b81204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:05 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5acbec45-f036-4961-8373-36436b5fff21 tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6721cff6-8174-4d87-bfbb-f1336ce97ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:05 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5acbec45-f036-4961-8373-36436b5fff21 tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6721cff6-8174-4d87-bfbb-f1336ce97ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b2d8407-7e14-416d-9fca-73d9df04de80', 'volume_name': 'volume-8b2d8407-7e14-416d-9fca-73d9df04de80', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:05 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5acbec45-f036-4961-8373-36436b5fff21 tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0033803f-4ae4-4ca7-8468-586f69b4bce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:05 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5acbec45-f036-4961-8373-36436b5fff21 tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0033803f-4ae4-4ca7-8468-586f69b4bce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:05 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5acbec45-f036-4961-8373-36436b5fff21 tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00aad173-6e7b-4835-b19e-bc88e3cfdff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:05 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-5acbec45-f036-4961-8373-36436b5fff21 tempest-CreateVolumesFromImageTest-871768967 None] Volume 8b2d8407-7e14-416d-9fca-73d9df04de80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b2d8407-7e14-416d-9fca-73d9df04de80', 'volume_size': 1}
Nov 06 11:56:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5acbec45-f036-4961-8373-36436b5fff21 tempest-CreateVolumesFromImageTest-871768967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:56:06 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6de79ac-29c1-4c41-9ddd-649ce4491c1e tempest-CreateVolumesFromImageTest-871768967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:56:06 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c6de79ac-29c1-4c41-9ddd-649ce4491c1e tempest-CreateVolumesFromImageTest-871768967 None] Flow 'volume_create_manager' (af1043cd-923a-4330-8398-0ae8e522a33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:56:06 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c6de79ac-29c1-4c41-9ddd-649ce4491c1e tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2779fe3f-7b48-4e62-afec-dd1338c520f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:06 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c6de79ac-29c1-4c41-9ddd-649ce4491c1e tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2779fe3f-7b48-4e62-afec-dd1338c520f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-603370081',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a939ccf0-3477-47e1-87c8-803a078167b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='211b6c18a6894184bfc7b066b989e6aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:06Z,use_quota=True,user_id='1ae8dded83574c80ae67dca54ef88681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:06 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c6de79ac-29c1-4c41-9ddd-649ce4491c1e tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d0c08c5-38e6-4936-8545-28c152f31518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:06 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c6de79ac-29c1-4c41-9ddd-649ce4491c1e tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d0c08c5-38e6-4936-8545-28c152f31518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:06 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c6de79ac-29c1-4c41-9ddd-649ce4491c1e tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b68fbf6c-ed98-40b2-bbca-f15e2eb7bcdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:06 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c6de79ac-29c1-4c41-9ddd-649ce4491c1e tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b68fbf6c-ed98-40b2-bbca-f15e2eb7bcdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a939ccf0-3477-47e1-87c8-803a078167b3', 'volume_name': 'volume-a939ccf0-3477-47e1-87c8-803a078167b3', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:06 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c6de79ac-29c1-4c41-9ddd-649ce4491c1e tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02596c20-0930-45d6-bb52-e14bc8d6d8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:06 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c6de79ac-29c1-4c41-9ddd-649ce4491c1e tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02596c20-0930-45d6-bb52-e14bc8d6d8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:06 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c6de79ac-29c1-4c41-9ddd-649ce4491c1e tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d10a3399-a2e2-48ee-a3cd-818c401eae3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:06 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-c6de79ac-29c1-4c41-9ddd-649ce4491c1e tempest-CreateVolumesFromImageTest-871768967 None] Volume a939ccf0-3477-47e1-87c8-803a078167b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a939ccf0-3477-47e1-87c8-803a078167b3', 'volume_size': 1}
Nov 06 11:56:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c6de79ac-29c1-4c41-9ddd-649ce4491c1e tempest-CreateVolumesFromImageTest-871768967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:56:06 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-aeb30fe5-b3c6-41c0-ba9f-89bb1bc6e004 tempest-CreateVolumesFromImageTest-871768967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:56:06 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-aeb30fe5-b3c6-41c0-ba9f-89bb1bc6e004 tempest-CreateVolumesFromImageTest-871768967 None] Flow 'volume_create_manager' (8dd12106-7249-4442-b387-0125ddec4325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:56:06 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-aeb30fe5-b3c6-41c0-ba9f-89bb1bc6e004 tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf6c1f1b-4394-47fd-8c35-a81251bd2c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:06 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-aeb30fe5-b3c6-41c0-ba9f-89bb1bc6e004 tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf6c1f1b-4394-47fd-8c35-a81251bd2c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:56:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2070870634',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58792b48-8c21-445a-8fb9-1319de8e0c1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='211b6c18a6894184bfc7b066b989e6aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:07Z,use_quota=True,user_id='1ae8dded83574c80ae67dca54ef88681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:06 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-aeb30fe5-b3c6-41c0-ba9f-89bb1bc6e004 tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76d8ab12-0a71-42a0-97ff-77822ba4b070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:06 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-aeb30fe5-b3c6-41c0-ba9f-89bb1bc6e004 tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76d8ab12-0a71-42a0-97ff-77822ba4b070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:06 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-aeb30fe5-b3c6-41c0-ba9f-89bb1bc6e004 tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99425631-a2bb-43ae-96a2-0fde16c33d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:06 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-aeb30fe5-b3c6-41c0-ba9f-89bb1bc6e004 tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99425631-a2bb-43ae-96a2-0fde16c33d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58792b48-8c21-445a-8fb9-1319de8e0c1e', 'volume_name': 'volume-58792b48-8c21-445a-8fb9-1319de8e0c1e', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:06 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-aeb30fe5-b3c6-41c0-ba9f-89bb1bc6e004 tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72cf9755-1adc-48da-9e5c-0af627d83158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:06 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-aeb30fe5-b3c6-41c0-ba9f-89bb1bc6e004 tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72cf9755-1adc-48da-9e5c-0af627d83158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:06 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-aeb30fe5-b3c6-41c0-ba9f-89bb1bc6e004 tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (918d2260-920f-4520-9d0b-0b5f08737d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:06 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-aeb30fe5-b3c6-41c0-ba9f-89bb1bc6e004 tempest-CreateVolumesFromImageTest-871768967 None] Volume 58792b48-8c21-445a-8fb9-1319de8e0c1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58792b48-8c21-445a-8fb9-1319de8e0c1e', 'volume_size': 1}
Nov 06 11:56:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-aeb30fe5-b3c6-41c0-ba9f-89bb1bc6e004 tempest-CreateVolumesFromImageTest-871768967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:56:10 devstack sudo[103336]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-fc9945dd-fb2c-4063-a3eb-ee8feca7dad5 tempest-TestImageHashVerification-1197010532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4e783686-4a33-4281-ad36-218b0d1cd830 /opt/stack/data/cinder/conversion/4e783686-4a33-4281-ad36-218b0d1cd830.temp_image.0a742b6d-bcdf-4e51-a48b-23b610e2b7ffir8ung8t.img" returned: 0 in 8.018s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:10 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4a31245-976a-46ca-9c39-4bd779a87d66 tempest-VolumeTypesAccessTest-1076938397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:56:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b4a31245-976a-46ca-9c39-4bd779a87d66 tempest-VolumeTypesAccessTest-1076938397 None] Flow 'volume_create_manager' (bf25f1ac-27f8-409d-b43c-ef9408566905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:56:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b4a31245-976a-46ca-9c39-4bd779a87d66 tempest-VolumeTypesAccessTest-1076938397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ff82fa8-925b-4a7d-ac5e-4f54edaeae35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:10 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d94bee7-080c-4514-9da5-88013453ed09]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:56:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-fc9945dd-fb2c-4063-a3eb-ee8feca7dad5 tempest-TestImageHashVerification-1197010532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4e783686-4a33-4281-ad36-218b0d1cd830 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b4a31245-976a-46ca-9c39-4bd779a87d66 tempest-VolumeTypesAccessTest-1076938397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ff82fa8-925b-4a7d-ac5e-4f54edaeae35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-256106233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=724a08a3-fa91-416b-8eba-49563e9b713c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19044d9a88f44b8d91097969c55b3ae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:10Z,use_quota=True,user_id='f364d7f2daae497c94c023582ed78ee2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(434781cd-530e-4577-afe6-23f756771d69),volume_type_id=434781cd-530e-4577-afe6-23f756771d69)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b4a31245-976a-46ca-9c39-4bd779a87d66 tempest-VolumeTypesAccessTest-1076938397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39b59d52-b140-48b6-ad1c-5b760ed70231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b4a31245-976a-46ca-9c39-4bd779a87d66 tempest-VolumeTypesAccessTest-1076938397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39b59d52-b140-48b6-ad1c-5b760ed70231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b4a31245-976a-46ca-9c39-4bd779a87d66 tempest-VolumeTypesAccessTest-1076938397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f91d7144-d27b-4e10-8764-8d1dd176bf69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b4a31245-976a-46ca-9c39-4bd779a87d66 tempest-VolumeTypesAccessTest-1076938397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f91d7144-d27b-4e10-8764-8d1dd176bf69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '724a08a3-fa91-416b-8eba-49563e9b713c', 'volume_name': 'volume-724a08a3-fa91-416b-8eba-49563e9b713c', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b4a31245-976a-46ca-9c39-4bd779a87d66 tempest-VolumeTypesAccessTest-1076938397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ba07ddd-a316-43a2-9745-6fcfa5ff32e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b4a31245-976a-46ca-9c39-4bd779a87d66 tempest-VolumeTypesAccessTest-1076938397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ba07ddd-a316-43a2-9745-6fcfa5ff32e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b4a31245-976a-46ca-9c39-4bd779a87d66 tempest-VolumeTypesAccessTest-1076938397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fcfe1ab-a5ae-4e09-8941-d8f47ecec25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:10 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-b4a31245-976a-46ca-9c39-4bd779a87d66 tempest-VolumeTypesAccessTest-1076938397 None] Volume 724a08a3-fa91-416b-8eba-49563e9b713c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-724a08a3-fa91-416b-8eba-49563e9b713c', 'volume_size': 1}
Nov 06 11:56:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b4a31245-976a-46ca-9c39-4bd779a87d66 tempest-VolumeTypesAccessTest-1076938397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:56:10 devstack sudo[103393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4e783686-4a33-4281-ad36-218b0d1cd830
Nov 06 11:56:10 devstack sudo[103393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:10 devstack sudo[103393]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-fc9945dd-fb2c-4063-a3eb-ee8feca7dad5 tempest-TestImageHashVerification-1197010532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4e783686-4a33-4281-ad36-218b0d1cd830" returned: 0 in 0.504s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:10 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-fc9945dd-fb2c-4063-a3eb-ee8feca7dad5 tempest-TestImageHashVerification-1197010532 None] Image conversion details: src /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4e783686-4a33-4281-ad36-218b0d1cd830, size 1024.00 MB, duration 8.02 sec, destination /opt/stack/data/cinder/conversion/4e783686-4a33-4281-ad36-218b0d1cd830.temp_image.0a742b6d-bcdf-4e51-a48b-23b610e2b7ffir8ung8t.img {{(pid=87165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 11:56:10 devstack cinder-volume[87165]: INFO cinder.image.image_utils [None req-fc9945dd-fb2c-4063-a3eb-ee8feca7dad5 tempest-TestImageHashVerification-1197010532 None] Converted 1024.00 MB image at 127.67 MB/s
Nov 06 11:56:10 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-fc9945dd-fb2c-4063-a3eb-ee8feca7dad5 tempest-TestImageHashVerification-1197010532 None] 0a742b6d-bcdf-4e51-a48b-23b610e2b7ff was raw, no need to convert to raw {{(pid=87165) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Nov 06 11:56:17 devstack cinder-volume[87165]: DEBUG oslo_service.periodic_task [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 11:56:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:56:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:56:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:56:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:56:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:56:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:17 devstack sudo[103399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:56:17 devstack sudo[103399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:17 devstack sudo[103399]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.272s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:17 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:56:17 devstack cinder-volume[87165]: DEBUG oslo_service.periodic_task [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running periodic task VolumeManager._thread_info {{(pid=87165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 11:56:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] thread count: 29 {{(pid=87165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 11:56:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] thread info: [<_MainThread(MainThread, started 127732956901504)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127732842693056)>, <Thread(Thread-3 (stat_writer), started daemon 127732841891136)>, <Thread(Rabbit-heartbeat, started daemon 127732842515648)>, <Thread(Thread-5 (_runner), started daemon 127732840534464)>, <Thread(Thread-7 (_runner), started daemon 127732840636032)>, <Thread(fd_logger, started daemon 127732838664256)>, <Thread(privsep_reader, started daemon 127732838673408)>, <Thread(tpool_thread_0, started daemon 127732829828800)>, <Thread(tpool_thread_1, started daemon 127732821436096)>, <Thread(tpool_thread_2, started daemon 127732813043392)>, <Thread(tpool_thread_3, started daemon 127732804650688)>, <Thread(tpool_thread_4, started daemon 127732796257984)>, <Thread(tpool_thread_5, started daemon 127732787865280)>, <Thread(tpool_thread_6, started daemon 127732779456192)>, <Thread(tpool_thread_7, started daemon 127732771047104)>, <Thread(tpool_thread_8, started daemon 127732762638016)>, <Thread(tpool_thread_9, started daemon 127732754228928)>, <Thread(tpool_thread_10, started daemon 127732745819840)>, <Thread(tpool_thread_11, started daemon 127732737410752)>, <Thread(tpool_thread_12, started daemon 127732729001664)>, <Thread(tpool_thread_13, started daemon 127732720592576)>, <Thread(tpool_thread_14, started daemon 127732712183488)>, <Thread(tpool_thread_15, started daemon 127732703774400)>, <Thread(tpool_thread_16, started daemon 127732695365312)>, <Thread(tpool_thread_17, started daemon 127732686956224)>, <Thread(tpool_thread_18, started daemon 127732678547136)>, <Thread(tpool_thread_19, started daemon 127732670138048)>, <Thread(Rabbit-heartbeat, started daemon 127732832631296)>] {{(pid=87165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 11:56:20 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:SELECT=54,cinder:UPDATE=50,cinder:DELETE=5,cinder:INSERT=9 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 11:56:20 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:UPDATE=59,cinder:INSERT=16,cinder:SELECT=38,cinder:DELETE=4 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 11:56:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-fc9945dd-fb2c-4063-a3eb-ee8feca7dad5 tempest-TestImageHashVerification-1197010532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.226s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:56:28 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-fc9945dd-fb2c-4063-a3eb-ee8feca7dad5 tempest-TestImageHashVerification-1197010532 None] Uploaded volume to glance image-id: 0a742b6d-bcdf-4e51-a48b-23b610e2b7ff. {{(pid=87165) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 06 11:56:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 25.243s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:56:28 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] Acquiring lock "cinder-quobyte-a1b61434-9bf6-47a5-bd4f-344b8eab6a69-85894f2e-26b8-4e32-97ff-c36167385581" by "_create_volume_from_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:56:28 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-fc9945dd-fb2c-4063-a3eb-ee8feca7dad5 tempest-TestImageHashVerification-1197010532 None] Copy volume to image completed successfully.
Nov 06 11:56:28 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] Lock "cinder-quobyte-a1b61434-9bf6-47a5-bd4f-344b8eab6a69-85894f2e-26b8-4e32-97ff-c36167385581" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:56:28 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] Creating volume 85894f2e-26b8-4e32-97ff-c36167385581 from snapshot a1b61434-9bf6-47a5-bd4f-344b8eab6a69 {{(pid=87165) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 06 11:56:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:56:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:56:28 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:56:28 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:56:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:56:28 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:56:28 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] Acquiring lock "cinder-quobyte-85894f2e-26b8-4e32-97ff-c36167385581" by "_copy_volume_from_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:56:28 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] Lock "cinder-quobyte-85894f2e-26b8-4e32-97ff-c36167385581" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:56:28 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] snapshot: a1b61434-9bf6-47a5-bd4f-344b8eab6a69, volume: 85894f2e-26b8-4e32-97ff-c36167385581,  {{(pid=87165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 06 11:56:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:56:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:56:28 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:56:28 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:56:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:56:28 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7a7bc8-1fc3-410a-936c-7f9c37066039]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:56:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032.a1b61434-9bf6-47a5-bd4f-344b8eab6a69 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:28 devstack sudo[103404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032.a1b61434-9bf6-47a5-bd4f-344b8eab6a69
Nov 06 11:56:28 devstack sudo[103404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:29 devstack sudo[103404]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032.a1b61434-9bf6-47a5-bd4f-344b8eab6a69" returned: 0 in 0.385s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:29 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4db9d4fa-55de-4223-9451-5cd5a9cef032(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:56:29 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[043b4b0b-8de1-4e0e-b9e2-383d5f4edd86]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:56:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:29 devstack sudo[103409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032
Nov 06 11:56:29 devstack sudo[103409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:29 devstack sudo[103409]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032" returned: 0 in 0.385s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:29 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032 {{(pid=87165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 06 11:56:29 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] Creating direct copy from snapshot {{(pid=87165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 06 11:56:29 devstack cinder-volume[87165]: DEBUG cinder.utils [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] Path /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-85894f2e-26b8-4e32-97ff-c36167385581 not found in is_blk_device check {{(pid=87165) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 06 11:56:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-85894f2e-26b8-4e32-97ff-c36167385581 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:29 devstack sudo[103414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-85894f2e-26b8-4e32-97ff-c36167385581
Nov 06 11:56:29 devstack sudo[103414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:29 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-13d0206b-e1e0-4765-8816-487fe1fdcb48 tempest-TestImageHashVerification-1197010532 None] Acquiring lock "cinder-4e783686-4a33-4281-ad36-218b0d1cd830-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:56:30 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-13d0206b-e1e0-4765-8816-487fe1fdcb48 tempest-TestImageHashVerification-1197010532 None] Lock "cinder-4e783686-4a33-4281-ad36-218b0d1cd830-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:56:30 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-13d0206b-e1e0-4765-8816-487fe1fdcb48 tempest-TestImageHashVerification-1197010532 None] Acquiring lock "cinder-quobyte-4e783686-4a33-4281-ad36-218b0d1cd830" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:56:30 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-13d0206b-e1e0-4765-8816-487fe1fdcb48 tempest-TestImageHashVerification-1197010532 None] Lock "cinder-quobyte-4e783686-4a33-4281-ad36-218b0d1cd830" acquired by "delete_volume" :: waited 0.027s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:56:30 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0dd8ef-744c-4584-8e2c-d54b727aaa7d]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:56:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-13d0206b-e1e0-4765-8816-487fe1fdcb48 tempest-TestImageHashVerification-1197010532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4e783686-4a33-4281-ad36-218b0d1cd830 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:30 devstack sudo[103426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4e783686-4a33-4281-ad36-218b0d1cd830
Nov 06 11:56:30 devstack sudo[103426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:30 devstack sudo[103426]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-13d0206b-e1e0-4765-8816-487fe1fdcb48 tempest-TestImageHashVerification-1197010532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4e783686-4a33-4281-ad36-218b0d1cd830" returned: 0 in 0.679s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-13d0206b-e1e0-4765-8816-487fe1fdcb48 tempest-TestImageHashVerification-1197010532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4e783686-4a33-4281-ad36-218b0d1cd830 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:30 devstack sudo[103431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4e783686-4a33-4281-ad36-218b0d1cd830
Nov 06 11:56:30 devstack sudo[103431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:31 devstack sudo[103431]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-13d0206b-e1e0-4765-8816-487fe1fdcb48 tempest-TestImageHashVerification-1197010532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4e783686-4a33-4281-ad36-218b0d1cd830" returned: 0 in 0.459s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:31 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-13d0206b-e1e0-4765-8816-487fe1fdcb48 tempest-TestImageHashVerification-1197010532 None] Lock "cinder-quobyte-4e783686-4a33-4281-ad36-218b0d1cd830" released by "delete_volume" :: held 1.199s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:56:31 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-13d0206b-e1e0-4765-8816-487fe1fdcb48 tempest-TestImageHashVerification-1197010532 None] Created reservations ['fbd4927b-0956-45c2-94ec-8d654050f4c8', 'e57b1fd4-748a-4fde-a57d-42aba49e6726', '2cc650a2-6780-4342-bded-2fe9d244867c', 'e9661665-747a-4b61-9a3f-0b8023e3ab8d'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:56:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-13d0206b-e1e0-4765-8816-487fe1fdcb48 tempest-TestImageHashVerification-1197010532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:56:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-13d0206b-e1e0-4765-8816-487fe1fdcb48 tempest-TestImageHashVerification-1197010532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:56:31 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-13d0206b-e1e0-4765-8816-487fe1fdcb48 tempest-TestImageHashVerification-1197010532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:56:31 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-13d0206b-e1e0-4765-8816-487fe1fdcb48 tempest-TestImageHashVerification-1197010532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:56:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-13d0206b-e1e0-4765-8816-487fe1fdcb48 tempest-TestImageHashVerification-1197010532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:56:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-13d0206b-e1e0-4765-8816-487fe1fdcb48 tempest-TestImageHashVerification-1197010532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:31 devstack sudo[103435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:56:31 devstack sudo[103435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:32 devstack sudo[103435]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-13d0206b-e1e0-4765-8816-487fe1fdcb48 tempest-TestImageHashVerification-1197010532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.605s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:32 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-13d0206b-e1e0-4765-8816-487fe1fdcb48 tempest-TestImageHashVerification-1197010532 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:56:32 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-13d0206b-e1e0-4765-8816-487fe1fdcb48 tempest-TestImageHashVerification-1197010532 None] Deleted volume successfully.
Nov 06 11:56:32 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-13d0206b-e1e0-4765-8816-487fe1fdcb48 tempest-TestImageHashVerification-1197010532 None] Lock "cinder-4e783686-4a33-4281-ad36-218b0d1cd830-delete_volume" released by "delete_volume" :: held 2.163s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:56:36 devstack sudo[103414]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-85894f2e-26b8-4e32-97ff-c36167385581" returned: 0 in 7.299s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:36 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] Image conversion details: src /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032, size 1024.00 MB, duration 7.30 sec, destination /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-85894f2e-26b8-4e32-97ff-c36167385581 {{(pid=87165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 11:56:36 devstack cinder-volume[87165]: INFO cinder.image.image_utils [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] Converted 1024.00 MB image at 140.28 MB/s
Nov 06 11:56:36 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-85894f2e-26b8-4e32-97ff-c36167385581 is being set with open permissions: ugo+rw
Nov 06 11:56:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-85894f2e-26b8-4e32-97ff-c36167385581 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:36 devstack sudo[103441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-85894f2e-26b8-4e32-97ff-c36167385581
Nov 06 11:56:36 devstack sudo[103441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:37 devstack sudo[103441]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-85894f2e-26b8-4e32-97ff-c36167385581" returned: 0 in 0.257s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:37 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] Lock "cinder-quobyte-85894f2e-26b8-4e32-97ff-c36167385581" released by "_copy_volume_from_snapshot" :: held 8.409s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:56:37 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] Lock "cinder-quobyte-a1b61434-9bf6-47a5-bd4f-344b8eab6a69-85894f2e-26b8-4e32-97ff-c36167385581" released by "_create_volume_from_snapshot" :: held 8.469s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:56:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.496s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:56:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-698390bc-8797-4794-953a-7f7bb52eee60 tempest-CreateVolumesFromImageTest-871768967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 32.766s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:56:37 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-698390bc-8797-4794-953a-7f7bb52eee60 tempest-CreateVolumesFromImageTest-871768967 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:56:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2081876147',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eea6afb-1cc7-4fb4-959d-8ee452313992,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='211b6c18a6894184bfc7b066b989e6aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:04Z,use_quota=True,user_id='1ae8dded83574c80ae67dca54ef88681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:56:37 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-698390bc-8797-4794-953a-7f7bb52eee60 tempest-CreateVolumesFromImageTest-871768967 None] Creating volume 6eea6afb-1cc7-4fb4-959d-8ee452313992 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:56:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-698390bc-8797-4794-953a-7f7bb52eee60 tempest-CreateVolumesFromImageTest-871768967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:56:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-698390bc-8797-4794-953a-7f7bb52eee60 tempest-CreateVolumesFromImageTest-871768967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:56:37 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-698390bc-8797-4794-953a-7f7bb52eee60 tempest-CreateVolumesFromImageTest-871768967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:56:37 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-698390bc-8797-4794-953a-7f7bb52eee60 tempest-CreateVolumesFromImageTest-871768967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:56:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-698390bc-8797-4794-953a-7f7bb52eee60 tempest-CreateVolumesFromImageTest-871768967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:56:37 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-698390bc-8797-4794-953a-7f7bb52eee60 tempest-CreateVolumesFromImageTest-871768967 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:56:37 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-698390bc-8797-4794-953a-7f7bb52eee60 tempest-CreateVolumesFromImageTest-871768967 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:56:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-698390bc-8797-4794-953a-7f7bb52eee60 tempest-CreateVolumesFromImageTest-871768967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6eea6afb-1cc7-4fb4-959d-8ee452313992 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:37 devstack sudo[103444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6eea6afb-1cc7-4fb4-959d-8ee452313992 1073741824
Nov 06 11:56:37 devstack sudo[103444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df68c9fa-18a3-43e5-a4e5-ddc2b6c967de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85894f2e-26b8-4e32-97ff-c36167385581', 'volume_size': 1, 'snapshot_id': 'a1b61434-9bf6-47a5-bd4f-344b8eab6a69'}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dc2dcf2-86cf-4ac4-9b2f-4a36e1c8d079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:37 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] Volume volume-85894f2e-26b8-4e32-97ff-c36167385581 (85894f2e-26b8-4e32-97ff-c36167385581): created successfully
Nov 06 11:56:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dc2dcf2-86cf-4ac4-9b2f-4a36e1c8d079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] Flow 'volume_create_manager' (09c66621-9923-4adc-9434-af7af2a2ee83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:56:37 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-5e8f6212-6dba-46f8-8762-043c4af20f59 tempest-VolumeDependencyTests-665248495 None] Created volume successfully.
Nov 06 11:56:37 devstack sudo[103444]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:37 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-6ee41d3a-1287-4bb5-ae75-38b651fd57ab tempest-VolumeDependencyTests-665248495 None] Acquiring lock "cinder-a1b61434-9bf6-47a5-bd4f-344b8eab6a69-delete_snapshot" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:56:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-698390bc-8797-4794-953a-7f7bb52eee60 tempest-CreateVolumesFromImageTest-871768967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6eea6afb-1cc7-4fb4-959d-8ee452313992 1073741824" returned: 0 in 0.422s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:37 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-6ee41d3a-1287-4bb5-ae75-38b651fd57ab tempest-VolumeDependencyTests-665248495 None] Lock "cinder-a1b61434-9bf6-47a5-bd4f-344b8eab6a69-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:56:37 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-6ee41d3a-1287-4bb5-ae75-38b651fd57ab tempest-VolumeDependencyTests-665248495 None] Acquiring lock "cinder-quobyte-4db9d4fa-55de-4223-9451-5cd5a9cef032" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:56:37 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-6ee41d3a-1287-4bb5-ae75-38b651fd57ab tempest-VolumeDependencyTests-665248495 None] Lock "cinder-quobyte-4db9d4fa-55de-4223-9451-5cd5a9cef032" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:56:37 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-6ee41d3a-1287-4bb5-ae75-38b651fd57ab tempest-VolumeDependencyTests-665248495 None] Acquiring lock "cinder-quobyte-a1b61434-9bf6-47a5-bd4f-344b8eab6a69" by "_delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:56:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-698390bc-8797-4794-953a-7f7bb52eee60 tempest-CreateVolumesFromImageTest-871768967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6eea6afb-1cc7-4fb4-959d-8ee452313992 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:37 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-6ee41d3a-1287-4bb5-ae75-38b651fd57ab tempest-VolumeDependencyTests-665248495 None] Lock "cinder-quobyte-a1b61434-9bf6-47a5-bd4f-344b8eab6a69" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:56:37 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-6ee41d3a-1287-4bb5-ae75-38b651fd57ab tempest-VolumeDependencyTests-665248495 None] Deleting offline snapshot a1b61434-9bf6-47a5-bd4f-344b8eab6a69 of volume 4db9d4fa-55de-4223-9451-5cd5a9cef032 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 11:56:37 devstack sudo[103450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6eea6afb-1cc7-4fb4-959d-8ee452313992
Nov 06 11:56:37 devstack sudo[103450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:37 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-6ee41d3a-1287-4bb5-ae75-38b651fd57ab tempest-VolumeDependencyTests-665248495 None] snapshot_file for this snap is: volume-4db9d4fa-55de-4223-9451-5cd5a9cef032.a1b61434-9bf6-47a5-bd4f-344b8eab6a69 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 11:56:37 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ace9aea-ab43-4af4-8137-5d79d835f2e7]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:56:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6ee41d3a-1287-4bb5-ae75-38b651fd57ab tempest-VolumeDependencyTests-665248495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032.a1b61434-9bf6-47a5-bd4f-344b8eab6a69 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:37 devstack sudo[103452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032.a1b61434-9bf6-47a5-bd4f-344b8eab6a69
Nov 06 11:56:37 devstack sudo[103452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:37 devstack sudo[103450]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-698390bc-8797-4794-953a-7f7bb52eee60 tempest-CreateVolumesFromImageTest-871768967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6eea6afb-1cc7-4fb4-959d-8ee452313992" returned: 0 in 0.324s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:37 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-698390bc-8797-4794-953a-7f7bb52eee60 tempest-CreateVolumesFromImageTest-871768967 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:56:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-698390bc-8797-4794-953a-7f7bb52eee60 tempest-CreateVolumesFromImageTest-871768967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:56:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-1f737b54-82ea-46a0-bba5-30357349c149 tempest-CreateVolumesFromImageTest-871768967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 32.865s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:56:37 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-1f737b54-82ea-46a0-bba5-30357349c149 tempest-CreateVolumesFromImageTest-871768967 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:56:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-22171252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc65f4f9-674f-45d7-b10a-38b2c69cb056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='211b6c18a6894184bfc7b066b989e6aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:05Z,use_quota=True,user_id='1ae8dded83574c80ae67dca54ef88681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:56:37 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-1f737b54-82ea-46a0-bba5-30357349c149 tempest-CreateVolumesFromImageTest-871768967 None] Creating volume cc65f4f9-674f-45d7-b10a-38b2c69cb056 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:56:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-1f737b54-82ea-46a0-bba5-30357349c149 tempest-CreateVolumesFromImageTest-871768967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:56:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-1f737b54-82ea-46a0-bba5-30357349c149 tempest-CreateVolumesFromImageTest-871768967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:56:37 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-1f737b54-82ea-46a0-bba5-30357349c149 tempest-CreateVolumesFromImageTest-871768967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:56:37 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-1f737b54-82ea-46a0-bba5-30357349c149 tempest-CreateVolumesFromImageTest-871768967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:56:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-1f737b54-82ea-46a0-bba5-30357349c149 tempest-CreateVolumesFromImageTest-871768967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:56:37 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-1f737b54-82ea-46a0-bba5-30357349c149 tempest-CreateVolumesFromImageTest-871768967 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:56:37 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-1f737b54-82ea-46a0-bba5-30357349c149 tempest-CreateVolumesFromImageTest-871768967 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:56:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1f737b54-82ea-46a0-bba5-30357349c149 tempest-CreateVolumesFromImageTest-871768967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-cc65f4f9-674f-45d7-b10a-38b2c69cb056 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-698390bc-8797-4794-953a-7f7bb52eee60 tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c198c2ef-c213-408e-849e-469ae2f5c976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6eea6afb-1cc7-4fb4-959d-8ee452313992', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-698390bc-8797-4794-953a-7f7bb52eee60 tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f744a3be-95e9-462d-a6c8-20395b2832d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:38 devstack sudo[103455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-cc65f4f9-674f-45d7-b10a-38b2c69cb056 1073741824
Nov 06 11:56:38 devstack sudo[103455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:38 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-698390bc-8797-4794-953a-7f7bb52eee60 tempest-CreateVolumesFromImageTest-871768967 None] Volume volume-6eea6afb-1cc7-4fb4-959d-8ee452313992 (6eea6afb-1cc7-4fb4-959d-8ee452313992): created successfully
Nov 06 11:56:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-698390bc-8797-4794-953a-7f7bb52eee60 tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f744a3be-95e9-462d-a6c8-20395b2832d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-698390bc-8797-4794-953a-7f7bb52eee60 tempest-CreateVolumesFromImageTest-871768967 None] Flow 'volume_create_manager' (76ca3d5e-0298-4fdf-ae36-e87069cba6d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:56:38 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-698390bc-8797-4794-953a-7f7bb52eee60 tempest-CreateVolumesFromImageTest-871768967 None] Created volume successfully.
Nov 06 11:56:38 devstack sudo[103452]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6ee41d3a-1287-4bb5-ae75-38b651fd57ab tempest-VolumeDependencyTests-665248495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032.a1b61434-9bf6-47a5-bd4f-344b8eab6a69" returned: 0 in 0.492s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:38 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-6ee41d3a-1287-4bb5-ae75-38b651fd57ab tempest-VolumeDependencyTests-665248495 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4db9d4fa-55de-4223-9451-5cd5a9cef032(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:56:38 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d284fb-e0c4-4244-a9bb-f73adc26267a]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:56:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6ee41d3a-1287-4bb5-ae75-38b651fd57ab tempest-VolumeDependencyTests-665248495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:38 devstack sudo[103461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032
Nov 06 11:56:38 devstack sudo[103461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:38 devstack sudo[103455]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1f737b54-82ea-46a0-bba5-30357349c149 tempest-CreateVolumesFromImageTest-871768967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-cc65f4f9-674f-45d7-b10a-38b2c69cb056 1073741824" returned: 0 in 0.556s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1f737b54-82ea-46a0-bba5-30357349c149 tempest-CreateVolumesFromImageTest-871768967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-cc65f4f9-674f-45d7-b10a-38b2c69cb056 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:38 devstack sudo[103468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-cc65f4f9-674f-45d7-b10a-38b2c69cb056
Nov 06 11:56:38 devstack sudo[103468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:38 devstack sudo[103468]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1f737b54-82ea-46a0-bba5-30357349c149 tempest-CreateVolumesFromImageTest-871768967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-cc65f4f9-674f-45d7-b10a-38b2c69cb056" returned: 0 in 0.303s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:38 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-1f737b54-82ea-46a0-bba5-30357349c149 tempest-CreateVolumesFromImageTest-871768967 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:56:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-1f737b54-82ea-46a0-bba5-30357349c149 tempest-CreateVolumesFromImageTest-871768967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:56:38 devstack sudo[103461]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5acbec45-f036-4961-8373-36436b5fff21 tempest-CreateVolumesFromImageTest-871768967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 33.189s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:56:38 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5acbec45-f036-4961-8373-36436b5fff21 tempest-CreateVolumesFromImageTest-871768967 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-769731345',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b2d8407-7e14-416d-9fca-73d9df04de80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='211b6c18a6894184bfc7b066b989e6aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:05Z,use_quota=True,user_id='1ae8dded83574c80ae67dca54ef88681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:56:38 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-5acbec45-f036-4961-8373-36436b5fff21 tempest-CreateVolumesFromImageTest-871768967 None] Creating volume 8b2d8407-7e14-416d-9fca-73d9df04de80 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:56:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5acbec45-f036-4961-8373-36436b5fff21 tempest-CreateVolumesFromImageTest-871768967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:56:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5acbec45-f036-4961-8373-36436b5fff21 tempest-CreateVolumesFromImageTest-871768967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:56:38 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5acbec45-f036-4961-8373-36436b5fff21 tempest-CreateVolumesFromImageTest-871768967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:56:38 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5acbec45-f036-4961-8373-36436b5fff21 tempest-CreateVolumesFromImageTest-871768967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:56:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5acbec45-f036-4961-8373-36436b5fff21 tempest-CreateVolumesFromImageTest-871768967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:56:38 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5acbec45-f036-4961-8373-36436b5fff21 tempest-CreateVolumesFromImageTest-871768967 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:56:38 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-5acbec45-f036-4961-8373-36436b5fff21 tempest-CreateVolumesFromImageTest-871768967 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:56:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5acbec45-f036-4961-8373-36436b5fff21 tempest-CreateVolumesFromImageTest-871768967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b2d8407-7e14-416d-9fca-73d9df04de80 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6ee41d3a-1287-4bb5-ae75-38b651fd57ab tempest-VolumeDependencyTests-665248495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032" returned: 0 in 0.689s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6ee41d3a-1287-4bb5-ae75-38b651fd57ab tempest-VolumeDependencyTests-665248495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032.a1b61434-9bf6-47a5-bd4f-344b8eab6a69 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:38 devstack sudo[103473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b2d8407-7e14-416d-9fca-73d9df04de80 1073741824
Nov 06 11:56:38 devstack sudo[103473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-1f737b54-82ea-46a0-bba5-30357349c149 tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (376dcd17-85d8-40b3-b3a7-e816630ec10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc65f4f9-674f-45d7-b10a-38b2c69cb056', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-1f737b54-82ea-46a0-bba5-30357349c149 tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33bb2f85-111a-4c3d-b876-440e4bb93cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:38 devstack sudo[103474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032.a1b61434-9bf6-47a5-bd4f-344b8eab6a69
Nov 06 11:56:38 devstack sudo[103474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:38 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-1f737b54-82ea-46a0-bba5-30357349c149 tempest-CreateVolumesFromImageTest-871768967 None] Volume volume-cc65f4f9-674f-45d7-b10a-38b2c69cb056 (cc65f4f9-674f-45d7-b10a-38b2c69cb056): created successfully
Nov 06 11:56:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-1f737b54-82ea-46a0-bba5-30357349c149 tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33bb2f85-111a-4c3d-b876-440e4bb93cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-1f737b54-82ea-46a0-bba5-30357349c149 tempest-CreateVolumesFromImageTest-871768967 None] Flow 'volume_create_manager' (d35f8f3e-ae9c-47e9-a1cc-0f4c0879b2af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:56:38 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-1f737b54-82ea-46a0-bba5-30357349c149 tempest-CreateVolumesFromImageTest-871768967 None] Created volume successfully.
Nov 06 11:56:39 devstack sudo[103474]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6ee41d3a-1287-4bb5-ae75-38b651fd57ab tempest-VolumeDependencyTests-665248495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032.a1b61434-9bf6-47a5-bd4f-344b8eab6a69" returned: 0 in 0.432s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6ee41d3a-1287-4bb5-ae75-38b651fd57ab tempest-VolumeDependencyTests-665248495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032.a1b61434-9bf6-47a5-bd4f-344b8eab6a69 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:39 devstack sudo[103485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032.a1b61434-9bf6-47a5-bd4f-344b8eab6a69
Nov 06 11:56:39 devstack sudo[103485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:39 devstack sudo[103473]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5acbec45-f036-4961-8373-36436b5fff21 tempest-CreateVolumesFromImageTest-871768967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b2d8407-7e14-416d-9fca-73d9df04de80 1073741824" returned: 0 in 0.494s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5acbec45-f036-4961-8373-36436b5fff21 tempest-CreateVolumesFromImageTest-871768967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b2d8407-7e14-416d-9fca-73d9df04de80 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:39 devstack sudo[103487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b2d8407-7e14-416d-9fca-73d9df04de80
Nov 06 11:56:39 devstack sudo[103487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:39 devstack sudo[103485]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6ee41d3a-1287-4bb5-ae75-38b651fd57ab tempest-VolumeDependencyTests-665248495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032.a1b61434-9bf6-47a5-bd4f-344b8eab6a69" returned: 0 in 0.283s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:39 devstack sudo[103487]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:39 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-6ee41d3a-1287-4bb5-ae75-38b651fd57ab tempest-VolumeDependencyTests-665248495 None] Lock "cinder-quobyte-a1b61434-9bf6-47a5-bd4f-344b8eab6a69" released by "_delete_snapshot" :: held 2.062s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:56:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5acbec45-f036-4961-8373-36436b5fff21 tempest-CreateVolumesFromImageTest-871768967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b2d8407-7e14-416d-9fca-73d9df04de80" returned: 0 in 0.267s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:39 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5acbec45-f036-4961-8373-36436b5fff21 tempest-CreateVolumesFromImageTest-871768967 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:56:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5acbec45-f036-4961-8373-36436b5fff21 tempest-CreateVolumesFromImageTest-871768967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:56:39 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-6ee41d3a-1287-4bb5-ae75-38b651fd57ab tempest-VolumeDependencyTests-665248495 None] Lock "cinder-quobyte-4db9d4fa-55de-4223-9451-5cd5a9cef032" released by "delete_snapshot" :: held 2.102s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:56:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c6de79ac-29c1-4c41-9ddd-649ce4491c1e tempest-CreateVolumesFromImageTest-871768967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 33.375s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:56:39 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-c6de79ac-29c1-4c41-9ddd-649ce4491c1e tempest-CreateVolumesFromImageTest-871768967 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-603370081',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a939ccf0-3477-47e1-87c8-803a078167b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='211b6c18a6894184bfc7b066b989e6aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:06Z,use_quota=True,user_id='1ae8dded83574c80ae67dca54ef88681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:56:39 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-c6de79ac-29c1-4c41-9ddd-649ce4491c1e tempest-CreateVolumesFromImageTest-871768967 None] Creating volume a939ccf0-3477-47e1-87c8-803a078167b3 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:56:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c6de79ac-29c1-4c41-9ddd-649ce4491c1e tempest-CreateVolumesFromImageTest-871768967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:56:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c6de79ac-29c1-4c41-9ddd-649ce4491c1e tempest-CreateVolumesFromImageTest-871768967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:56:39 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-c6de79ac-29c1-4c41-9ddd-649ce4491c1e tempest-CreateVolumesFromImageTest-871768967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:56:39 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-c6de79ac-29c1-4c41-9ddd-649ce4491c1e tempest-CreateVolumesFromImageTest-871768967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:56:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c6de79ac-29c1-4c41-9ddd-649ce4491c1e tempest-CreateVolumesFromImageTest-871768967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:56:39 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-c6de79ac-29c1-4c41-9ddd-649ce4491c1e tempest-CreateVolumesFromImageTest-871768967 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:56:39 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-c6de79ac-29c1-4c41-9ddd-649ce4491c1e tempest-CreateVolumesFromImageTest-871768967 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:56:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c6de79ac-29c1-4c41-9ddd-649ce4491c1e tempest-CreateVolumesFromImageTest-871768967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a939ccf0-3477-47e1-87c8-803a078167b3 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:39 devstack sudo[103491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a939ccf0-3477-47e1-87c8-803a078167b3 1073741824
Nov 06 11:56:39 devstack sudo[103491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:39 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5acbec45-f036-4961-8373-36436b5fff21 tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00aad173-6e7b-4835-b19e-bc88e3cfdff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b2d8407-7e14-416d-9fca-73d9df04de80', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:39 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5acbec45-f036-4961-8373-36436b5fff21 tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ae426a1-8f6e-4fb6-848a-85348c7c2cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:39 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-5acbec45-f036-4961-8373-36436b5fff21 tempest-CreateVolumesFromImageTest-871768967 None] Volume volume-8b2d8407-7e14-416d-9fca-73d9df04de80 (8b2d8407-7e14-416d-9fca-73d9df04de80): created successfully
Nov 06 11:56:39 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5acbec45-f036-4961-8373-36436b5fff21 tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ae426a1-8f6e-4fb6-848a-85348c7c2cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:39 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5acbec45-f036-4961-8373-36436b5fff21 tempest-CreateVolumesFromImageTest-871768967 None] Flow 'volume_create_manager' (da6e2eec-1a36-4d1a-8fc5-91c3882c7eb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:56:39 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-5acbec45-f036-4961-8373-36436b5fff21 tempest-CreateVolumesFromImageTest-871768967 None] Created volume successfully.
Nov 06 11:56:39 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-6ee41d3a-1287-4bb5-ae75-38b651fd57ab tempest-VolumeDependencyTests-665248495 None] Created reservations ['22c5b93b-f764-4c1e-8cc4-86c279e9e0c0', '844ca81f-4ce0-4b33-b25a-90d2ba34fab8', '781db402-3d96-4029-ac7e-ad2f36b51ac3', '191852f6-c265-4284-8ff0-47f74194c751'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:56:39 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-6ee41d3a-1287-4bb5-ae75-38b651fd57ab tempest-VolumeDependencyTests-665248495 None] Delete snapshot completed successfully.
Nov 06 11:56:39 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-6ee41d3a-1287-4bb5-ae75-38b651fd57ab tempest-VolumeDependencyTests-665248495 None] Lock "cinder-a1b61434-9bf6-47a5-bd4f-344b8eab6a69-delete_snapshot" released by "delete_snapshot" :: held 2.397s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:56:40 devstack sudo[103491]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c6de79ac-29c1-4c41-9ddd-649ce4491c1e tempest-CreateVolumesFromImageTest-871768967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a939ccf0-3477-47e1-87c8-803a078167b3 1073741824" returned: 0 in 0.529s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c6de79ac-29c1-4c41-9ddd-649ce4491c1e tempest-CreateVolumesFromImageTest-871768967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a939ccf0-3477-47e1-87c8-803a078167b3 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:40 devstack sudo[103496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a939ccf0-3477-47e1-87c8-803a078167b3
Nov 06 11:56:40 devstack sudo[103496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:40 devstack sudo[103496]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c6de79ac-29c1-4c41-9ddd-649ce4491c1e tempest-CreateVolumesFromImageTest-871768967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a939ccf0-3477-47e1-87c8-803a078167b3" returned: 0 in 0.270s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:40 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-c6de79ac-29c1-4c41-9ddd-649ce4491c1e tempest-CreateVolumesFromImageTest-871768967 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:56:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c6de79ac-29c1-4c41-9ddd-649ce4491c1e tempest-CreateVolumesFromImageTest-871768967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:56:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-aeb30fe5-b3c6-41c0-ba9f-89bb1bc6e004 tempest-CreateVolumesFromImageTest-871768967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 33.583s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:56:40 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-aeb30fe5-b3c6-41c0-ba9f-89bb1bc6e004 tempest-CreateVolumesFromImageTest-871768967 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:56:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2070870634',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58792b48-8c21-445a-8fb9-1319de8e0c1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='211b6c18a6894184bfc7b066b989e6aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:07Z,use_quota=True,user_id='1ae8dded83574c80ae67dca54ef88681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:56:40 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-aeb30fe5-b3c6-41c0-ba9f-89bb1bc6e004 tempest-CreateVolumesFromImageTest-871768967 None] Creating volume 58792b48-8c21-445a-8fb9-1319de8e0c1e {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:56:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-aeb30fe5-b3c6-41c0-ba9f-89bb1bc6e004 tempest-CreateVolumesFromImageTest-871768967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:56:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-aeb30fe5-b3c6-41c0-ba9f-89bb1bc6e004 tempest-CreateVolumesFromImageTest-871768967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:56:40 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-aeb30fe5-b3c6-41c0-ba9f-89bb1bc6e004 tempest-CreateVolumesFromImageTest-871768967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:56:40 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-aeb30fe5-b3c6-41c0-ba9f-89bb1bc6e004 tempest-CreateVolumesFromImageTest-871768967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:56:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-aeb30fe5-b3c6-41c0-ba9f-89bb1bc6e004 tempest-CreateVolumesFromImageTest-871768967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:56:40 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-aeb30fe5-b3c6-41c0-ba9f-89bb1bc6e004 tempest-CreateVolumesFromImageTest-871768967 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:56:40 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-aeb30fe5-b3c6-41c0-ba9f-89bb1bc6e004 tempest-CreateVolumesFromImageTest-871768967 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:56:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-aeb30fe5-b3c6-41c0-ba9f-89bb1bc6e004 tempest-CreateVolumesFromImageTest-871768967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-58792b48-8c21-445a-8fb9-1319de8e0c1e 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:40 devstack sudo[103500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-58792b48-8c21-445a-8fb9-1319de8e0c1e 1073741824
Nov 06 11:56:40 devstack sudo[103500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c6de79ac-29c1-4c41-9ddd-649ce4491c1e tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d10a3399-a2e2-48ee-a3cd-818c401eae3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a939ccf0-3477-47e1-87c8-803a078167b3', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c6de79ac-29c1-4c41-9ddd-649ce4491c1e tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77f5e1f7-eaec-4fb9-87cd-28772f237d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:40 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-c6de79ac-29c1-4c41-9ddd-649ce4491c1e tempest-CreateVolumesFromImageTest-871768967 None] Volume volume-a939ccf0-3477-47e1-87c8-803a078167b3 (a939ccf0-3477-47e1-87c8-803a078167b3): created successfully
Nov 06 11:56:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c6de79ac-29c1-4c41-9ddd-649ce4491c1e tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77f5e1f7-eaec-4fb9-87cd-28772f237d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c6de79ac-29c1-4c41-9ddd-649ce4491c1e tempest-CreateVolumesFromImageTest-871768967 None] Flow 'volume_create_manager' (af1043cd-923a-4330-8398-0ae8e522a33a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:56:40 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-c6de79ac-29c1-4c41-9ddd-649ce4491c1e tempest-CreateVolumesFromImageTest-871768967 None] Created volume successfully.
Nov 06 11:56:40 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-67dd443f-0cda-4bc9-bda9-fc7363b6b834 tempest-VolumeDependencyTests-665248495 None] Acquiring lock "cinder-4db9d4fa-55de-4223-9451-5cd5a9cef032-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:56:40 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-67dd443f-0cda-4bc9-bda9-fc7363b6b834 tempest-VolumeDependencyTests-665248495 None] Lock "cinder-4db9d4fa-55de-4223-9451-5cd5a9cef032-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:56:40 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-67dd443f-0cda-4bc9-bda9-fc7363b6b834 tempest-VolumeDependencyTests-665248495 None] Acquiring lock "cinder-quobyte-4db9d4fa-55de-4223-9451-5cd5a9cef032" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:56:40 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-67dd443f-0cda-4bc9-bda9-fc7363b6b834 tempest-VolumeDependencyTests-665248495 None] Lock "cinder-quobyte-4db9d4fa-55de-4223-9451-5cd5a9cef032" acquired by "delete_volume" :: waited 0.023s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:56:41 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de65246-f2e9-4411-8b92-423166846acd]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:56:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-67dd443f-0cda-4bc9-bda9-fc7363b6b834 tempest-VolumeDependencyTests-665248495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:41 devstack sudo[103505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032
Nov 06 11:56:41 devstack sudo[103505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:41 devstack sudo[103500]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-aeb30fe5-b3c6-41c0-ba9f-89bb1bc6e004 tempest-CreateVolumesFromImageTest-871768967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-58792b48-8c21-445a-8fb9-1319de8e0c1e 1073741824" returned: 0 in 0.560s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-aeb30fe5-b3c6-41c0-ba9f-89bb1bc6e004 tempest-CreateVolumesFromImageTest-871768967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-58792b48-8c21-445a-8fb9-1319de8e0c1e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:41 devstack sudo[103508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-58792b48-8c21-445a-8fb9-1319de8e0c1e
Nov 06 11:56:41 devstack sudo[103508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:41 devstack sudo[103505]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-67dd443f-0cda-4bc9-bda9-fc7363b6b834 tempest-VolumeDependencyTests-665248495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032" returned: 0 in 0.388s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-67dd443f-0cda-4bc9-bda9-fc7363b6b834 tempest-VolumeDependencyTests-665248495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:41 devstack sudo[103514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032
Nov 06 11:56:41 devstack sudo[103514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:41 devstack sudo[103508]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-aeb30fe5-b3c6-41c0-ba9f-89bb1bc6e004 tempest-CreateVolumesFromImageTest-871768967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-58792b48-8c21-445a-8fb9-1319de8e0c1e" returned: 0 in 0.283s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:41 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-aeb30fe5-b3c6-41c0-ba9f-89bb1bc6e004 tempest-CreateVolumesFromImageTest-871768967 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:56:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-aeb30fe5-b3c6-41c0-ba9f-89bb1bc6e004 tempest-CreateVolumesFromImageTest-871768967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:56:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b4a31245-976a-46ca-9c39-4bd779a87d66 tempest-VolumeTypesAccessTest-1076938397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 30.985s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:56:41 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b4a31245-976a-46ca-9c39-4bd779a87d66 tempest-VolumeTypesAccessTest-1076938397 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-256106233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=724a08a3-fa91-416b-8eba-49563e9b713c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19044d9a88f44b8d91097969c55b3ae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:10Z,use_quota=True,user_id='f364d7f2daae497c94c023582ed78ee2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(434781cd-530e-4577-afe6-23f756771d69),volume_type_id=434781cd-530e-4577-afe6-23f756771d69)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:56:41 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-b4a31245-976a-46ca-9c39-4bd779a87d66 tempest-VolumeTypesAccessTest-1076938397 None] Creating volume 724a08a3-fa91-416b-8eba-49563e9b713c {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:56:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b4a31245-976a-46ca-9c39-4bd779a87d66 tempest-VolumeTypesAccessTest-1076938397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:56:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b4a31245-976a-46ca-9c39-4bd779a87d66 tempest-VolumeTypesAccessTest-1076938397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:56:41 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b4a31245-976a-46ca-9c39-4bd779a87d66 tempest-VolumeTypesAccessTest-1076938397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:56:41 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b4a31245-976a-46ca-9c39-4bd779a87d66 tempest-VolumeTypesAccessTest-1076938397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:56:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b4a31245-976a-46ca-9c39-4bd779a87d66 tempest-VolumeTypesAccessTest-1076938397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:56:41 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b4a31245-976a-46ca-9c39-4bd779a87d66 tempest-VolumeTypesAccessTest-1076938397 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:56:41 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-b4a31245-976a-46ca-9c39-4bd779a87d66 tempest-VolumeTypesAccessTest-1076938397 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:56:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b4a31245-976a-46ca-9c39-4bd779a87d66 tempest-VolumeTypesAccessTest-1076938397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-724a08a3-fa91-416b-8eba-49563e9b713c 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:41 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-aeb30fe5-b3c6-41c0-ba9f-89bb1bc6e004 tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (918d2260-920f-4520-9d0b-0b5f08737d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58792b48-8c21-445a-8fb9-1319de8e0c1e', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:41 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-aeb30fe5-b3c6-41c0-ba9f-89bb1bc6e004 tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c824ee6d-acaa-449c-b1b8-d0aeb57ffe65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:41 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-aeb30fe5-b3c6-41c0-ba9f-89bb1bc6e004 tempest-CreateVolumesFromImageTest-871768967 None] Volume volume-58792b48-8c21-445a-8fb9-1319de8e0c1e (58792b48-8c21-445a-8fb9-1319de8e0c1e): created successfully
Nov 06 11:56:41 devstack sudo[103516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-724a08a3-fa91-416b-8eba-49563e9b713c 1073741824
Nov 06 11:56:41 devstack sudo[103516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:41 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-aeb30fe5-b3c6-41c0-ba9f-89bb1bc6e004 tempest-CreateVolumesFromImageTest-871768967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c824ee6d-acaa-449c-b1b8-d0aeb57ffe65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:41 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-aeb30fe5-b3c6-41c0-ba9f-89bb1bc6e004 tempest-CreateVolumesFromImageTest-871768967 None] Flow 'volume_create_manager' (8dd12106-7249-4442-b387-0125ddec4325) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:56:41 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-aeb30fe5-b3c6-41c0-ba9f-89bb1bc6e004 tempest-CreateVolumesFromImageTest-871768967 None] Created volume successfully.
Nov 06 11:56:41 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-3d8086ff-f787-4017-a791-b7ec2cec253a tempest-CreateVolumesFromImageTest-871768967 None] Acquiring lock "cinder-58792b48-8c21-445a-8fb9-1319de8e0c1e-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:56:41 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-3d8086ff-f787-4017-a791-b7ec2cec253a tempest-CreateVolumesFromImageTest-871768967 None] Lock "cinder-58792b48-8c21-445a-8fb9-1319de8e0c1e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:56:41 devstack sudo[103514]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-67dd443f-0cda-4bc9-bda9-fc7363b6b834 tempest-VolumeDependencyTests-665248495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4db9d4fa-55de-4223-9451-5cd5a9cef032" returned: 0 in 0.437s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:41 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-3d8086ff-f787-4017-a791-b7ec2cec253a tempest-CreateVolumesFromImageTest-871768967 None] Acquiring lock "cinder-quobyte-58792b48-8c21-445a-8fb9-1319de8e0c1e" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:56:41 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-67dd443f-0cda-4bc9-bda9-fc7363b6b834 tempest-VolumeDependencyTests-665248495 None] Lock "cinder-quobyte-4db9d4fa-55de-4223-9451-5cd5a9cef032" released by "delete_volume" :: held 0.913s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:56:41 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-3d8086ff-f787-4017-a791-b7ec2cec253a tempest-CreateVolumesFromImageTest-871768967 None] Lock "cinder-quobyte-58792b48-8c21-445a-8fb9-1319de8e0c1e" acquired by "delete_volume" :: waited 0.027s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:56:41 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec134db-892f-443b-a30a-3baabf90a1e2]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:56:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3d8086ff-f787-4017-a791-b7ec2cec253a tempest-CreateVolumesFromImageTest-871768967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-58792b48-8c21-445a-8fb9-1319de8e0c1e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:41 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-67dd443f-0cda-4bc9-bda9-fc7363b6b834 tempest-VolumeDependencyTests-665248495 None] Created reservations ['00cc1f9c-cfc9-47b8-b1f9-32925b66140f', '47008d56-4282-43dd-8c02-3cb989c4b9aa', 'b97bfb23-d9e2-4742-8899-333d3475ee5d', 'b40d5ab5-4f1a-493b-bb88-8fd6188a4326'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:56:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-67dd443f-0cda-4bc9-bda9-fc7363b6b834 tempest-VolumeDependencyTests-665248495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:56:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-67dd443f-0cda-4bc9-bda9-fc7363b6b834 tempest-VolumeDependencyTests-665248495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:56:42 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-67dd443f-0cda-4bc9-bda9-fc7363b6b834 tempest-VolumeDependencyTests-665248495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:56:42 devstack sudo[103522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-58792b48-8c21-445a-8fb9-1319de8e0c1e
Nov 06 11:56:42 devstack sudo[103522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:42 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-67dd443f-0cda-4bc9-bda9-fc7363b6b834 tempest-VolumeDependencyTests-665248495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:56:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-67dd443f-0cda-4bc9-bda9-fc7363b6b834 tempest-VolumeDependencyTests-665248495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:56:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-67dd443f-0cda-4bc9-bda9-fc7363b6b834 tempest-VolumeDependencyTests-665248495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:42 devstack sudo[103525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:56:42 devstack sudo[103525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:42 devstack sudo[103516]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b4a31245-976a-46ca-9c39-4bd779a87d66 tempest-VolumeTypesAccessTest-1076938397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-724a08a3-fa91-416b-8eba-49563e9b713c 1073741824" returned: 0 in 0.720s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b4a31245-976a-46ca-9c39-4bd779a87d66 tempest-VolumeTypesAccessTest-1076938397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-724a08a3-fa91-416b-8eba-49563e9b713c {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:42 devstack sudo[103527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-724a08a3-fa91-416b-8eba-49563e9b713c
Nov 06 11:56:42 devstack sudo[103527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:42 devstack sudo[103522]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:42 devstack sudo[103525]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3d8086ff-f787-4017-a791-b7ec2cec253a tempest-CreateVolumesFromImageTest-871768967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-58792b48-8c21-445a-8fb9-1319de8e0c1e" returned: 0 in 0.460s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-67dd443f-0cda-4bc9-bda9-fc7363b6b834 tempest-VolumeDependencyTests-665248495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.290s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3d8086ff-f787-4017-a791-b7ec2cec253a tempest-CreateVolumesFromImageTest-871768967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-58792b48-8c21-445a-8fb9-1319de8e0c1e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:42 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-67dd443f-0cda-4bc9-bda9-fc7363b6b834 tempest-VolumeDependencyTests-665248495 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:56:42 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-67dd443f-0cda-4bc9-bda9-fc7363b6b834 tempest-VolumeDependencyTests-665248495 None] Deleted volume successfully.
Nov 06 11:56:42 devstack sudo[103533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-58792b48-8c21-445a-8fb9-1319de8e0c1e
Nov 06 11:56:42 devstack sudo[103533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:42 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-67dd443f-0cda-4bc9-bda9-fc7363b6b834 tempest-VolumeDependencyTests-665248495 None] Lock "cinder-4db9d4fa-55de-4223-9451-5cd5a9cef032-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:56:42 devstack sudo[103527]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b4a31245-976a-46ca-9c39-4bd779a87d66 tempest-VolumeTypesAccessTest-1076938397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-724a08a3-fa91-416b-8eba-49563e9b713c" returned: 0 in 0.277s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:42 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b4a31245-976a-46ca-9c39-4bd779a87d66 tempest-VolumeTypesAccessTest-1076938397 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:56:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b4a31245-976a-46ca-9c39-4bd779a87d66 tempest-VolumeTypesAccessTest-1076938397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:56:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b4a31245-976a-46ca-9c39-4bd779a87d66 tempest-VolumeTypesAccessTest-1076938397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fcfe1ab-a5ae-4e09-8941-d8f47ecec25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-724a08a3-fa91-416b-8eba-49563e9b713c', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b4a31245-976a-46ca-9c39-4bd779a87d66 tempest-VolumeTypesAccessTest-1076938397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f392186-a717-4c01-90cd-08ca46c230ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:42 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-b4a31245-976a-46ca-9c39-4bd779a87d66 tempest-VolumeTypesAccessTest-1076938397 None] Volume volume-724a08a3-fa91-416b-8eba-49563e9b713c (724a08a3-fa91-416b-8eba-49563e9b713c): created successfully
Nov 06 11:56:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b4a31245-976a-46ca-9c39-4bd779a87d66 tempest-VolumeTypesAccessTest-1076938397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f392186-a717-4c01-90cd-08ca46c230ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b4a31245-976a-46ca-9c39-4bd779a87d66 tempest-VolumeTypesAccessTest-1076938397 None] Flow 'volume_create_manager' (bf25f1ac-27f8-409d-b43c-ef9408566905) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:56:42 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-b4a31245-976a-46ca-9c39-4bd779a87d66 tempest-VolumeTypesAccessTest-1076938397 None] Created volume successfully.
Nov 06 11:56:42 devstack sudo[103533]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3d8086ff-f787-4017-a791-b7ec2cec253a tempest-CreateVolumesFromImageTest-871768967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-58792b48-8c21-445a-8fb9-1319de8e0c1e" returned: 0 in 0.307s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:42 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-3d8086ff-f787-4017-a791-b7ec2cec253a tempest-CreateVolumesFromImageTest-871768967 None] Lock "cinder-quobyte-58792b48-8c21-445a-8fb9-1319de8e0c1e" released by "delete_volume" :: held 0.833s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:56:42 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-3d8086ff-f787-4017-a791-b7ec2cec253a tempest-CreateVolumesFromImageTest-871768967 None] Created reservations ['f89997cf-4290-41e4-9039-ca8662547b3b', '379ea466-2ecb-4bfa-a90a-96ae9743fe25', '9c262bf6-f73d-48c2-98cf-2b334541b75e', '299d06f8-1e16-41d4-b6ed-9679a6230f4e'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:56:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3d8086ff-f787-4017-a791-b7ec2cec253a tempest-CreateVolumesFromImageTest-871768967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:56:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3d8086ff-f787-4017-a791-b7ec2cec253a tempest-CreateVolumesFromImageTest-871768967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:56:42 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-3d8086ff-f787-4017-a791-b7ec2cec253a tempest-CreateVolumesFromImageTest-871768967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:56:42 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-3d8086ff-f787-4017-a791-b7ec2cec253a tempest-CreateVolumesFromImageTest-871768967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:56:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3d8086ff-f787-4017-a791-b7ec2cec253a tempest-CreateVolumesFromImageTest-871768967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:56:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3d8086ff-f787-4017-a791-b7ec2cec253a tempest-CreateVolumesFromImageTest-871768967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:42 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-cad2a120-e885-477b-a52e-56317cf909cd tempest-VolumeTypesAccessTest-1076938397 None] Acquiring lock "cinder-724a08a3-fa91-416b-8eba-49563e9b713c-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:56:42 devstack sudo[103538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:56:43 devstack sudo[103538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:43 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-cad2a120-e885-477b-a52e-56317cf909cd tempest-VolumeTypesAccessTest-1076938397 None] Lock "cinder-724a08a3-fa91-416b-8eba-49563e9b713c-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:56:43 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c918d801-c641-458a-b4dc-db0e57682132 tempest-CreateVolumesFromImageTest-871768967 None] Acquiring lock "cinder-a939ccf0-3477-47e1-87c8-803a078167b3-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:56:43 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-cad2a120-e885-477b-a52e-56317cf909cd tempest-VolumeTypesAccessTest-1076938397 None] Acquiring lock "cinder-quobyte-724a08a3-fa91-416b-8eba-49563e9b713c" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:56:43 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c918d801-c641-458a-b4dc-db0e57682132 tempest-CreateVolumesFromImageTest-871768967 None] Lock "cinder-a939ccf0-3477-47e1-87c8-803a078167b3-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:56:43 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-cad2a120-e885-477b-a52e-56317cf909cd tempest-VolumeTypesAccessTest-1076938397 None] Lock "cinder-quobyte-724a08a3-fa91-416b-8eba-49563e9b713c" acquired by "delete_volume" :: waited 0.028s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:56:43 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1401c872-0c95-4485-85bc-cc60b005367a]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:56:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cad2a120-e885-477b-a52e-56317cf909cd tempest-VolumeTypesAccessTest-1076938397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-724a08a3-fa91-416b-8eba-49563e9b713c {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:43 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c918d801-c641-458a-b4dc-db0e57682132 tempest-CreateVolumesFromImageTest-871768967 None] Acquiring lock "cinder-quobyte-a939ccf0-3477-47e1-87c8-803a078167b3" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:56:43 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c918d801-c641-458a-b4dc-db0e57682132 tempest-CreateVolumesFromImageTest-871768967 None] Lock "cinder-quobyte-a939ccf0-3477-47e1-87c8-803a078167b3" acquired by "delete_volume" :: waited 0.022s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:56:43 devstack sudo[103538]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3d8086ff-f787-4017-a791-b7ec2cec253a tempest-CreateVolumesFromImageTest-871768967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.417s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:43 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-3d8086ff-f787-4017-a791-b7ec2cec253a tempest-CreateVolumesFromImageTest-871768967 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:56:43 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-3d8086ff-f787-4017-a791-b7ec2cec253a tempest-CreateVolumesFromImageTest-871768967 None] Deleted volume successfully.
Nov 06 11:56:43 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[936c834f-804c-4ae2-b96d-7226d6403b6d]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:56:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c918d801-c641-458a-b4dc-db0e57682132 tempest-CreateVolumesFromImageTest-871768967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a939ccf0-3477-47e1-87c8-803a078167b3 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:43 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e6fb7699-b720-44f5-9208-eb39f05d284d tempest-VolumeDependencyTests-665248495 None] Acquiring lock "cinder-85894f2e-26b8-4e32-97ff-c36167385581-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:56:43 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-3d8086ff-f787-4017-a791-b7ec2cec253a tempest-CreateVolumesFromImageTest-871768967 None] Lock "cinder-58792b48-8c21-445a-8fb9-1319de8e0c1e-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:56:43 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e6fb7699-b720-44f5-9208-eb39f05d284d tempest-VolumeDependencyTests-665248495 None] Lock "cinder-85894f2e-26b8-4e32-97ff-c36167385581-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:56:43 devstack sudo[103541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-724a08a3-fa91-416b-8eba-49563e9b713c
Nov 06 11:56:43 devstack sudo[103541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:43 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e6fb7699-b720-44f5-9208-eb39f05d284d tempest-VolumeDependencyTests-665248495 None] Acquiring lock "cinder-quobyte-85894f2e-26b8-4e32-97ff-c36167385581" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:56:43 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e6fb7699-b720-44f5-9208-eb39f05d284d tempest-VolumeDependencyTests-665248495 None] Lock "cinder-quobyte-85894f2e-26b8-4e32-97ff-c36167385581" acquired by "delete_volume" :: waited 0.024s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:56:43 devstack sudo[103542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a939ccf0-3477-47e1-87c8-803a078167b3
Nov 06 11:56:43 devstack sudo[103542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:43 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be0d539-4b05-4830-8b26-e45d9d883ecb]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:56:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e6fb7699-b720-44f5-9208-eb39f05d284d tempest-VolumeDependencyTests-665248495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-85894f2e-26b8-4e32-97ff-c36167385581 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:43 devstack sudo[103545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-85894f2e-26b8-4e32-97ff-c36167385581
Nov 06 11:56:43 devstack sudo[103545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:43 devstack sudo[103541]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cad2a120-e885-477b-a52e-56317cf909cd tempest-VolumeTypesAccessTest-1076938397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-724a08a3-fa91-416b-8eba-49563e9b713c" returned: 0 in 0.519s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cad2a120-e885-477b-a52e-56317cf909cd tempest-VolumeTypesAccessTest-1076938397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-724a08a3-fa91-416b-8eba-49563e9b713c {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:43 devstack sudo[103553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-724a08a3-fa91-416b-8eba-49563e9b713c
Nov 06 11:56:43 devstack sudo[103553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:43 devstack sudo[103542]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c918d801-c641-458a-b4dc-db0e57682132 tempest-CreateVolumesFromImageTest-871768967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a939ccf0-3477-47e1-87c8-803a078167b3" returned: 0 in 0.495s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c918d801-c641-458a-b4dc-db0e57682132 tempest-CreateVolumesFromImageTest-871768967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a939ccf0-3477-47e1-87c8-803a078167b3 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:43 devstack sudo[103555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a939ccf0-3477-47e1-87c8-803a078167b3
Nov 06 11:56:43 devstack sudo[103555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:44 devstack sudo[103545]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e6fb7699-b720-44f5-9208-eb39f05d284d tempest-VolumeDependencyTests-665248495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-85894f2e-26b8-4e32-97ff-c36167385581" returned: 0 in 0.537s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e6fb7699-b720-44f5-9208-eb39f05d284d tempest-VolumeDependencyTests-665248495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-85894f2e-26b8-4e32-97ff-c36167385581 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:44 devstack sudo[103561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-85894f2e-26b8-4e32-97ff-c36167385581
Nov 06 11:56:44 devstack sudo[103561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:44 devstack sudo[103553]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cad2a120-e885-477b-a52e-56317cf909cd tempest-VolumeTypesAccessTest-1076938397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-724a08a3-fa91-416b-8eba-49563e9b713c" returned: 0 in 0.367s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:44 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-cad2a120-e885-477b-a52e-56317cf909cd tempest-VolumeTypesAccessTest-1076938397 None] Lock "cinder-quobyte-724a08a3-fa91-416b-8eba-49563e9b713c" released by "delete_volume" :: held 0.986s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:56:44 devstack sudo[103555]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c918d801-c641-458a-b4dc-db0e57682132 tempest-CreateVolumesFromImageTest-871768967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a939ccf0-3477-47e1-87c8-803a078167b3" returned: 0 in 0.356s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:44 devstack cinder-volume[87165]: WARNING cinder.quota [None req-cad2a120-e885-477b-a52e-56317cf909cd tempest-VolumeTypesAccessTest-1076938397 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1570920475 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1570920475, it is now deprecated. Please use the default quota class for default quota.
Nov 06 11:56:44 devstack cinder-volume[87165]: WARNING cinder.quota [None req-cad2a120-e885-477b-a52e-56317cf909cd tempest-VolumeTypesAccessTest-1076938397 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1570920475 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1570920475, it is now deprecated. Please use the default quota class for default quota.
Nov 06 11:56:44 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c918d801-c641-458a-b4dc-db0e57682132 tempest-CreateVolumesFromImageTest-871768967 None] Lock "cinder-quobyte-a939ccf0-3477-47e1-87c8-803a078167b3" released by "delete_volume" :: held 0.943s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:56:44 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-cad2a120-e885-477b-a52e-56317cf909cd tempest-VolumeTypesAccessTest-1076938397 None] Created reservations ['1f24228f-a346-4463-aba3-8d47a315ddea', '6cd204af-a430-4d42-9e4f-cc15a04ade34', '2f913699-7777-4095-8ede-9606ff10dac8', '529188b1-2ff3-4caa-b9e9-721b16e8b6f8'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:56:44 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-c918d801-c641-458a-b4dc-db0e57682132 tempest-CreateVolumesFromImageTest-871768967 None] Created reservations ['e9c8437a-d6b5-4c24-8a57-ec9fe843a807', 'c9a6ce71-fc7a-4a37-a819-15619ebcebfe', '4b61a52d-2620-439e-b23d-35d3f1ec221a', 'a3962ac9-c1f5-47d6-acd4-a13687ac4abc'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:56:44 devstack sudo[103561]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e6fb7699-b720-44f5-9208-eb39f05d284d tempest-VolumeDependencyTests-665248495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-85894f2e-26b8-4e32-97ff-c36167385581" returned: 0 in 0.335s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-cad2a120-e885-477b-a52e-56317cf909cd tempest-VolumeTypesAccessTest-1076938397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:56:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-cad2a120-e885-477b-a52e-56317cf909cd tempest-VolumeTypesAccessTest-1076938397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:56:44 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-cad2a120-e885-477b-a52e-56317cf909cd tempest-VolumeTypesAccessTest-1076938397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:56:44 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-cad2a120-e885-477b-a52e-56317cf909cd tempest-VolumeTypesAccessTest-1076938397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:56:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-cad2a120-e885-477b-a52e-56317cf909cd tempest-VolumeTypesAccessTest-1076938397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:56:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cad2a120-e885-477b-a52e-56317cf909cd tempest-VolumeTypesAccessTest-1076938397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:44 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e6fb7699-b720-44f5-9208-eb39f05d284d tempest-VolumeDependencyTests-665248495 None] Lock "cinder-quobyte-85894f2e-26b8-4e32-97ff-c36167385581" released by "delete_volume" :: held 0.952s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:56:44 devstack sudo[103566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:56:44 devstack sudo[103566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c918d801-c641-458a-b4dc-db0e57682132 tempest-CreateVolumesFromImageTest-871768967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:56:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c918d801-c641-458a-b4dc-db0e57682132 tempest-CreateVolumesFromImageTest-871768967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:56:44 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-c918d801-c641-458a-b4dc-db0e57682132 tempest-CreateVolumesFromImageTest-871768967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:56:44 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-c918d801-c641-458a-b4dc-db0e57682132 tempest-CreateVolumesFromImageTest-871768967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:56:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c918d801-c641-458a-b4dc-db0e57682132 tempest-CreateVolumesFromImageTest-871768967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:56:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c918d801-c641-458a-b4dc-db0e57682132 tempest-CreateVolumesFromImageTest-871768967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:44 devstack sudo[103568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:56:44 devstack sudo[103568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:44 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-e6fb7699-b720-44f5-9208-eb39f05d284d tempest-VolumeDependencyTests-665248495 None] Created reservations ['5ead941c-c2c3-4bc6-80d4-579717e3b5ea', '02899e1e-b46f-4bc2-8cfd-849fb622bbf4', 'd7d7e3ae-a5da-4877-b05e-a22f50cbec72', '557a54a2-6dfc-4e09-9714-56d114f4821e'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:56:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e6fb7699-b720-44f5-9208-eb39f05d284d tempest-VolumeDependencyTests-665248495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:56:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e6fb7699-b720-44f5-9208-eb39f05d284d tempest-VolumeDependencyTests-665248495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:56:44 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-e6fb7699-b720-44f5-9208-eb39f05d284d tempest-VolumeDependencyTests-665248495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:56:44 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-e6fb7699-b720-44f5-9208-eb39f05d284d tempest-VolumeDependencyTests-665248495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:56:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e6fb7699-b720-44f5-9208-eb39f05d284d tempest-VolumeDependencyTests-665248495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:56:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e6fb7699-b720-44f5-9208-eb39f05d284d tempest-VolumeDependencyTests-665248495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:44 devstack sudo[103571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:56:44 devstack sudo[103571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:44 devstack sudo[103566]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cad2a120-e885-477b-a52e-56317cf909cd tempest-VolumeTypesAccessTest-1076938397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.324s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:44 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-cad2a120-e885-477b-a52e-56317cf909cd tempest-VolumeTypesAccessTest-1076938397 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:56:44 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-cad2a120-e885-477b-a52e-56317cf909cd tempest-VolumeTypesAccessTest-1076938397 None] Deleted volume successfully.
Nov 06 11:56:44 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-cad2a120-e885-477b-a52e-56317cf909cd tempest-VolumeTypesAccessTest-1076938397 None] Lock "cinder-724a08a3-fa91-416b-8eba-49563e9b713c-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:56:44 devstack sudo[103568]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c918d801-c641-458a-b4dc-db0e57682132 tempest-CreateVolumesFromImageTest-871768967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.326s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:44 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-c918d801-c641-458a-b4dc-db0e57682132 tempest-CreateVolumesFromImageTest-871768967 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:56:44 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-c918d801-c641-458a-b4dc-db0e57682132 tempest-CreateVolumesFromImageTest-871768967 None] Deleted volume successfully.
Nov 06 11:56:44 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c918d801-c641-458a-b4dc-db0e57682132 tempest-CreateVolumesFromImageTest-871768967 None] Lock "cinder-a939ccf0-3477-47e1-87c8-803a078167b3-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:56:44 devstack sudo[103571]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e6fb7699-b720-44f5-9208-eb39f05d284d tempest-VolumeDependencyTests-665248495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.303s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:44 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-e6fb7699-b720-44f5-9208-eb39f05d284d tempest-VolumeDependencyTests-665248495 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:56:44 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-e6fb7699-b720-44f5-9208-eb39f05d284d tempest-VolumeDependencyTests-665248495 None] Deleted volume successfully.
Nov 06 11:56:45 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e6fb7699-b720-44f5-9208-eb39f05d284d tempest-VolumeDependencyTests-665248495 None] Lock "cinder-85894f2e-26b8-4e32-97ff-c36167385581-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:56:45 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-525640df-3923-49da-aec8-b09164e4f961 tempest-CreateVolumesFromImageTest-871768967 None] Acquiring lock "cinder-8b2d8407-7e14-416d-9fca-73d9df04de80-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:56:45 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-525640df-3923-49da-aec8-b09164e4f961 tempest-CreateVolumesFromImageTest-871768967 None] Lock "cinder-8b2d8407-7e14-416d-9fca-73d9df04de80-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:56:45 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-525640df-3923-49da-aec8-b09164e4f961 tempest-CreateVolumesFromImageTest-871768967 None] Acquiring lock "cinder-quobyte-8b2d8407-7e14-416d-9fca-73d9df04de80" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:56:45 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-525640df-3923-49da-aec8-b09164e4f961 tempest-CreateVolumesFromImageTest-871768967 None] Lock "cinder-quobyte-8b2d8407-7e14-416d-9fca-73d9df04de80" acquired by "delete_volume" :: waited 0.026s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:56:45 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c255b170-e80a-449a-8d6c-9585f4989148]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:56:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-525640df-3923-49da-aec8-b09164e4f961 tempest-CreateVolumesFromImageTest-871768967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b2d8407-7e14-416d-9fca-73d9df04de80 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:45 devstack sudo[103578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b2d8407-7e14-416d-9fca-73d9df04de80
Nov 06 11:56:45 devstack sudo[103578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:46 devstack sudo[103578]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-525640df-3923-49da-aec8-b09164e4f961 tempest-CreateVolumesFromImageTest-871768967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b2d8407-7e14-416d-9fca-73d9df04de80" returned: 0 in 0.517s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-525640df-3923-49da-aec8-b09164e4f961 tempest-CreateVolumesFromImageTest-871768967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b2d8407-7e14-416d-9fca-73d9df04de80 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:46 devstack sudo[103583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b2d8407-7e14-416d-9fca-73d9df04de80
Nov 06 11:56:46 devstack sudo[103583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:46 devstack sudo[103583]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-525640df-3923-49da-aec8-b09164e4f961 tempest-CreateVolumesFromImageTest-871768967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b2d8407-7e14-416d-9fca-73d9df04de80" returned: 0 in 0.332s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:46 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-525640df-3923-49da-aec8-b09164e4f961 tempest-CreateVolumesFromImageTest-871768967 None] Lock "cinder-quobyte-8b2d8407-7e14-416d-9fca-73d9df04de80" released by "delete_volume" :: held 0.920s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:56:46 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-525640df-3923-49da-aec8-b09164e4f961 tempest-CreateVolumesFromImageTest-871768967 None] Created reservations ['626c0f77-9013-48b3-8037-755bbd699815', '1e050a70-48a7-438d-8819-984c7854d03b', '98736eaa-c6c8-4ad7-a8fd-9352d96c612a', '1a0ae33a-ab01-4d87-b96b-01b7a4c602b6'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:56:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-525640df-3923-49da-aec8-b09164e4f961 tempest-CreateVolumesFromImageTest-871768967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:56:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-525640df-3923-49da-aec8-b09164e4f961 tempest-CreateVolumesFromImageTest-871768967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:56:46 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-525640df-3923-49da-aec8-b09164e4f961 tempest-CreateVolumesFromImageTest-871768967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:56:46 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-525640df-3923-49da-aec8-b09164e4f961 tempest-CreateVolumesFromImageTest-871768967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:56:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-525640df-3923-49da-aec8-b09164e4f961 tempest-CreateVolumesFromImageTest-871768967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:56:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-525640df-3923-49da-aec8-b09164e4f961 tempest-CreateVolumesFromImageTest-871768967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:46 devstack sudo[103586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:56:46 devstack sudo[103586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:46 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-9fbe8e6c-37fd-40b6-93ec-0b62c27183cf tempest-CreateVolumesFromImageTest-871768967 None] Acquiring lock "cinder-cc65f4f9-674f-45d7-b10a-38b2c69cb056-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:56:46 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-9fbe8e6c-37fd-40b6-93ec-0b62c27183cf tempest-CreateVolumesFromImageTest-871768967 None] Lock "cinder-cc65f4f9-674f-45d7-b10a-38b2c69cb056-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:56:46 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-9fbe8e6c-37fd-40b6-93ec-0b62c27183cf tempest-CreateVolumesFromImageTest-871768967 None] Acquiring lock "cinder-quobyte-cc65f4f9-674f-45d7-b10a-38b2c69cb056" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:56:47 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-9fbe8e6c-37fd-40b6-93ec-0b62c27183cf tempest-CreateVolumesFromImageTest-871768967 None] Lock "cinder-quobyte-cc65f4f9-674f-45d7-b10a-38b2c69cb056" acquired by "delete_volume" :: waited 0.051s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:56:47 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c94c4c1-77f1-44d6-976c-9213d7d4c657]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:56:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9fbe8e6c-37fd-40b6-93ec-0b62c27183cf tempest-CreateVolumesFromImageTest-871768967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-cc65f4f9-674f-45d7-b10a-38b2c69cb056 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:47 devstack sudo[103586]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-525640df-3923-49da-aec8-b09164e4f961 tempest-CreateVolumesFromImageTest-871768967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.438s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:47 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-525640df-3923-49da-aec8-b09164e4f961 tempest-CreateVolumesFromImageTest-871768967 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:56:47 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-525640df-3923-49da-aec8-b09164e4f961 tempest-CreateVolumesFromImageTest-871768967 None] Deleted volume successfully.
Nov 06 11:56:47 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-525640df-3923-49da-aec8-b09164e4f961 tempest-CreateVolumesFromImageTest-871768967 None] Lock "cinder-8b2d8407-7e14-416d-9fca-73d9df04de80-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:56:47 devstack sudo[103588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-cc65f4f9-674f-45d7-b10a-38b2c69cb056
Nov 06 11:56:47 devstack sudo[103588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:47 devstack sudo[103588]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9fbe8e6c-37fd-40b6-93ec-0b62c27183cf tempest-CreateVolumesFromImageTest-871768967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-cc65f4f9-674f-45d7-b10a-38b2c69cb056" returned: 0 in 0.527s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9fbe8e6c-37fd-40b6-93ec-0b62c27183cf tempest-CreateVolumesFromImageTest-871768967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-cc65f4f9-674f-45d7-b10a-38b2c69cb056 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:47 devstack sudo[103594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-cc65f4f9-674f-45d7-b10a-38b2c69cb056
Nov 06 11:56:47 devstack sudo[103594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:47 devstack sudo[103594]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9fbe8e6c-37fd-40b6-93ec-0b62c27183cf tempest-CreateVolumesFromImageTest-871768967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-cc65f4f9-674f-45d7-b10a-38b2c69cb056" returned: 0 in 0.318s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:47 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-9fbe8e6c-37fd-40b6-93ec-0b62c27183cf tempest-CreateVolumesFromImageTest-871768967 None] Lock "cinder-quobyte-cc65f4f9-674f-45d7-b10a-38b2c69cb056" released by "delete_volume" :: held 0.934s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:56:48 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-9fbe8e6c-37fd-40b6-93ec-0b62c27183cf tempest-CreateVolumesFromImageTest-871768967 None] Created reservations ['e6ed0be7-0ea3-4ab7-b7ce-6f8872949cdf', 'a9a5845b-df7e-442e-b5e4-d0527b64bbff', 'e30b1a3f-68d0-4f91-aaf0-709322935bd2', '043fe9f9-c059-492e-b51c-c3c8eb5bd2b8'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:56:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9fbe8e6c-37fd-40b6-93ec-0b62c27183cf tempest-CreateVolumesFromImageTest-871768967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:56:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9fbe8e6c-37fd-40b6-93ec-0b62c27183cf tempest-CreateVolumesFromImageTest-871768967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:56:48 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-9fbe8e6c-37fd-40b6-93ec-0b62c27183cf tempest-CreateVolumesFromImageTest-871768967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:56:48 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-9fbe8e6c-37fd-40b6-93ec-0b62c27183cf tempest-CreateVolumesFromImageTest-871768967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:56:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9fbe8e6c-37fd-40b6-93ec-0b62c27183cf tempest-CreateVolumesFromImageTest-871768967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:56:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9fbe8e6c-37fd-40b6-93ec-0b62c27183cf tempest-CreateVolumesFromImageTest-871768967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:48 devstack sudo[103597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:56:48 devstack sudo[103597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:48 devstack sudo[103597]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9fbe8e6c-37fd-40b6-93ec-0b62c27183cf tempest-CreateVolumesFromImageTest-871768967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.311s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:48 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-9fbe8e6c-37fd-40b6-93ec-0b62c27183cf tempest-CreateVolumesFromImageTest-871768967 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:56:48 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-9fbe8e6c-37fd-40b6-93ec-0b62c27183cf tempest-CreateVolumesFromImageTest-871768967 None] Deleted volume successfully.
Nov 06 11:56:48 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-9fbe8e6c-37fd-40b6-93ec-0b62c27183cf tempest-CreateVolumesFromImageTest-871768967 None] Lock "cinder-cc65f4f9-674f-45d7-b10a-38b2c69cb056-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:56:49 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-12f1c433-0dd5-40ed-808d-02d51a3c7eac tempest-CreateVolumesFromImageTest-871768967 None] Acquiring lock "cinder-6eea6afb-1cc7-4fb4-959d-8ee452313992-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:56:49 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-12f1c433-0dd5-40ed-808d-02d51a3c7eac tempest-CreateVolumesFromImageTest-871768967 None] Lock "cinder-6eea6afb-1cc7-4fb4-959d-8ee452313992-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:56:49 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-12f1c433-0dd5-40ed-808d-02d51a3c7eac tempest-CreateVolumesFromImageTest-871768967 None] Acquiring lock "cinder-quobyte-6eea6afb-1cc7-4fb4-959d-8ee452313992" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:56:49 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-12f1c433-0dd5-40ed-808d-02d51a3c7eac tempest-CreateVolumesFromImageTest-871768967 None] Lock "cinder-quobyte-6eea6afb-1cc7-4fb4-959d-8ee452313992" acquired by "delete_volume" :: waited 0.027s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:56:49 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea15d415-e0b8-4152-bbb9-ccf1ef548551]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:56:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-12f1c433-0dd5-40ed-808d-02d51a3c7eac tempest-CreateVolumesFromImageTest-871768967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6eea6afb-1cc7-4fb4-959d-8ee452313992 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:49 devstack sudo[103600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6eea6afb-1cc7-4fb4-959d-8ee452313992
Nov 06 11:56:49 devstack sudo[103600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:49 devstack sudo[103600]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-12f1c433-0dd5-40ed-808d-02d51a3c7eac tempest-CreateVolumesFromImageTest-871768967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6eea6afb-1cc7-4fb4-959d-8ee452313992" returned: 0 in 0.518s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-12f1c433-0dd5-40ed-808d-02d51a3c7eac tempest-CreateVolumesFromImageTest-871768967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6eea6afb-1cc7-4fb4-959d-8ee452313992 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:49 devstack sudo[103605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6eea6afb-1cc7-4fb4-959d-8ee452313992
Nov 06 11:56:49 devstack sudo[103605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:50 devstack sudo[103605]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-12f1c433-0dd5-40ed-808d-02d51a3c7eac tempest-CreateVolumesFromImageTest-871768967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6eea6afb-1cc7-4fb4-959d-8ee452313992" returned: 0 in 0.412s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:50 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-12f1c433-0dd5-40ed-808d-02d51a3c7eac tempest-CreateVolumesFromImageTest-871768967 None] Lock "cinder-quobyte-6eea6afb-1cc7-4fb4-959d-8ee452313992" released by "delete_volume" :: held 0.999s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:56:50 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-12f1c433-0dd5-40ed-808d-02d51a3c7eac tempest-CreateVolumesFromImageTest-871768967 None] Created reservations ['56abc8ca-8e2c-4133-8d9e-d1cab9104671', 'b6da817f-6574-47f1-96fe-a2e7c79ad059', '6d3aee55-74d2-4a48-9357-78777a3be3b7', '40eb109a-c975-45f5-8459-72413ab745ac'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:56:50 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1cfcf72-8b25-4fe2-9d0e-3a4a3aefa677 tempest-CinderUnicodeTest-829812763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:56:50 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a1cfcf72-8b25-4fe2-9d0e-3a4a3aefa677 tempest-CinderUnicodeTest-829812763 None] Flow 'volume_create_manager' (15fe0c22-462a-47b5-ba03-942097bf4719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:56:50 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a1cfcf72-8b25-4fe2-9d0e-3a4a3aefa677 tempest-CinderUnicodeTest-829812763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80b32793-ea38-42e2-bd9b-8c5760c484cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-12f1c433-0dd5-40ed-808d-02d51a3c7eac tempest-CreateVolumesFromImageTest-871768967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:56:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-12f1c433-0dd5-40ed-808d-02d51a3c7eac tempest-CreateVolumesFromImageTest-871768967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:56:50 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-12f1c433-0dd5-40ed-808d-02d51a3c7eac tempest-CreateVolumesFromImageTest-871768967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:56:50 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-12f1c433-0dd5-40ed-808d-02d51a3c7eac tempest-CreateVolumesFromImageTest-871768967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:56:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-12f1c433-0dd5-40ed-808d-02d51a3c7eac tempest-CreateVolumesFromImageTest-871768967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:56:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-12f1c433-0dd5-40ed-808d-02d51a3c7eac tempest-CreateVolumesFromImageTest-871768967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:50 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a1cfcf72-8b25-4fe2-9d0e-3a4a3aefa677 tempest-CinderUnicodeTest-829812763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80b32793-ea38-42e2-bd9b-8c5760c484cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2935532c-1b18-44de-87a9-4cf8d62e47f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c741fe12079b438c9ae6770bb195ec80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:50Z,use_quota=True,user_id='4840a78eb725419fb3c38893051bbd6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:50 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a1cfcf72-8b25-4fe2-9d0e-3a4a3aefa677 tempest-CinderUnicodeTest-829812763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5be2c665-739d-4240-809e-e94a2ec00d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:50 devstack sudo[103608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:56:50 devstack sudo[103608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:50 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a1cfcf72-8b25-4fe2-9d0e-3a4a3aefa677 tempest-CinderUnicodeTest-829812763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5be2c665-739d-4240-809e-e94a2ec00d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:50 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a1cfcf72-8b25-4fe2-9d0e-3a4a3aefa677 tempest-CinderUnicodeTest-829812763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36566ea6-6783-400b-ab2c-ea266e035528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:50 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a1cfcf72-8b25-4fe2-9d0e-3a4a3aefa677 tempest-CinderUnicodeTest-829812763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36566ea6-6783-400b-ab2c-ea266e035528) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2935532c-1b18-44de-87a9-4cf8d62e47f7', 'volume_name': 'volume-2935532c-1b18-44de-87a9-4cf8d62e47f7', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:50 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a1cfcf72-8b25-4fe2-9d0e-3a4a3aefa677 tempest-CinderUnicodeTest-829812763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f47bef96-c693-4239-920f-e4865c7432d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:50 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a1cfcf72-8b25-4fe2-9d0e-3a4a3aefa677 tempest-CinderUnicodeTest-829812763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f47bef96-c693-4239-920f-e4865c7432d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:50 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a1cfcf72-8b25-4fe2-9d0e-3a4a3aefa677 tempest-CinderUnicodeTest-829812763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1195402-b060-4c48-a9e6-1303da0edf3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:50 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-a1cfcf72-8b25-4fe2-9d0e-3a4a3aefa677 tempest-CinderUnicodeTest-829812763 None] Volume 2935532c-1b18-44de-87a9-4cf8d62e47f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2935532c-1b18-44de-87a9-4cf8d62e47f7', 'volume_size': 1}
Nov 06 11:56:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a1cfcf72-8b25-4fe2-9d0e-3a4a3aefa677 tempest-CinderUnicodeTest-829812763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:56:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a1cfcf72-8b25-4fe2-9d0e-3a4a3aefa677 tempest-CinderUnicodeTest-829812763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:56:50 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a1cfcf72-8b25-4fe2-9d0e-3a4a3aefa677 tempest-CinderUnicodeTest-829812763 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2935532c-1b18-44de-87a9-4cf8d62e47f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c741fe12079b438c9ae6770bb195ec80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:50Z,use_quota=True,user_id='4840a78eb725419fb3c38893051bbd6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:56:50 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-a1cfcf72-8b25-4fe2-9d0e-3a4a3aefa677 tempest-CinderUnicodeTest-829812763 None] Creating volume 2935532c-1b18-44de-87a9-4cf8d62e47f7 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:56:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a1cfcf72-8b25-4fe2-9d0e-3a4a3aefa677 tempest-CinderUnicodeTest-829812763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:56:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a1cfcf72-8b25-4fe2-9d0e-3a4a3aefa677 tempest-CinderUnicodeTest-829812763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:56:50 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a1cfcf72-8b25-4fe2-9d0e-3a4a3aefa677 tempest-CinderUnicodeTest-829812763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:56:50 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a1cfcf72-8b25-4fe2-9d0e-3a4a3aefa677 tempest-CinderUnicodeTest-829812763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:56:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a1cfcf72-8b25-4fe2-9d0e-3a4a3aefa677 tempest-CinderUnicodeTest-829812763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:56:50 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a1cfcf72-8b25-4fe2-9d0e-3a4a3aefa677 tempest-CinderUnicodeTest-829812763 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:56:50 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-a1cfcf72-8b25-4fe2-9d0e-3a4a3aefa677 tempest-CinderUnicodeTest-829812763 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:56:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a1cfcf72-8b25-4fe2-9d0e-3a4a3aefa677 tempest-CinderUnicodeTest-829812763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2935532c-1b18-44de-87a9-4cf8d62e47f7 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:50 devstack sudo[103610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2935532c-1b18-44de-87a9-4cf8d62e47f7 1073741824
Nov 06 11:56:50 devstack sudo[103610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:50 devstack sudo[103608]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-12f1c433-0dd5-40ed-808d-02d51a3c7eac tempest-CreateVolumesFromImageTest-871768967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.335s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:50 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-12f1c433-0dd5-40ed-808d-02d51a3c7eac tempest-CreateVolumesFromImageTest-871768967 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:56:50 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-12f1c433-0dd5-40ed-808d-02d51a3c7eac tempest-CreateVolumesFromImageTest-871768967 None] Deleted volume successfully.
Nov 06 11:56:50 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-12f1c433-0dd5-40ed-808d-02d51a3c7eac tempest-CreateVolumesFromImageTest-871768967 None] Lock "cinder-6eea6afb-1cc7-4fb4-959d-8ee452313992-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:56:51 devstack sudo[103610]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a1cfcf72-8b25-4fe2-9d0e-3a4a3aefa677 tempest-CinderUnicodeTest-829812763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2935532c-1b18-44de-87a9-4cf8d62e47f7 1073741824" returned: 0 in 0.557s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a1cfcf72-8b25-4fe2-9d0e-3a4a3aefa677 tempest-CinderUnicodeTest-829812763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2935532c-1b18-44de-87a9-4cf8d62e47f7 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:51 devstack sudo[103617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2935532c-1b18-44de-87a9-4cf8d62e47f7
Nov 06 11:56:51 devstack sudo[103617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:51 devstack sudo[103617]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a1cfcf72-8b25-4fe2-9d0e-3a4a3aefa677 tempest-CinderUnicodeTest-829812763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2935532c-1b18-44de-87a9-4cf8d62e47f7" returned: 0 in 0.299s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:51 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a1cfcf72-8b25-4fe2-9d0e-3a4a3aefa677 tempest-CinderUnicodeTest-829812763 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:56:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a1cfcf72-8b25-4fe2-9d0e-3a4a3aefa677 tempest-CinderUnicodeTest-829812763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:56:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a1cfcf72-8b25-4fe2-9d0e-3a4a3aefa677 tempest-CinderUnicodeTest-829812763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1195402-b060-4c48-a9e6-1303da0edf3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2935532c-1b18-44de-87a9-4cf8d62e47f7', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a1cfcf72-8b25-4fe2-9d0e-3a4a3aefa677 tempest-CinderUnicodeTest-829812763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92d6ba4e-d88d-48a3-bf8e-ede5ac5956c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:51 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-a1cfcf72-8b25-4fe2-9d0e-3a4a3aefa677 tempest-CinderUnicodeTest-829812763 None] Volume volume-2935532c-1b18-44de-87a9-4cf8d62e47f7 (2935532c-1b18-44de-87a9-4cf8d62e47f7): created successfully
Nov 06 11:56:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a1cfcf72-8b25-4fe2-9d0e-3a4a3aefa677 tempest-CinderUnicodeTest-829812763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92d6ba4e-d88d-48a3-bf8e-ede5ac5956c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a1cfcf72-8b25-4fe2-9d0e-3a4a3aefa677 tempest-CinderUnicodeTest-829812763 None] Flow 'volume_create_manager' (15fe0c22-462a-47b5-ba03-942097bf4719) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:56:51 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-a1cfcf72-8b25-4fe2-9d0e-3a4a3aefa677 tempest-CinderUnicodeTest-829812763 None] Created volume successfully.
Nov 06 11:56:53 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b38712b-2cc6-4fba-a6b1-4f25777dbe81 tempest-CinderUnicodeTest-829812763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:56:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8b38712b-2cc6-4fba-a6b1-4f25777dbe81 tempest-CinderUnicodeTest-829812763 None] Flow 'volume_create_manager' (217ef9da-2f17-4257-a4cb-6b4c6effa5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:56:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8b38712b-2cc6-4fba-a6b1-4f25777dbe81 tempest-CinderUnicodeTest-829812763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4198055-afeb-44b0-848b-533f7a400f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8b38712b-2cc6-4fba-a6b1-4f25777dbe81 tempest-CinderUnicodeTest-829812763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4198055-afeb-44b0-848b-533f7a400f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:56:53Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1923846160',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9262222-5e2c-4d24-b891-390c004039ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c741fe12079b438c9ae6770bb195ec80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:53Z,use_quota=True,user_id='4840a78eb725419fb3c38893051bbd6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8b38712b-2cc6-4fba-a6b1-4f25777dbe81 tempest-CinderUnicodeTest-829812763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ab4ff4e-e0d4-431f-98e0-af6b37269dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8b38712b-2cc6-4fba-a6b1-4f25777dbe81 tempest-CinderUnicodeTest-829812763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ab4ff4e-e0d4-431f-98e0-af6b37269dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8b38712b-2cc6-4fba-a6b1-4f25777dbe81 tempest-CinderUnicodeTest-829812763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1cc0c1c-5a69-4636-872e-da2d84585341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8b38712b-2cc6-4fba-a6b1-4f25777dbe81 tempest-CinderUnicodeTest-829812763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1cc0c1c-5a69-4636-872e-da2d84585341) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9262222-5e2c-4d24-b891-390c004039ab', 'volume_name': 'volume-e9262222-5e2c-4d24-b891-390c004039ab', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8b38712b-2cc6-4fba-a6b1-4f25777dbe81 tempest-CinderUnicodeTest-829812763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95a3b874-dcb7-4507-8ad4-c0f4c332023b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8b38712b-2cc6-4fba-a6b1-4f25777dbe81 tempest-CinderUnicodeTest-829812763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95a3b874-dcb7-4507-8ad4-c0f4c332023b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8b38712b-2cc6-4fba-a6b1-4f25777dbe81 tempest-CinderUnicodeTest-829812763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ae85f02-f3f2-4c80-9f13-05973698988a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:53 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-8b38712b-2cc6-4fba-a6b1-4f25777dbe81 tempest-CinderUnicodeTest-829812763 None] Volume e9262222-5e2c-4d24-b891-390c004039ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9262222-5e2c-4d24-b891-390c004039ab', 'volume_size': 1}
Nov 06 11:56:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-8b38712b-2cc6-4fba-a6b1-4f25777dbe81 tempest-CinderUnicodeTest-829812763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:56:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-8b38712b-2cc6-4fba-a6b1-4f25777dbe81 tempest-CinderUnicodeTest-829812763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:56:53 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-8b38712b-2cc6-4fba-a6b1-4f25777dbe81 tempest-CinderUnicodeTest-829812763 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:56:53Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1923846160',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9262222-5e2c-4d24-b891-390c004039ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c741fe12079b438c9ae6770bb195ec80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:53Z,use_quota=True,user_id='4840a78eb725419fb3c38893051bbd6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:56:53 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-8b38712b-2cc6-4fba-a6b1-4f25777dbe81 tempest-CinderUnicodeTest-829812763 None] Creating volume e9262222-5e2c-4d24-b891-390c004039ab {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:56:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-8b38712b-2cc6-4fba-a6b1-4f25777dbe81 tempest-CinderUnicodeTest-829812763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:56:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-8b38712b-2cc6-4fba-a6b1-4f25777dbe81 tempest-CinderUnicodeTest-829812763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:56:53 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-8b38712b-2cc6-4fba-a6b1-4f25777dbe81 tempest-CinderUnicodeTest-829812763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:56:53 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-8b38712b-2cc6-4fba-a6b1-4f25777dbe81 tempest-CinderUnicodeTest-829812763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:56:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-8b38712b-2cc6-4fba-a6b1-4f25777dbe81 tempest-CinderUnicodeTest-829812763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:56:53 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-8b38712b-2cc6-4fba-a6b1-4f25777dbe81 tempest-CinderUnicodeTest-829812763 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:56:53 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-8b38712b-2cc6-4fba-a6b1-4f25777dbe81 tempest-CinderUnicodeTest-829812763 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:56:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-8b38712b-2cc6-4fba-a6b1-4f25777dbe81 tempest-CinderUnicodeTest-829812763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e9262222-5e2c-4d24-b891-390c004039ab 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:53 devstack sudo[103620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e9262222-5e2c-4d24-b891-390c004039ab 1073741824
Nov 06 11:56:53 devstack sudo[103620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:54 devstack sudo[103620]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-8b38712b-2cc6-4fba-a6b1-4f25777dbe81 tempest-CinderUnicodeTest-829812763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e9262222-5e2c-4d24-b891-390c004039ab 1073741824" returned: 0 in 0.601s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-8b38712b-2cc6-4fba-a6b1-4f25777dbe81 tempest-CinderUnicodeTest-829812763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e9262222-5e2c-4d24-b891-390c004039ab {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:54 devstack sudo[103627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e9262222-5e2c-4d24-b891-390c004039ab
Nov 06 11:56:54 devstack sudo[103627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:54 devstack sudo[103627]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:54 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:56:54 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Flow 'volume_create_manager' (a18c070c-4d11-4e89-b6a7-cd8b22a27306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:56:54 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0c28a0f-0951-4829-a99a-4faa408c7e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-8b38712b-2cc6-4fba-a6b1-4f25777dbe81 tempest-CinderUnicodeTest-829812763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e9262222-5e2c-4d24-b891-390c004039ab" returned: 0 in 0.352s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:54 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-8b38712b-2cc6-4fba-a6b1-4f25777dbe81 tempest-CinderUnicodeTest-829812763 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:56:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-8b38712b-2cc6-4fba-a6b1-4f25777dbe81 tempest-CinderUnicodeTest-829812763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:56:54 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0c28a0f-0951-4829-a99a-4faa408c7e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=474bd392-c1b0-4082-aef6-d5105c5b48df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc24e4991e7b44869abcca6924ba492c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:54Z,use_quota=True,user_id='6e56252c89684af3ba1b31b1c40ed03b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ed43e64-2d45-42c0-82b3-607bf3fdee0a),volume_type_id=8ed43e64-2d45-42c0-82b3-607bf3fdee0a)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:54 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56c4e8bd-c95a-459c-aa18-a540591d5658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:54 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56c4e8bd-c95a-459c-aa18-a540591d5658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:54 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96e12edd-4d6b-4712-8ba4-d41015f0244c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:54 devstack cinder-volume[87165]: DEBUG cinder.image.glance [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Creating Keystone auth plugin from conf {{(pid=87165) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 06 11:56:54 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8b38712b-2cc6-4fba-a6b1-4f25777dbe81 tempest-CinderUnicodeTest-829812763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ae85f02-f3f2-4c80-9f13-05973698988a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9262222-5e2c-4d24-b891-390c004039ab', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:54 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8b38712b-2cc6-4fba-a6b1-4f25777dbe81 tempest-CinderUnicodeTest-829812763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18aa662f-8624-4f3e-add5-28b8905d2be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:54 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-8b38712b-2cc6-4fba-a6b1-4f25777dbe81 tempest-CinderUnicodeTest-829812763 None] Volume volume-e9262222-5e2c-4d24-b891-390c004039ab (e9262222-5e2c-4d24-b891-390c004039ab): created successfully
Nov 06 11:56:54 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8b38712b-2cc6-4fba-a6b1-4f25777dbe81 tempest-CinderUnicodeTest-829812763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18aa662f-8624-4f3e-add5-28b8905d2be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:54 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8b38712b-2cc6-4fba-a6b1-4f25777dbe81 tempest-CinderUnicodeTest-829812763 None] Flow 'volume_create_manager' (217ef9da-2f17-4257-a4cb-6b4c6effa5e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:56:54 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-8b38712b-2cc6-4fba-a6b1-4f25777dbe81 tempest-CinderUnicodeTest-829812763 None] Created volume successfully.
Nov 06 11:56:54 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96e12edd-4d6b-4712-8ba4-d41015f0244c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '474bd392-c1b0-4082-aef6-d5105c5b48df', 'volume_name': 'volume-474bd392-c1b0-4082-aef6-d5105c5b48df', 'volume_size': 1, 'image_id': 'cbd638b6-97f5-4069-b9d0-ba85f6f08bef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cbd638b6-97f5-4069-b9d0-ba85f6f08bef', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '43a7470b11c59ac0329db571f499d7d9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bc24e4991e7b44869abcca6924ba492c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2cd8a9c5e1e3409453e5cdc3e94f1569f1564786af425030ee65c536a12cd40b36ccc92087b7763b284d1e30c9c1b7a1c090626700b78090c29ee343786e7bcb', 'id': 'cbd638b6-97f5-4069-b9d0-ba85f6f08bef', 'created_at': datetime.datetime(2026, 11, 6, 10, 56, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 10, 56, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cbd638b6-97f5-4069-b9d0-ba85f6f08bef/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x742c1e0637a0>}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:54 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3ba998d-f9e7-4cca-a7eb-16c8d4e896f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:54 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3ba998d-f9e7-4cca-a7eb-16c8d4e896f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:54 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87b23454-65d3-4218-9b56-794b3e0f150c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:54 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Volume 474bd392-c1b0-4082-aef6-d5105c5b48df: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-474bd392-c1b0-4082-aef6-d5105c5b48df', 'volume_size': 1, 'image_id': 'cbd638b6-97f5-4069-b9d0-ba85f6f08bef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cbd638b6-97f5-4069-b9d0-ba85f6f08bef', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '43a7470b11c59ac0329db571f499d7d9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bc24e4991e7b44869abcca6924ba492c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2cd8a9c5e1e3409453e5cdc3e94f1569f1564786af425030ee65c536a12cd40b36ccc92087b7763b284d1e30c9c1b7a1c090626700b78090c29ee343786e7bcb', 'id': 'cbd638b6-97f5-4069-b9d0-ba85f6f08bef', 'created_at': datetime.datetime(2026, 11, 6, 10, 56, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 10, 56, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cbd638b6-97f5-4069-b9d0-ba85f6f08bef/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x742c1e0637a0>}
Nov 06 11:56:54 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Trying to clone 474bd392-c1b0-4082-aef6-d5105c5b48df from image cbd638b6-97f5-4069-b9d0-ba85f6f08bef at location (None, [{'url': 'file:///opt/stack/data/glance/images/cbd638b6-97f5-4069-b9d0-ba85f6f08bef', 'metadata': {}}]). {{(pid=87165) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 06 11:56:55 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cbd638b6-97f5-4069-b9d0-ba85f6f08bef_ix4xn1ikdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87165) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 06 11:56:55 devstack cinder-volume[87165]: INFO cinder.image.image_utils [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Image download 0.00 MB at 0.00 MB/s
Nov 06 11:56:55 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f637325-1867-491e-aba0-adf0b0870b32]: (4, 'raw') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:56:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cbd638b6-97f5-4069-b9d0-ba85f6f08bef_ix4xn1ikdevstack@QuobyteHD {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:55 devstack sudo[103631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cbd638b6-97f5-4069-b9d0-ba85f6f08bef_ix4xn1ikdevstack@QuobyteHD
Nov 06 11:56:55 devstack sudo[103631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:55 devstack sudo[103631]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cbd638b6-97f5-4069-b9d0-ba85f6f08bef_ix4xn1ikdevstack@QuobyteHD" returned: 0 in 0.378s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cbd638b6-97f5-4069-b9d0-ba85f6f08bef_ix4xn1ikdevstack@QuobyteHD {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:55 devstack sudo[103635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cbd638b6-97f5-4069-b9d0-ba85f6f08bef_ix4xn1ikdevstack@QuobyteHD
Nov 06 11:56:55 devstack sudo[103635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:55 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-10665291-f20a-458d-89bc-09d9b8e9d211 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:56:55 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-10665291-f20a-458d-89bc-09d9b8e9d211 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Flow 'volume_create_manager' (2e8027a5-e90e-441b-88c1-225ab07ce768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:56:55 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-10665291-f20a-458d-89bc-09d9b8e9d211 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b46bb96-a2e7-4538-8033-0c68921be1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:55 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-10665291-f20a-458d-89bc-09d9b8e9d211 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b46bb96-a2e7-4538-8033-0c68921be1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-830693227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93b92557-830a-4739-91d4-14295dcf6c9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b36f6e16bd8b46e8a04df79adacb0274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:56Z,use_quota=True,user_id='239c3ab7fc82447195336a54200210b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:55 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-10665291-f20a-458d-89bc-09d9b8e9d211 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82f5ab48-cb36-40a9-a435-5cd570dbed3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:55 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-10665291-f20a-458d-89bc-09d9b8e9d211 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82f5ab48-cb36-40a9-a435-5cd570dbed3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:55 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-10665291-f20a-458d-89bc-09d9b8e9d211 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61d3574c-e693-4dc8-946a-0674a7526e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:55 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-10665291-f20a-458d-89bc-09d9b8e9d211 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61d3574c-e693-4dc8-946a-0674a7526e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93b92557-830a-4739-91d4-14295dcf6c9e', 'volume_name': 'volume-93b92557-830a-4739-91d4-14295dcf6c9e', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:55 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-10665291-f20a-458d-89bc-09d9b8e9d211 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e45c9770-9231-47c7-a3cc-11b6950ba594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:55 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-10665291-f20a-458d-89bc-09d9b8e9d211 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e45c9770-9231-47c7-a3cc-11b6950ba594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:55 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-10665291-f20a-458d-89bc-09d9b8e9d211 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (804ba299-e964-4189-87cf-03794010fe8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:55 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-10665291-f20a-458d-89bc-09d9b8e9d211 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Volume 93b92557-830a-4739-91d4-14295dcf6c9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93b92557-830a-4739-91d4-14295dcf6c9e', 'volume_size': 1}
Nov 06 11:56:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-10665291-f20a-458d-89bc-09d9b8e9d211 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:56:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-10665291-f20a-458d-89bc-09d9b8e9d211 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:56:55 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-10665291-f20a-458d-89bc-09d9b8e9d211 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-830693227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93b92557-830a-4739-91d4-14295dcf6c9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b36f6e16bd8b46e8a04df79adacb0274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:56Z,use_quota=True,user_id='239c3ab7fc82447195336a54200210b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:56:55 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-10665291-f20a-458d-89bc-09d9b8e9d211 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Creating volume 93b92557-830a-4739-91d4-14295dcf6c9e {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:56:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-10665291-f20a-458d-89bc-09d9b8e9d211 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:56:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-10665291-f20a-458d-89bc-09d9b8e9d211 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:56:55 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-10665291-f20a-458d-89bc-09d9b8e9d211 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:56:55 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-10665291-f20a-458d-89bc-09d9b8e9d211 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:56:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-10665291-f20a-458d-89bc-09d9b8e9d211 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:56:55 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-10665291-f20a-458d-89bc-09d9b8e9d211 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:56:55 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-10665291-f20a-458d-89bc-09d9b8e9d211 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:56:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-10665291-f20a-458d-89bc-09d9b8e9d211 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-93b92557-830a-4739-91d4-14295dcf6c9e 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:55 devstack sudo[103637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-93b92557-830a-4739-91d4-14295dcf6c9e 1073741824
Nov 06 11:56:55 devstack sudo[103637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:55 devstack sudo[103635]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cbd638b6-97f5-4069-b9d0-ba85f6f08bef_ix4xn1ikdevstack@QuobyteHD" returned: 1 in 0.430s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cbd638b6-97f5-4069-b9d0-ba85f6f08bef_ix4xn1ikdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 11:56:55 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Temporary image cbd638b6-97f5-4069-b9d0-ba85f6f08bef is fetched for user 6e56252c89684af3ba1b31b1c40ed03b. {{(pid=87165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 06 11:56:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-1766fdee-454b-43e1-877b-15a5c4b85988 tempest-CinderUnicodeTest-829812763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:56:56 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d98eef-f331-455d-93c4-2e9b4292b35f]: (4, 'raw') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:56:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cbd638b6-97f5-4069-b9d0-ba85f6f08bef_ix4xn1ikdevstack@QuobyteHD {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:56 devstack sudo[103643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cbd638b6-97f5-4069-b9d0-ba85f6f08bef_ix4xn1ikdevstack@QuobyteHD
Nov 06 11:56:56 devstack sudo[103643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:56 devstack sudo[103637]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-10665291-f20a-458d-89bc-09d9b8e9d211 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-93b92557-830a-4739-91d4-14295dcf6c9e 1073741824" returned: 0 in 0.558s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-10665291-f20a-458d-89bc-09d9b8e9d211 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-93b92557-830a-4739-91d4-14295dcf6c9e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:56 devstack sudo[103650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-93b92557-830a-4739-91d4-14295dcf6c9e
Nov 06 11:56:56 devstack sudo[103650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:56 devstack sudo[103643]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cbd638b6-97f5-4069-b9d0-ba85f6f08bef_ix4xn1ikdevstack@QuobyteHD" returned: 0 in 0.409s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cbd638b6-97f5-4069-b9d0-ba85f6f08bef_ix4xn1ikdevstack@QuobyteHD {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:56 devstack sudo[103652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cbd638b6-97f5-4069-b9d0-ba85f6f08bef_ix4xn1ikdevstack@QuobyteHD
Nov 06 11:56:56 devstack sudo[103652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:56 devstack sudo[103650]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-10665291-f20a-458d-89bc-09d9b8e9d211 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-93b92557-830a-4739-91d4-14295dcf6c9e" returned: 0 in 0.296s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:56 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-10665291-f20a-458d-89bc-09d9b8e9d211 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:56:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-10665291-f20a-458d-89bc-09d9b8e9d211 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:56:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-1766fdee-454b-43e1-877b-15a5c4b85988 tempest-CinderUnicodeTest-829812763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.699s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:56:56 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-10665291-f20a-458d-89bc-09d9b8e9d211 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (804ba299-e964-4189-87cf-03794010fe8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93b92557-830a-4739-91d4-14295dcf6c9e', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:56 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-10665291-f20a-458d-89bc-09d9b8e9d211 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80001ea9-0aba-4a7c-97f2-ed9ac554967f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:56 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-1766fdee-454b-43e1-877b-15a5c4b85988 tempest-CinderUnicodeTest-829812763 None] Creating offline snapshot b45f127f-4bd6-48a4-9517-967cad6dc4e9 of volume e9262222-5e2c-4d24-b891-390c004039ab {{(pid=87165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 11:56:56 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-10665291-f20a-458d-89bc-09d9b8e9d211 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Volume volume-93b92557-830a-4739-91d4-14295dcf6c9e (93b92557-830a-4739-91d4-14295dcf6c9e): created successfully
Nov 06 11:56:56 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-10665291-f20a-458d-89bc-09d9b8e9d211 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80001ea9-0aba-4a7c-97f2-ed9ac554967f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:56 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-10665291-f20a-458d-89bc-09d9b8e9d211 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Flow 'volume_create_manager' (2e8027a5-e90e-441b-88c1-225ab07ce768) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:56:56 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[364c4b8c-17c9-45bc-b387-35e850296ca8]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:56:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1766fdee-454b-43e1-877b-15a5c4b85988 tempest-CinderUnicodeTest-829812763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e9262222-5e2c-4d24-b891-390c004039ab {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:56 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-10665291-f20a-458d-89bc-09d9b8e9d211 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Created volume successfully.
Nov 06 11:56:56 devstack sudo[103655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e9262222-5e2c-4d24-b891-390c004039ab
Nov 06 11:56:56 devstack sudo[103655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:56 devstack sudo[103652]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cbd638b6-97f5-4069-b9d0-ba85f6f08bef_ix4xn1ikdevstack@QuobyteHD" returned: 1 in 0.490s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cbd638b6-97f5-4069-b9d0-ba85f6f08bef_ix4xn1ikdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 11:56:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:56:57 devstack sudo[103655]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1766fdee-454b-43e1-877b-15a5c4b85988 tempest-CinderUnicodeTest-829812763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e9262222-5e2c-4d24-b891-390c004039ab" returned: 0 in 0.410s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1766fdee-454b-43e1-877b-15a5c4b85988 tempest-CinderUnicodeTest-829812763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e9262222-5e2c-4d24-b891-390c004039ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e9262222-5e2c-4d24-b891-390c004039ab.b45f127f-4bd6-48a4-9517-967cad6dc4e9 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:57 devstack sudo[103663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e9262222-5e2c-4d24-b891-390c004039ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e9262222-5e2c-4d24-b891-390c004039ab.b45f127f-4bd6-48a4-9517-967cad6dc4e9 1G
Nov 06 11:56:57 devstack sudo[103663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:57 devstack sudo[103663]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1766fdee-454b-43e1-877b-15a5c4b85988 tempest-CinderUnicodeTest-829812763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e9262222-5e2c-4d24-b891-390c004039ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e9262222-5e2c-4d24-b891-390c004039ab.b45f127f-4bd6-48a4-9517-967cad6dc4e9 1G" returned: 0 in 0.411s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1766fdee-454b-43e1-877b-15a5c4b85988 tempest-CinderUnicodeTest-829812763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9262222-5e2c-4d24-b891-390c004039ab -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e9262222-5e2c-4d24-b891-390c004039ab.b45f127f-4bd6-48a4-9517-967cad6dc4e9 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:57 devstack sudo[103669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9262222-5e2c-4d24-b891-390c004039ab -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e9262222-5e2c-4d24-b891-390c004039ab.b45f127f-4bd6-48a4-9517-967cad6dc4e9
Nov 06 11:56:57 devstack sudo[103669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:57 devstack sudo[103669]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1766fdee-454b-43e1-877b-15a5c4b85988 tempest-CinderUnicodeTest-829812763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9262222-5e2c-4d24-b891-390c004039ab -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e9262222-5e2c-4d24-b891-390c004039ab.b45f127f-4bd6-48a4-9517-967cad6dc4e9" returned: 0 in 0.342s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:57 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-1766fdee-454b-43e1-877b-15a5c4b85988 tempest-CinderUnicodeTest-829812763 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e9262222-5e2c-4d24-b891-390c004039ab.b45f127f-4bd6-48a4-9517-967cad6dc4e9 is being set with open permissions: ugo+rw
Nov 06 11:56:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1766fdee-454b-43e1-877b-15a5c4b85988 tempest-CinderUnicodeTest-829812763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e9262222-5e2c-4d24-b891-390c004039ab.b45f127f-4bd6-48a4-9517-967cad6dc4e9 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:58 devstack sudo[103675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e9262222-5e2c-4d24-b891-390c004039ab.b45f127f-4bd6-48a4-9517-967cad6dc4e9
Nov 06 11:56:58 devstack sudo[103675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:58 devstack sudo[103675]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1766fdee-454b-43e1-877b-15a5c4b85988 tempest-CinderUnicodeTest-829812763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e9262222-5e2c-4d24-b891-390c004039ab.b45f127f-4bd6-48a4-9517-967cad6dc4e9" returned: 0 in 0.279s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1766fdee-454b-43e1-877b-15a5c4b85988 tempest-CinderUnicodeTest-829812763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e9262222-5e2c-4d24-b891-390c004039ab.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:58 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-180e64d9-fc37-4a6e-8964-45a008938db6 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:56:58 devstack sudo[103678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e9262222-5e2c-4d24-b891-390c004039ab.info
Nov 06 11:56:58 devstack sudo[103678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:58 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-180e64d9-fc37-4a6e-8964-45a008938db6 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Flow 'volume_create_manager' (ddbfaa05-5995-471c-a213-3cb14b4afa8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:56:58 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-180e64d9-fc37-4a6e-8964-45a008938db6 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07cb1e27-ba7e-4df9-902d-1b7d840bfa0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:58 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-180e64d9-fc37-4a6e-8964-45a008938db6 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07cb1e27-ba7e-4df9-902d-1b7d840bfa0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-623542671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=331f9373-e8e8-4267-a039-9136a0cda045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b36f6e16bd8b46e8a04df79adacb0274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:58Z,use_quota=True,user_id='239c3ab7fc82447195336a54200210b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:58 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-180e64d9-fc37-4a6e-8964-45a008938db6 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbe3c0ac-1a95-4b57-85c9-92e4a9a08091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:58 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-180e64d9-fc37-4a6e-8964-45a008938db6 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbe3c0ac-1a95-4b57-85c9-92e4a9a08091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:58 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-180e64d9-fc37-4a6e-8964-45a008938db6 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89e9ea21-01e3-4974-8fd4-7315f8544c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:58 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-180e64d9-fc37-4a6e-8964-45a008938db6 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89e9ea21-01e3-4974-8fd4-7315f8544c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '331f9373-e8e8-4267-a039-9136a0cda045', 'volume_name': 'volume-331f9373-e8e8-4267-a039-9136a0cda045', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:58 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-180e64d9-fc37-4a6e-8964-45a008938db6 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1dd2192-4a34-472c-a671-f5d60dbffb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:58 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-180e64d9-fc37-4a6e-8964-45a008938db6 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1dd2192-4a34-472c-a671-f5d60dbffb51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:58 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-180e64d9-fc37-4a6e-8964-45a008938db6 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb39d76e-4061-4698-bdf1-fe4d0d656406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:58 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-180e64d9-fc37-4a6e-8964-45a008938db6 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Volume 331f9373-e8e8-4267-a039-9136a0cda045: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-331f9373-e8e8-4267-a039-9136a0cda045', 'volume_size': 1}
Nov 06 11:56:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-180e64d9-fc37-4a6e-8964-45a008938db6 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:56:58 devstack sudo[103678]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1766fdee-454b-43e1-877b-15a5c4b85988 tempest-CinderUnicodeTest-829812763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e9262222-5e2c-4d24-b891-390c004039ab.info" returned: 0 in 0.387s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:58 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-1766fdee-454b-43e1-877b-15a5c4b85988 tempest-CinderUnicodeTest-829812763 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e9262222-5e2c-4d24-b891-390c004039ab.info is being set with open permissions: ugo+rw
Nov 06 11:56:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1766fdee-454b-43e1-877b-15a5c4b85988 tempest-CinderUnicodeTest-829812763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e9262222-5e2c-4d24-b891-390c004039ab.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:58 devstack sudo[103681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e9262222-5e2c-4d24-b891-390c004039ab.info
Nov 06 11:56:58 devstack sudo[103681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:58 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e23901a-6ef4-49a9-b0c4-27e3513e62cf tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:56:58 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9e23901a-6ef4-49a9-b0c4-27e3513e62cf tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Flow 'volume_create_manager' (88b0791d-d5ff-494a-8469-6570259cf07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:56:58 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9e23901a-6ef4-49a9-b0c4-27e3513e62cf tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1afc5d6-5d60-476b-b258-203a54d5eca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:58 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9e23901a-6ef4-49a9-b0c4-27e3513e62cf tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1afc5d6-5d60-476b-b258-203a54d5eca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1442479702',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=325bea40-a2ff-4406-b6d8-ea95357ed527,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b36f6e16bd8b46e8a04df79adacb0274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:59Z,use_quota=True,user_id='239c3ab7fc82447195336a54200210b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:58 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9e23901a-6ef4-49a9-b0c4-27e3513e62cf tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46fff1ff-0ad5-404c-ba88-a893d2cfbdd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:58 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9e23901a-6ef4-49a9-b0c4-27e3513e62cf tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46fff1ff-0ad5-404c-ba88-a893d2cfbdd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:58 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9e23901a-6ef4-49a9-b0c4-27e3513e62cf tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e555f930-fc08-438f-8590-b51308a561bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:58 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9e23901a-6ef4-49a9-b0c4-27e3513e62cf tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e555f930-fc08-438f-8590-b51308a561bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '325bea40-a2ff-4406-b6d8-ea95357ed527', 'volume_name': 'volume-325bea40-a2ff-4406-b6d8-ea95357ed527', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:58 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9e23901a-6ef4-49a9-b0c4-27e3513e62cf tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3f67f7a-eaaf-429c-9c4d-9dad5b71643a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:58 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9e23901a-6ef4-49a9-b0c4-27e3513e62cf tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3f67f7a-eaaf-429c-9c4d-9dad5b71643a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:58 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9e23901a-6ef4-49a9-b0c4-27e3513e62cf tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f790697-8a32-4991-8576-c89e0695e07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:58 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-9e23901a-6ef4-49a9-b0c4-27e3513e62cf tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Volume 325bea40-a2ff-4406-b6d8-ea95357ed527: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-325bea40-a2ff-4406-b6d8-ea95357ed527', 'volume_size': 1}
Nov 06 11:56:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9e23901a-6ef4-49a9-b0c4-27e3513e62cf tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:56:59 devstack sudo[103681]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1766fdee-454b-43e1-877b-15a5c4b85988 tempest-CinderUnicodeTest-829812763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e9262222-5e2c-4d24-b891-390c004039ab.info" returned: 0 in 0.428s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-1766fdee-454b-43e1-877b-15a5c4b85988 tempest-CinderUnicodeTest-829812763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.429s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:56:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.203s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:56:59 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=474bd392-c1b0-4082-aef6-d5105c5b48df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc24e4991e7b44869abcca6924ba492c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:54Z,use_quota=True,user_id='6e56252c89684af3ba1b31b1c40ed03b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ed43e64-2d45-42c0-82b3-607bf3fdee0a),volume_type_id=8ed43e64-2d45-42c0-82b3-607bf3fdee0a)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:56:59 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Creating volume 474bd392-c1b0-4082-aef6-d5105c5b48df {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:56:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:56:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:56:59 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:56:59 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:56:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:56:59 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:56:59 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:56:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-474bd392-c1b0-4082-aef6-d5105c5b48df 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:59 devstack sudo[103684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-474bd392-c1b0-4082-aef6-d5105c5b48df 1073741824
Nov 06 11:56:59 devstack sudo[103684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:56:59 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-1766fdee-454b-43e1-877b-15a5c4b85988 tempest-CinderUnicodeTest-829812763 None] Create snapshot completed successfully
Nov 06 11:56:59 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c9fdd2f-4ada-4f97-a512-c482c5403325 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:56:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4c9fdd2f-4ada-4f97-a512-c482c5403325 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Flow 'volume_create_manager' (27a2cbdd-8bf4-4d84-bdcd-38155f0e81b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:56:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4c9fdd2f-4ada-4f97-a512-c482c5403325 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ca1d786-e319-4b1e-afcf-64c967d16e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4c9fdd2f-4ada-4f97-a512-c482c5403325 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ca1d786-e319-4b1e-afcf-64c967d16e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-267165348',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f79a85cf-1f1b-4f00-988d-d1896df97cfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b36f6e16bd8b46e8a04df79adacb0274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:59Z,use_quota=True,user_id='239c3ab7fc82447195336a54200210b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4c9fdd2f-4ada-4f97-a512-c482c5403325 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23590243-9bb7-4692-bbb3-49b5bfe1ad4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4c9fdd2f-4ada-4f97-a512-c482c5403325 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23590243-9bb7-4692-bbb3-49b5bfe1ad4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4c9fdd2f-4ada-4f97-a512-c482c5403325 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cc24c21-6584-41e0-8041-c03f1b5a984e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4c9fdd2f-4ada-4f97-a512-c482c5403325 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cc24c21-6584-41e0-8041-c03f1b5a984e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f79a85cf-1f1b-4f00-988d-d1896df97cfb', 'volume_name': 'volume-f79a85cf-1f1b-4f00-988d-d1896df97cfb', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4c9fdd2f-4ada-4f97-a512-c482c5403325 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af92864d-83aa-4b23-b879-132612c6c468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4c9fdd2f-4ada-4f97-a512-c482c5403325 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af92864d-83aa-4b23-b879-132612c6c468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4c9fdd2f-4ada-4f97-a512-c482c5403325 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d06a80a-660e-41d1-b3dc-d6ad5348945d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:59 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-4c9fdd2f-4ada-4f97-a512-c482c5403325 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Volume f79a85cf-1f1b-4f00-988d-d1896df97cfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f79a85cf-1f1b-4f00-988d-d1896df97cfb', 'volume_size': 1}
Nov 06 11:56:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4c9fdd2f-4ada-4f97-a512-c482c5403325 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:56:59 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c474281-adb1-4d26-b37a-70c5e3a19cd8 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:56:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5c474281-adb1-4d26-b37a-70c5e3a19cd8 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Flow 'volume_create_manager' (a7522f83-681c-44aa-a856-20c33e2ded05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:56:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5c474281-adb1-4d26-b37a-70c5e3a19cd8 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d846ac66-b6d6-4310-b0d3-dd35910c828d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:59 devstack sudo[103684]: pam_unix(sudo:session): session closed for user root
Nov 06 11:56:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-474bd392-c1b0-4082-aef6-d5105c5b48df 1073741824" returned: 0 in 0.559s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:56:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5c474281-adb1-4d26-b37a-70c5e3a19cd8 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d846ac66-b6d6-4310-b0d3-dd35910c828d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-352765967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc7e5da6-d0e3-4a25-921d-3544e3f22026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b36f6e16bd8b46e8a04df79adacb0274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:57:00Z,use_quota=True,user_id='239c3ab7fc82447195336a54200210b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5c474281-adb1-4d26-b37a-70c5e3a19cd8 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (465625a0-46fe-4d05-8d64-2be345ab32be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5c474281-adb1-4d26-b37a-70c5e3a19cd8 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (465625a0-46fe-4d05-8d64-2be345ab32be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5c474281-adb1-4d26-b37a-70c5e3a19cd8 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (458326b4-1f8d-4263-ab47-fa600d53fca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5c474281-adb1-4d26-b37a-70c5e3a19cd8 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (458326b4-1f8d-4263-ab47-fa600d53fca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc7e5da6-d0e3-4a25-921d-3544e3f22026', 'volume_name': 'volume-fc7e5da6-d0e3-4a25-921d-3544e3f22026', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5c474281-adb1-4d26-b37a-70c5e3a19cd8 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a359b882-e9a0-453d-838d-1386bd3f2bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5c474281-adb1-4d26-b37a-70c5e3a19cd8 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a359b882-e9a0-453d-838d-1386bd3f2bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:56:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5c474281-adb1-4d26-b37a-70c5e3a19cd8 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (761dc616-4868-455b-824f-3f513902fd22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:56:59 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-5c474281-adb1-4d26-b37a-70c5e3a19cd8 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Volume fc7e5da6-d0e3-4a25-921d-3544e3f22026: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc7e5da6-d0e3-4a25-921d-3544e3f22026', 'volume_size': 1}
Nov 06 11:56:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5c474281-adb1-4d26-b37a-70c5e3a19cd8 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:56:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-474bd392-c1b0-4082-aef6-d5105c5b48df {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:56:59 devstack sudo[103690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-474bd392-c1b0-4082-aef6-d5105c5b48df
Nov 06 11:56:59 devstack sudo[103690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:00 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f5c221a-ea76-48b8-bd8e-cc61ccba5b69 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:57:00 devstack sudo[103690]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:00 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9f5c221a-ea76-48b8-bd8e-cc61ccba5b69 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Flow 'volume_create_manager' (1f9b5856-8195-4415-ae6d-9b98c6b2d8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:57:00 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9f5c221a-ea76-48b8-bd8e-cc61ccba5b69 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1abfe786-3900-4ec9-bf83-a6ce75fe5936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:00 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0f92cd6f-392c-4979-862c-da98911c09e9 tempest-CinderUnicodeTest-829812763 None] Acquiring lock "cinder-b45f127f-4bd6-48a4-9517-967cad6dc4e9-delete_snapshot" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:57:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-474bd392-c1b0-4082-aef6-d5105c5b48df" returned: 0 in 0.371s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:00 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:57:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-180e64d9-fc37-4a6e-8964-45a008938db6 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.751s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:00 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-180e64d9-fc37-4a6e-8964-45a008938db6 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-623542671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=331f9373-e8e8-4267-a039-9136a0cda045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b36f6e16bd8b46e8a04df79adacb0274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:58Z,use_quota=True,user_id='239c3ab7fc82447195336a54200210b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:57:00 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-180e64d9-fc37-4a6e-8964-45a008938db6 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Creating volume 331f9373-e8e8-4267-a039-9136a0cda045 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:57:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-180e64d9-fc37-4a6e-8964-45a008938db6 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-180e64d9-fc37-4a6e-8964-45a008938db6 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:00 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-180e64d9-fc37-4a6e-8964-45a008938db6 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:57:00 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-180e64d9-fc37-4a6e-8964-45a008938db6 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:57:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-180e64d9-fc37-4a6e-8964-45a008938db6 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:00 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-180e64d9-fc37-4a6e-8964-45a008938db6 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:57:00 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-180e64d9-fc37-4a6e-8964-45a008938db6 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:57:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-180e64d9-fc37-4a6e-8964-45a008938db6 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-331f9373-e8e8-4267-a039-9136a0cda045 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:00 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9f5c221a-ea76-48b8-bd8e-cc61ccba5b69 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1abfe786-3900-4ec9-bf83-a6ce75fe5936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1366358400',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abafae8d-0bd6-408e-91dd-89a42643b1d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b36f6e16bd8b46e8a04df79adacb0274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:57:00Z,use_quota=True,user_id='239c3ab7fc82447195336a54200210b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:00 devstack sudo[103693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-331f9373-e8e8-4267-a039-9136a0cda045 1073741824
Nov 06 11:57:00 devstack sudo[103693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:00 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9f5c221a-ea76-48b8-bd8e-cc61ccba5b69 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01caffb4-bb38-4aca-9797-ed4d1e47038d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:00 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9f5c221a-ea76-48b8-bd8e-cc61ccba5b69 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01caffb4-bb38-4aca-9797-ed4d1e47038d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:00 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9f5c221a-ea76-48b8-bd8e-cc61ccba5b69 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59140995-5d11-45e1-8c24-ad1c971d3079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:00 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9f5c221a-ea76-48b8-bd8e-cc61ccba5b69 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59140995-5d11-45e1-8c24-ad1c971d3079) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abafae8d-0bd6-408e-91dd-89a42643b1d9', 'volume_name': 'volume-abafae8d-0bd6-408e-91dd-89a42643b1d9', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:00 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9f5c221a-ea76-48b8-bd8e-cc61ccba5b69 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c6db554-3cac-4993-aabd-52b15f98c62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:00 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9f5c221a-ea76-48b8-bd8e-cc61ccba5b69 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c6db554-3cac-4993-aabd-52b15f98c62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:00 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9f5c221a-ea76-48b8-bd8e-cc61ccba5b69 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0648702b-8114-46c9-b724-dac773bfd40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:00 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-9f5c221a-ea76-48b8-bd8e-cc61ccba5b69 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Volume abafae8d-0bd6-408e-91dd-89a42643b1d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abafae8d-0bd6-408e-91dd-89a42643b1d9', 'volume_size': 1}
Nov 06 11:57:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9f5c221a-ea76-48b8-bd8e-cc61ccba5b69 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:00 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0f92cd6f-392c-4979-862c-da98911c09e9 tempest-CinderUnicodeTest-829812763 None] Lock "cinder-b45f127f-4bd6-48a4-9517-967cad6dc4e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.103s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:57:00 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0f92cd6f-392c-4979-862c-da98911c09e9 tempest-CinderUnicodeTest-829812763 None] Acquiring lock "cinder-quobyte-e9262222-5e2c-4d24-b891-390c004039ab" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:57:00 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0f92cd6f-392c-4979-862c-da98911c09e9 tempest-CinderUnicodeTest-829812763 None] Lock "cinder-quobyte-e9262222-5e2c-4d24-b891-390c004039ab" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:57:00 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0f92cd6f-392c-4979-862c-da98911c09e9 tempest-CinderUnicodeTest-829812763 None] Acquiring lock "cinder-quobyte-b45f127f-4bd6-48a4-9517-967cad6dc4e9" by "_delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:57:00 devstack cinder-volume[87165]: DEBUG cinder.volume.volume_utils [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Attempting download of cbd638b6-97f5-4069-b9d0-ba85f6f08bef ((None, [{'url': 'file:///opt/stack/data/glance/images/cbd638b6-97f5-4069-b9d0-ba85f6f08bef', 'metadata': {}}])) to volume 474bd392-c1b0-4082-aef6-d5105c5b48df. {{(pid=87165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 06 11:57:00 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0f92cd6f-392c-4979-862c-da98911c09e9 tempest-CinderUnicodeTest-829812763 None] Lock "cinder-quobyte-b45f127f-4bd6-48a4-9517-967cad6dc4e9" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:57:00 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-0f92cd6f-392c-4979-862c-da98911c09e9 tempest-CinderUnicodeTest-829812763 None] Deleting offline snapshot b45f127f-4bd6-48a4-9517-967cad6dc4e9 of volume e9262222-5e2c-4d24-b891-390c004039ab {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 11:57:00 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-0f92cd6f-392c-4979-862c-da98911c09e9 tempest-CinderUnicodeTest-829812763 None] snapshot_file for this snap is: volume-e9262222-5e2c-4d24-b891-390c004039ab.b45f127f-4bd6-48a4-9517-967cad6dc4e9 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 11:57:00 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9251c5c-8a0c-43aa-864b-eaddf6888fc2]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:57:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0f92cd6f-392c-4979-862c-da98911c09e9 tempest-CinderUnicodeTest-829812763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e9262222-5e2c-4d24-b891-390c004039ab.b45f127f-4bd6-48a4-9517-967cad6dc4e9 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:00 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf99dd20-d154-46f2-9b75-d27a7dda5831]: (4, 'raw') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:57:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cbd638b6-97f5-4069-b9d0-ba85f6f08bef_1qjsdf92 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:00 devstack sudo[103695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e9262222-5e2c-4d24-b891-390c004039ab.b45f127f-4bd6-48a4-9517-967cad6dc4e9
Nov 06 11:57:00 devstack sudo[103695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:00 devstack sudo[103696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cbd638b6-97f5-4069-b9d0-ba85f6f08bef_1qjsdf92
Nov 06 11:57:00 devstack sudo[103696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:00 devstack sudo[103693]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-180e64d9-fc37-4a6e-8964-45a008938db6 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-331f9373-e8e8-4267-a039-9136a0cda045 1073741824" returned: 0 in 0.520s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-180e64d9-fc37-4a6e-8964-45a008938db6 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-331f9373-e8e8-4267-a039-9136a0cda045 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:00 devstack sudo[103696]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cbd638b6-97f5-4069-b9d0-ba85f6f08bef_1qjsdf92" returned: 0 in 0.387s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cbd638b6-97f5-4069-b9d0-ba85f6f08bef_1qjsdf92 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:00 devstack sudo[103708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-331f9373-e8e8-4267-a039-9136a0cda045
Nov 06 11:57:00 devstack sudo[103708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:00 devstack sudo[103695]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0f92cd6f-392c-4979-862c-da98911c09e9 tempest-CinderUnicodeTest-829812763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e9262222-5e2c-4d24-b891-390c004039ab.b45f127f-4bd6-48a4-9517-967cad6dc4e9" returned: 0 in 0.469s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:00 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-0f92cd6f-392c-4979-862c-da98911c09e9 tempest-CinderUnicodeTest-829812763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9262222-5e2c-4d24-b891-390c004039ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:57:00 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc70f34-35d6-44d5-9117-602c0d2e48b1]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:57:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0f92cd6f-392c-4979-862c-da98911c09e9 tempest-CinderUnicodeTest-829812763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e9262222-5e2c-4d24-b891-390c004039ab {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:00 devstack sudo[103711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cbd638b6-97f5-4069-b9d0-ba85f6f08bef_1qjsdf92
Nov 06 11:57:00 devstack sudo[103711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:01 devstack sudo[103708]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-180e64d9-fc37-4a6e-8964-45a008938db6 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-331f9373-e8e8-4267-a039-9136a0cda045" returned: 0 in 0.316s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:01 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-180e64d9-fc37-4a6e-8964-45a008938db6 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:57:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-180e64d9-fc37-4a6e-8964-45a008938db6 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9e23901a-6ef4-49a9-b0c4-27e3513e62cf tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.287s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:01 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-9e23901a-6ef4-49a9-b0c4-27e3513e62cf tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1442479702',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=325bea40-a2ff-4406-b6d8-ea95357ed527,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b36f6e16bd8b46e8a04df79adacb0274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:59Z,use_quota=True,user_id='239c3ab7fc82447195336a54200210b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:57:01 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-9e23901a-6ef4-49a9-b0c4-27e3513e62cf tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Creating volume 325bea40-a2ff-4406-b6d8-ea95357ed527 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:57:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9e23901a-6ef4-49a9-b0c4-27e3513e62cf tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9e23901a-6ef4-49a9-b0c4-27e3513e62cf tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:01 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-9e23901a-6ef4-49a9-b0c4-27e3513e62cf tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:57:01 devstack sudo[103712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e9262222-5e2c-4d24-b891-390c004039ab
Nov 06 11:57:01 devstack sudo[103712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:01 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-9e23901a-6ef4-49a9-b0c4-27e3513e62cf tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:57:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9e23901a-6ef4-49a9-b0c4-27e3513e62cf tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:01 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-9e23901a-6ef4-49a9-b0c4-27e3513e62cf tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:57:01 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-9e23901a-6ef4-49a9-b0c4-27e3513e62cf tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:57:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9e23901a-6ef4-49a9-b0c4-27e3513e62cf tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-325bea40-a2ff-4406-b6d8-ea95357ed527 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:01 devstack sudo[103716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-325bea40-a2ff-4406-b6d8-ea95357ed527 1073741824
Nov 06 11:57:01 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-180e64d9-fc37-4a6e-8964-45a008938db6 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb39d76e-4061-4698-bdf1-fe4d0d656406) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-331f9373-e8e8-4267-a039-9136a0cda045', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:01 devstack sudo[103716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:01 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-180e64d9-fc37-4a6e-8964-45a008938db6 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3586d02a-93c7-4bc9-9088-31fe724fce4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:01 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-180e64d9-fc37-4a6e-8964-45a008938db6 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Volume volume-331f9373-e8e8-4267-a039-9136a0cda045 (331f9373-e8e8-4267-a039-9136a0cda045): created successfully
Nov 06 11:57:01 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-180e64d9-fc37-4a6e-8964-45a008938db6 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3586d02a-93c7-4bc9-9088-31fe724fce4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:01 devstack sudo[103711]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:01 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-180e64d9-fc37-4a6e-8964-45a008938db6 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Flow 'volume_create_manager' (ddbfaa05-5995-471c-a213-3cb14b4afa8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:57:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cbd638b6-97f5-4069-b9d0-ba85f6f08bef_1qjsdf92" returned: 1 in 0.456s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cbd638b6-97f5-4069-b9d0-ba85f6f08bef_1qjsdf92' failed. Not Retrying. {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 11:57:01 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1756faf-b8b1-4f8c-9d13-cb4d4de1a8f3]: (4, 'raw') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:57:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cbd638b6-97f5-4069-b9d0-ba85f6f08bef_ix4xn1ikdevstack@QuobyteHD {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:01 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-180e64d9-fc37-4a6e-8964-45a008938db6 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Created volume successfully.
Nov 06 11:57:01 devstack sudo[103720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cbd638b6-97f5-4069-b9d0-ba85f6f08bef_ix4xn1ikdevstack@QuobyteHD
Nov 06 11:57:01 devstack sudo[103720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:01 devstack sudo[103712]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0f92cd6f-392c-4979-862c-da98911c09e9 tempest-CinderUnicodeTest-829812763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e9262222-5e2c-4d24-b891-390c004039ab" returned: 0 in 0.516s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0f92cd6f-392c-4979-862c-da98911c09e9 tempest-CinderUnicodeTest-829812763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e9262222-5e2c-4d24-b891-390c004039ab.b45f127f-4bd6-48a4-9517-967cad6dc4e9 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:01 devstack sudo[103727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e9262222-5e2c-4d24-b891-390c004039ab.b45f127f-4bd6-48a4-9517-967cad6dc4e9
Nov 06 11:57:01 devstack sudo[103727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:01 devstack sudo[103720]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cbd638b6-97f5-4069-b9d0-ba85f6f08bef_ix4xn1ikdevstack@QuobyteHD" returned: 0 in 0.383s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cbd638b6-97f5-4069-b9d0-ba85f6f08bef_ix4xn1ikdevstack@QuobyteHD {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:01 devstack sudo[103716]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9e23901a-6ef4-49a9-b0c4-27e3513e62cf tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-325bea40-a2ff-4406-b6d8-ea95357ed527 1073741824" returned: 0 in 0.550s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9e23901a-6ef4-49a9-b0c4-27e3513e62cf tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-325bea40-a2ff-4406-b6d8-ea95357ed527 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:01 devstack sudo[103738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-325bea40-a2ff-4406-b6d8-ea95357ed527
Nov 06 11:57:01 devstack sudo[103738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:01 devstack sudo[103733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cbd638b6-97f5-4069-b9d0-ba85f6f08bef_ix4xn1ikdevstack@QuobyteHD
Nov 06 11:57:01 devstack sudo[103733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:01 devstack sudo[103727]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0f92cd6f-392c-4979-862c-da98911c09e9 tempest-CinderUnicodeTest-829812763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e9262222-5e2c-4d24-b891-390c004039ab.b45f127f-4bd6-48a4-9517-967cad6dc4e9" returned: 0 in 0.405s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0f92cd6f-392c-4979-862c-da98911c09e9 tempest-CinderUnicodeTest-829812763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e9262222-5e2c-4d24-b891-390c004039ab.b45f127f-4bd6-48a4-9517-967cad6dc4e9 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:01 devstack sudo[103741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e9262222-5e2c-4d24-b891-390c004039ab.b45f127f-4bd6-48a4-9517-967cad6dc4e9
Nov 06 11:57:01 devstack sudo[103741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:02 devstack sudo[103733]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cbd638b6-97f5-4069-b9d0-ba85f6f08bef_ix4xn1ikdevstack@QuobyteHD" returned: 1 in 0.381s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cbd638b6-97f5-4069-b9d0-ba85f6f08bef_ix4xn1ikdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 11:57:02 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] cbd638b6-97f5-4069-b9d0-ba85f6f08bef was raw, converting to qcow2 {{(pid=87165) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 06 11:57:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cbd638b6-97f5-4069-b9d0-ba85f6f08bef_ix4xn1ikdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-474bd392-c1b0-4082-aef6-d5105c5b48df {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:02 devstack sudo[103747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cbd638b6-97f5-4069-b9d0-ba85f6f08bef_ix4xn1ikdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-474bd392-c1b0-4082-aef6-d5105c5b48df
Nov 06 11:57:02 devstack sudo[103747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:02 devstack sudo[103738]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9e23901a-6ef4-49a9-b0c4-27e3513e62cf tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-325bea40-a2ff-4406-b6d8-ea95357ed527" returned: 0 in 0.340s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:02 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-9e23901a-6ef4-49a9-b0c4-27e3513e62cf tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:57:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9e23901a-6ef4-49a9-b0c4-27e3513e62cf tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4c9fdd2f-4ada-4f97-a512-c482c5403325 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.659s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:02 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-4c9fdd2f-4ada-4f97-a512-c482c5403325 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-267165348',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f79a85cf-1f1b-4f00-988d-d1896df97cfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b36f6e16bd8b46e8a04df79adacb0274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:59Z,use_quota=True,user_id='239c3ab7fc82447195336a54200210b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:57:02 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-4c9fdd2f-4ada-4f97-a512-c482c5403325 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Creating volume f79a85cf-1f1b-4f00-988d-d1896df97cfb {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:57:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4c9fdd2f-4ada-4f97-a512-c482c5403325 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4c9fdd2f-4ada-4f97-a512-c482c5403325 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:02 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-4c9fdd2f-4ada-4f97-a512-c482c5403325 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:57:02 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-4c9fdd2f-4ada-4f97-a512-c482c5403325 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:57:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4c9fdd2f-4ada-4f97-a512-c482c5403325 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:02 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-4c9fdd2f-4ada-4f97-a512-c482c5403325 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:57:02 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-4c9fdd2f-4ada-4f97-a512-c482c5403325 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:57:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4c9fdd2f-4ada-4f97-a512-c482c5403325 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f79a85cf-1f1b-4f00-988d-d1896df97cfb 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:02 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9e23901a-6ef4-49a9-b0c4-27e3513e62cf tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f790697-8a32-4991-8576-c89e0695e07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-325bea40-a2ff-4406-b6d8-ea95357ed527', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:02 devstack sudo[103750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f79a85cf-1f1b-4f00-988d-d1896df97cfb 1073741824
Nov 06 11:57:02 devstack sudo[103750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:02 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9e23901a-6ef4-49a9-b0c4-27e3513e62cf tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (518b9cc5-54b9-43b5-8eb4-8d2d944f0704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:02 devstack sudo[103741]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0f92cd6f-392c-4979-862c-da98911c09e9 tempest-CinderUnicodeTest-829812763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e9262222-5e2c-4d24-b891-390c004039ab.b45f127f-4bd6-48a4-9517-967cad6dc4e9" returned: 0 in 0.314s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:02 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-9e23901a-6ef4-49a9-b0c4-27e3513e62cf tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Volume volume-325bea40-a2ff-4406-b6d8-ea95357ed527 (325bea40-a2ff-4406-b6d8-ea95357ed527): created successfully
Nov 06 11:57:02 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9e23901a-6ef4-49a9-b0c4-27e3513e62cf tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (518b9cc5-54b9-43b5-8eb4-8d2d944f0704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:02 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9e23901a-6ef4-49a9-b0c4-27e3513e62cf tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Flow 'volume_create_manager' (88b0791d-d5ff-494a-8469-6570259cf07a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:57:02 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0f92cd6f-392c-4979-862c-da98911c09e9 tempest-CinderUnicodeTest-829812763 None] Lock "cinder-quobyte-b45f127f-4bd6-48a4-9517-967cad6dc4e9" released by "_delete_snapshot" :: held 1.942s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:57:02 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-9e23901a-6ef4-49a9-b0c4-27e3513e62cf tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Created volume successfully.
Nov 06 11:57:02 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0f92cd6f-392c-4979-862c-da98911c09e9 tempest-CinderUnicodeTest-829812763 None] Lock "cinder-quobyte-e9262222-5e2c-4d24-b891-390c004039ab" released by "delete_snapshot" :: held 1.989s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:57:02 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-0f92cd6f-392c-4979-862c-da98911c09e9 tempest-CinderUnicodeTest-829812763 None] Created reservations ['1766cb45-b050-454f-aa07-c4c117a1e9aa', '31ede475-be3e-47a2-a62d-48329548735e', 'e33f732d-2173-4d10-84d4-198fb4dcb943', '4379e70c-8e79-4ab7-a4ac-1520bdfc10e7'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:57:02 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-0f92cd6f-392c-4979-862c-da98911c09e9 tempest-CinderUnicodeTest-829812763 None] Delete snapshot completed successfully.
Nov 06 11:57:02 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0f92cd6f-392c-4979-862c-da98911c09e9 tempest-CinderUnicodeTest-829812763 None] Lock "cinder-b45f127f-4bd6-48a4-9517-967cad6dc4e9-delete_snapshot" released by "delete_snapshot" :: held 2.194s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:57:02 devstack sudo[103747]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cbd638b6-97f5-4069-b9d0-ba85f6f08bef_ix4xn1ikdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-474bd392-c1b0-4082-aef6-d5105c5b48df" returned: 0 in 0.552s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:02 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cbd638b6-97f5-4069-b9d0-ba85f6f08bef_ix4xn1ikdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-474bd392-c1b0-4082-aef6-d5105c5b48df {{(pid=87165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 11:57:02 devstack cinder-volume[87165]: INFO cinder.image.image_utils [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Converted 0.00 MB image at 0.00 MB/s
Nov 06 11:57:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-474bd392-c1b0-4082-aef6-d5105c5b48df 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:02 devstack sudo[103760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-474bd392-c1b0-4082-aef6-d5105c5b48df 1G
Nov 06 11:57:02 devstack sudo[103760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:02 devstack sudo[103750]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4c9fdd2f-4ada-4f97-a512-c482c5403325 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f79a85cf-1f1b-4f00-988d-d1896df97cfb 1073741824" returned: 0 in 0.556s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4c9fdd2f-4ada-4f97-a512-c482c5403325 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f79a85cf-1f1b-4f00-988d-d1896df97cfb {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:02 devstack sudo[103762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f79a85cf-1f1b-4f00-988d-d1896df97cfb
Nov 06 11:57:02 devstack sudo[103762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:02 devstack sudo[103760]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:02 devstack sudo[103762]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-474bd392-c1b0-4082-aef6-d5105c5b48df 1G" returned: 0 in 0.370s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:02 devstack cinder-volume[87165]: DEBUG cinder.volume.volume_utils [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Downloaded image cbd638b6-97f5-4069-b9d0-ba85f6f08bef ((None, [{'url': 'file:///opt/stack/data/glance/images/cbd638b6-97f5-4069-b9d0-ba85f6f08bef', 'metadata': {}}])) to volume 474bd392-c1b0-4082-aef6-d5105c5b48df successfully. {{(pid=87165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 06 11:57:02 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Temporary image cbd638b6-97f5-4069-b9d0-ba85f6f08bef for user 6e56252c89684af3ba1b31b1c40ed03b is deleted. {{(pid=87165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 06 11:57:02 devstack cinder-volume[87165]: DEBUG cinder.volume.volume_utils [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Marking volume 474bd392-c1b0-4082-aef6-d5105c5b48df as bootable. {{(pid=87165) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4c9fdd2f-4ada-4f97-a512-c482c5403325 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f79a85cf-1f1b-4f00-988d-d1896df97cfb" returned: 0 in 0.289s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-4c9fdd2f-4ada-4f97-a512-c482c5403325 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4c9fdd2f-4ada-4f97-a512-c482c5403325 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5c474281-adb1-4d26-b37a-70c5e3a19cd8 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.220s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5c474281-adb1-4d26-b37a-70c5e3a19cd8 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-352765967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc7e5da6-d0e3-4a25-921d-3544e3f22026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b36f6e16bd8b46e8a04df79adacb0274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:57:00Z,use_quota=True,user_id='239c3ab7fc82447195336a54200210b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-5c474281-adb1-4d26-b37a-70c5e3a19cd8 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Creating volume fc7e5da6-d0e3-4a25-921d-3544e3f22026 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5c474281-adb1-4d26-b37a-70c5e3a19cd8 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5c474281-adb1-4d26-b37a-70c5e3a19cd8 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5c474281-adb1-4d26-b37a-70c5e3a19cd8 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5c474281-adb1-4d26-b37a-70c5e3a19cd8 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5c474281-adb1-4d26-b37a-70c5e3a19cd8 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5c474281-adb1-4d26-b37a-70c5e3a19cd8 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:57:03 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-5c474281-adb1-4d26-b37a-70c5e3a19cd8 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5c474281-adb1-4d26-b37a-70c5e3a19cd8 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fc7e5da6-d0e3-4a25-921d-3544e3f22026 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Copying metadata from image cbd638b6-97f5-4069-b9d0-ba85f6f08bef to 474bd392-c1b0-4082-aef6-d5105c5b48df. {{(pid=87165) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Creating volume glance metadata for volume 474bd392-c1b0-4082-aef6-d5105c5b48df backed by image cbd638b6-97f5-4069-b9d0-ba85f6f08bef with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'cbd638b6-97f5-4069-b9d0-ba85f6f08bef', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '43a7470b11c59ac0329db571f499d7d9', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87165) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 06 11:57:03 devstack sudo[103768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fc7e5da6-d0e3-4a25-921d-3544e3f22026 1073741824
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4c9fdd2f-4ada-4f97-a512-c482c5403325 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d06a80a-660e-41d1-b3dc-d6ad5348945d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f79a85cf-1f1b-4f00-988d-d1896df97cfb', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:03 devstack sudo[103768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4c9fdd2f-4ada-4f97-a512-c482c5403325 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad6b7fdf-388b-4b14-b6ad-6096a6559397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:03 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-4c9fdd2f-4ada-4f97-a512-c482c5403325 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Volume volume-f79a85cf-1f1b-4f00-988d-d1896df97cfb (f79a85cf-1f1b-4f00-988d-d1896df97cfb): created successfully
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4c9fdd2f-4ada-4f97-a512-c482c5403325 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad6b7fdf-388b-4b14-b6ad-6096a6559397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4c9fdd2f-4ada-4f97-a512-c482c5403325 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Flow 'volume_create_manager' (27a2cbdd-8bf4-4d84-bdcd-38155f0e81b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:57:03 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-4c9fdd2f-4ada-4f97-a512-c482c5403325 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Created volume successfully.
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87b23454-65d3-4218-9b56-794b3e0f150c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-474bd392-c1b0-4082-aef6-d5105c5b48df', 'volume_size': 1, 'image_id': 'cbd638b6-97f5-4069-b9d0-ba85f6f08bef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cbd638b6-97f5-4069-b9d0-ba85f6f08bef', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '43a7470b11c59ac0329db571f499d7d9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bc24e4991e7b44869abcca6924ba492c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2cd8a9c5e1e3409453e5cdc3e94f1569f1564786af425030ee65c536a12cd40b36ccc92087b7763b284d1e30c9c1b7a1c090626700b78090c29ee343786e7bcb', 'id': 'cbd638b6-97f5-4069-b9d0-ba85f6f08bef', 'created_at': datetime.datetime(2026, 11, 6, 10, 56, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 10, 56, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cbd638b6-97f5-4069-b9d0-ba85f6f08bef/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x742c1e0637a0>}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6cea271-8634-4670-9348-1100eb395ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:03 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Volume volume-474bd392-c1b0-4082-aef6-d5105c5b48df (474bd392-c1b0-4082-aef6-d5105c5b48df): created successfully
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6cea271-8634-4670-9348-1100eb395ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Flow 'volume_create_manager' (a18c070c-4d11-4e89-b6a7-cd8b22a27306) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:57:03 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-7a382f30-fc73-4b2a-a017-ad1fa1249aa0 tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Created volume successfully.
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-a27c6d02-62e7-4f47-b8b4-bcf56c7ead39 tempest-VolumesListAdminTestJSON-996772640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a27c6d02-62e7-4f47-b8b4-bcf56c7ead39 tempest-VolumesListAdminTestJSON-996772640 None] Flow 'volume_create_manager' (876b70ea-280d-467d-a72a-7e6076dfd624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a27c6d02-62e7-4f47-b8b4-bcf56c7ead39 tempest-VolumesListAdminTestJSON-996772640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69d5f282-496d-4271-8112-57c8099def72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a27c6d02-62e7-4f47-b8b4-bcf56c7ead39 tempest-VolumesListAdminTestJSON-996772640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69d5f282-496d-4271-8112-57c8099def72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-100306921',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82550ea5-d59e-4c8c-827b-8f725b835f16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896adac6abc84781ae373c99dcf9d3ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:57:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:57:03Z,use_quota=True,user_id='929d31867c704ee98ee413dc57541fae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a27c6d02-62e7-4f47-b8b4-bcf56c7ead39 tempest-VolumesListAdminTestJSON-996772640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4389f40d-5f85-413a-a6b6-2a46b6a6247a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a27c6d02-62e7-4f47-b8b4-bcf56c7ead39 tempest-VolumesListAdminTestJSON-996772640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4389f40d-5f85-413a-a6b6-2a46b6a6247a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a27c6d02-62e7-4f47-b8b4-bcf56c7ead39 tempest-VolumesListAdminTestJSON-996772640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01b4fb3b-5394-46d1-ad9b-a640cbbd0e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a27c6d02-62e7-4f47-b8b4-bcf56c7ead39 tempest-VolumesListAdminTestJSON-996772640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01b4fb3b-5394-46d1-ad9b-a640cbbd0e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82550ea5-d59e-4c8c-827b-8f725b835f16', 'volume_name': 'volume-82550ea5-d59e-4c8c-827b-8f725b835f16', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a27c6d02-62e7-4f47-b8b4-bcf56c7ead39 tempest-VolumesListAdminTestJSON-996772640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5db99141-96d6-481b-833b-467345d397be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a27c6d02-62e7-4f47-b8b4-bcf56c7ead39 tempest-VolumesListAdminTestJSON-996772640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5db99141-96d6-481b-833b-467345d397be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a27c6d02-62e7-4f47-b8b4-bcf56c7ead39 tempest-VolumesListAdminTestJSON-996772640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a87afdff-1576-4ae0-8705-355056afd1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:03 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-a27c6d02-62e7-4f47-b8b4-bcf56c7ead39 tempest-VolumesListAdminTestJSON-996772640 None] Volume 82550ea5-d59e-4c8c-827b-8f725b835f16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82550ea5-d59e-4c8c-827b-8f725b835f16', 'volume_size': 1}
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a27c6d02-62e7-4f47-b8b4-bcf56c7ead39 tempest-VolumesListAdminTestJSON-996772640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b10d56cb-c6eb-4e43-b1d7-45f6b61bcd46 tempest-CinderUnicodeTest-829812763 None] Acquiring lock "cinder-e9262222-5e2c-4d24-b891-390c004039ab-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b10d56cb-c6eb-4e43-b1d7-45f6b61bcd46 tempest-CinderUnicodeTest-829812763 None] Lock "cinder-e9262222-5e2c-4d24-b891-390c004039ab-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b10d56cb-c6eb-4e43-b1d7-45f6b61bcd46 tempest-CinderUnicodeTest-829812763 None] Acquiring lock "cinder-quobyte-e9262222-5e2c-4d24-b891-390c004039ab" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b10d56cb-c6eb-4e43-b1d7-45f6b61bcd46 tempest-CinderUnicodeTest-829812763 None] Lock "cinder-quobyte-e9262222-5e2c-4d24-b891-390c004039ab" acquired by "delete_volume" :: waited 0.017s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:57:03 devstack sudo[103768]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5c474281-adb1-4d26-b37a-70c5e3a19cd8 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fc7e5da6-d0e3-4a25-921d-3544e3f22026 1073741824" returned: 0 in 0.562s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1625bb5-bd87-405f-80c2-ca446daacf77]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b10d56cb-c6eb-4e43-b1d7-45f6b61bcd46 tempest-CinderUnicodeTest-829812763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e9262222-5e2c-4d24-b891-390c004039ab {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5c474281-adb1-4d26-b37a-70c5e3a19cd8 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fc7e5da6-d0e3-4a25-921d-3544e3f22026 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:03 devstack sudo[103775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fc7e5da6-d0e3-4a25-921d-3544e3f22026
Nov 06 11:57:03 devstack sudo[103775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:03 devstack sudo[103774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e9262222-5e2c-4d24-b891-390c004039ab
Nov 06 11:57:03 devstack sudo[103774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:03 devstack sudo[103775]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5c474281-adb1-4d26-b37a-70c5e3a19cd8 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fc7e5da6-d0e3-4a25-921d-3544e3f22026" returned: 0 in 0.246s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5c474281-adb1-4d26-b37a-70c5e3a19cd8 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5c474281-adb1-4d26-b37a-70c5e3a19cd8 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9f5c221a-ea76-48b8-bd8e-cc61ccba5b69 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.578s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-9f5c221a-ea76-48b8-bd8e-cc61ccba5b69 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1366358400',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abafae8d-0bd6-408e-91dd-89a42643b1d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b36f6e16bd8b46e8a04df79adacb0274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:57:00Z,use_quota=True,user_id='239c3ab7fc82447195336a54200210b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-9f5c221a-ea76-48b8-bd8e-cc61ccba5b69 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Creating volume abafae8d-0bd6-408e-91dd-89a42643b1d9 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9f5c221a-ea76-48b8-bd8e-cc61ccba5b69 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9f5c221a-ea76-48b8-bd8e-cc61ccba5b69 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-9f5c221a-ea76-48b8-bd8e-cc61ccba5b69 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-9f5c221a-ea76-48b8-bd8e-cc61ccba5b69 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9f5c221a-ea76-48b8-bd8e-cc61ccba5b69 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-9f5c221a-ea76-48b8-bd8e-cc61ccba5b69 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:57:03 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-9f5c221a-ea76-48b8-bd8e-cc61ccba5b69 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9f5c221a-ea76-48b8-bd8e-cc61ccba5b69 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-abafae8d-0bd6-408e-91dd-89a42643b1d9 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5c474281-adb1-4d26-b37a-70c5e3a19cd8 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (761dc616-4868-455b-824f-3f513902fd22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc7e5da6-d0e3-4a25-921d-3544e3f22026', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:03 devstack sudo[103781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-abafae8d-0bd6-408e-91dd-89a42643b1d9 1073741824
Nov 06 11:57:03 devstack sudo[103781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5c474281-adb1-4d26-b37a-70c5e3a19cd8 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (938b6dbd-b7d5-4bbd-bf4b-1636d78eb7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:03 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-5c474281-adb1-4d26-b37a-70c5e3a19cd8 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Volume volume-fc7e5da6-d0e3-4a25-921d-3544e3f22026 (fc7e5da6-d0e3-4a25-921d-3544e3f22026): created successfully
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5c474281-adb1-4d26-b37a-70c5e3a19cd8 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (938b6dbd-b7d5-4bbd-bf4b-1636d78eb7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5c474281-adb1-4d26-b37a-70c5e3a19cd8 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Flow 'volume_create_manager' (a7522f83-681c-44aa-a856-20c33e2ded05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:57:03 devstack sudo[103774]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b10d56cb-c6eb-4e43-b1d7-45f6b61bcd46 tempest-CinderUnicodeTest-829812763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e9262222-5e2c-4d24-b891-390c004039ab" returned: 0 in 0.369s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b10d56cb-c6eb-4e43-b1d7-45f6b61bcd46 tempest-CinderUnicodeTest-829812763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e9262222-5e2c-4d24-b891-390c004039ab {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:03 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-5c474281-adb1-4d26-b37a-70c5e3a19cd8 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Created volume successfully.
Nov 06 11:57:03 devstack sudo[103784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e9262222-5e2c-4d24-b891-390c004039ab
Nov 06 11:57:04 devstack sudo[103784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:04 devstack sudo[103784]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b10d56cb-c6eb-4e43-b1d7-45f6b61bcd46 tempest-CinderUnicodeTest-829812763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e9262222-5e2c-4d24-b891-390c004039ab" returned: 0 in 0.287s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:04 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b10d56cb-c6eb-4e43-b1d7-45f6b61bcd46 tempest-CinderUnicodeTest-829812763 None] Lock "cinder-quobyte-e9262222-5e2c-4d24-b891-390c004039ab" released by "delete_volume" :: held 0.722s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:57:04 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c57260d5-c183-4988-a9a0-1889c56d658c tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Acquiring lock "cinder-474bd392-c1b0-4082-aef6-d5105c5b48df-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:57:04 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-b10d56cb-c6eb-4e43-b1d7-45f6b61bcd46 tempest-CinderUnicodeTest-829812763 None] Created reservations ['c278308e-3890-4996-a270-f7cecc83cb25', '8b310e3f-a476-4e44-b46b-39efbc038af8', '9606b77a-2d27-45f2-b8e7-0c6374a58ec7', '93e163b1-cbfb-4f42-a0a4-115aaea0f3d6'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:57:04 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c57260d5-c183-4988-a9a0-1889c56d658c tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Lock "cinder-474bd392-c1b0-4082-aef6-d5105c5b48df-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:57:04 devstack sudo[103781]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9f5c221a-ea76-48b8-bd8e-cc61ccba5b69 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-abafae8d-0bd6-408e-91dd-89a42643b1d9 1073741824" returned: 0 in 0.499s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:04 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c57260d5-c183-4988-a9a0-1889c56d658c tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Acquiring lock "cinder-quobyte-474bd392-c1b0-4082-aef6-d5105c5b48df" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:57:04 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c57260d5-c183-4988-a9a0-1889c56d658c tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Lock "cinder-quobyte-474bd392-c1b0-4082-aef6-d5105c5b48df" acquired by "delete_volume" :: waited 0.025s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:57:04 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4deef6b-5a16-45a1-9fdd-9567e94daa6b]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:57:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c57260d5-c183-4988-a9a0-1889c56d658c tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-474bd392-c1b0-4082-aef6-d5105c5b48df {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b10d56cb-c6eb-4e43-b1d7-45f6b61bcd46 tempest-CinderUnicodeTest-829812763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b10d56cb-c6eb-4e43-b1d7-45f6b61bcd46 tempest-CinderUnicodeTest-829812763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:04 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b10d56cb-c6eb-4e43-b1d7-45f6b61bcd46 tempest-CinderUnicodeTest-829812763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:57:04 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b10d56cb-c6eb-4e43-b1d7-45f6b61bcd46 tempest-CinderUnicodeTest-829812763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:57:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b10d56cb-c6eb-4e43-b1d7-45f6b61bcd46 tempest-CinderUnicodeTest-829812763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b10d56cb-c6eb-4e43-b1d7-45f6b61bcd46 tempest-CinderUnicodeTest-829812763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9f5c221a-ea76-48b8-bd8e-cc61ccba5b69 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-abafae8d-0bd6-408e-91dd-89a42643b1d9 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:04 devstack sudo[103792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:57:04 devstack sudo[103792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:04 devstack sudo[103793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-abafae8d-0bd6-408e-91dd-89a42643b1d9
Nov 06 11:57:04 devstack sudo[103793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:04 devstack sudo[103791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-474bd392-c1b0-4082-aef6-d5105c5b48df
Nov 06 11:57:04 devstack sudo[103791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:04 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-fd90a79b-4ae0-4394-828e-235212c50868 tempest-CinderUnicodeTest-829812763 None] Acquiring lock "cinder-2935532c-1b18-44de-87a9-4cf8d62e47f7-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:57:04 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-fd90a79b-4ae0-4394-828e-235212c50868 tempest-CinderUnicodeTest-829812763 None] Lock "cinder-2935532c-1b18-44de-87a9-4cf8d62e47f7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:57:04 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-fd90a79b-4ae0-4394-828e-235212c50868 tempest-CinderUnicodeTest-829812763 None] Acquiring lock "cinder-quobyte-2935532c-1b18-44de-87a9-4cf8d62e47f7" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:57:04 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-fd90a79b-4ae0-4394-828e-235212c50868 tempest-CinderUnicodeTest-829812763 None] Lock "cinder-quobyte-2935532c-1b18-44de-87a9-4cf8d62e47f7" acquired by "delete_volume" :: waited 0.030s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:57:04 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a913de-84b9-4e1d-ab36-fa4765943da8]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:57:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-fd90a79b-4ae0-4394-828e-235212c50868 tempest-CinderUnicodeTest-829812763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2935532c-1b18-44de-87a9-4cf8d62e47f7 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:04 devstack sudo[103793]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:04 devstack sudo[103792]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9f5c221a-ea76-48b8-bd8e-cc61ccba5b69 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-abafae8d-0bd6-408e-91dd-89a42643b1d9" returned: 0 in 0.355s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:04 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-9f5c221a-ea76-48b8-bd8e-cc61ccba5b69 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:57:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9f5c221a-ea76-48b8-bd8e-cc61ccba5b69 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a27c6d02-62e7-4f47-b8b4-bcf56c7ead39 tempest-VolumesListAdminTestJSON-996772640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.447s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:04 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a27c6d02-62e7-4f47-b8b4-bcf56c7ead39 tempest-VolumesListAdminTestJSON-996772640 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-100306921',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82550ea5-d59e-4c8c-827b-8f725b835f16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896adac6abc84781ae373c99dcf9d3ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:57:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:57:03Z,use_quota=True,user_id='929d31867c704ee98ee413dc57541fae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:57:04 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-a27c6d02-62e7-4f47-b8b4-bcf56c7ead39 tempest-VolumesListAdminTestJSON-996772640 None] Creating volume 82550ea5-d59e-4c8c-827b-8f725b835f16 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:57:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a27c6d02-62e7-4f47-b8b4-bcf56c7ead39 tempest-VolumesListAdminTestJSON-996772640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a27c6d02-62e7-4f47-b8b4-bcf56c7ead39 tempest-VolumesListAdminTestJSON-996772640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:04 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a27c6d02-62e7-4f47-b8b4-bcf56c7ead39 tempest-VolumesListAdminTestJSON-996772640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:57:04 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a27c6d02-62e7-4f47-b8b4-bcf56c7ead39 tempest-VolumesListAdminTestJSON-996772640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:57:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a27c6d02-62e7-4f47-b8b4-bcf56c7ead39 tempest-VolumesListAdminTestJSON-996772640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:04 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a27c6d02-62e7-4f47-b8b4-bcf56c7ead39 tempest-VolumesListAdminTestJSON-996772640 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:57:04 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-a27c6d02-62e7-4f47-b8b4-bcf56c7ead39 tempest-VolumesListAdminTestJSON-996772640 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:57:04 devstack sudo[103791]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a27c6d02-62e7-4f47-b8b4-bcf56c7ead39 tempest-VolumesListAdminTestJSON-996772640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-82550ea5-d59e-4c8c-827b-8f725b835f16 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b10d56cb-c6eb-4e43-b1d7-45f6b61bcd46 tempest-CinderUnicodeTest-829812763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.398s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:04 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-b10d56cb-c6eb-4e43-b1d7-45f6b61bcd46 tempest-CinderUnicodeTest-829812763 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:57:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c57260d5-c183-4988-a9a0-1889c56d658c tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-474bd392-c1b0-4082-aef6-d5105c5b48df" returned: 0 in 0.425s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c57260d5-c183-4988-a9a0-1889c56d658c tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-474bd392-c1b0-4082-aef6-d5105c5b48df {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:04 devstack sudo[103804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-82550ea5-d59e-4c8c-827b-8f725b835f16 1073741824
Nov 06 11:57:04 devstack sudo[103804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:04 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-b10d56cb-c6eb-4e43-b1d7-45f6b61bcd46 tempest-CinderUnicodeTest-829812763 None] Deleted volume successfully.
Nov 06 11:57:04 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9f5c221a-ea76-48b8-bd8e-cc61ccba5b69 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0648702b-8114-46c9-b724-dac773bfd40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abafae8d-0bd6-408e-91dd-89a42643b1d9', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:04 devstack sudo[103805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-474bd392-c1b0-4082-aef6-d5105c5b48df
Nov 06 11:57:04 devstack sudo[103805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:04 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9f5c221a-ea76-48b8-bd8e-cc61ccba5b69 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba6318b7-a8ac-472a-9453-9285ec547ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:04 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-9f5c221a-ea76-48b8-bd8e-cc61ccba5b69 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Volume volume-abafae8d-0bd6-408e-91dd-89a42643b1d9 (abafae8d-0bd6-408e-91dd-89a42643b1d9): created successfully
Nov 06 11:57:04 devstack sudo[103803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2935532c-1b18-44de-87a9-4cf8d62e47f7
Nov 06 11:57:04 devstack sudo[103803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:04 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9f5c221a-ea76-48b8-bd8e-cc61ccba5b69 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba6318b7-a8ac-472a-9453-9285ec547ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:04 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9f5c221a-ea76-48b8-bd8e-cc61ccba5b69 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Flow 'volume_create_manager' (1f9b5856-8195-4415-ae6d-9b98c6b2d8cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:57:04 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b10d56cb-c6eb-4e43-b1d7-45f6b61bcd46 tempest-CinderUnicodeTest-829812763 None] Lock "cinder-e9262222-5e2c-4d24-b891-390c004039ab-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:57:04 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-9f5c221a-ea76-48b8-bd8e-cc61ccba5b69 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Created volume successfully.
Nov 06 11:57:05 devstack sudo[103805]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:05 devstack sudo[103803]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c57260d5-c183-4988-a9a0-1889c56d658c tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-474bd392-c1b0-4082-aef6-d5105c5b48df" returned: 0 in 0.312s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-fd90a79b-4ae0-4394-828e-235212c50868 tempest-CinderUnicodeTest-829812763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2935532c-1b18-44de-87a9-4cf8d62e47f7" returned: 0 in 0.378s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-fd90a79b-4ae0-4394-828e-235212c50868 tempest-CinderUnicodeTest-829812763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2935532c-1b18-44de-87a9-4cf8d62e47f7 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:05 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c57260d5-c183-4988-a9a0-1889c56d658c tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Lock "cinder-quobyte-474bd392-c1b0-4082-aef6-d5105c5b48df" released by "delete_volume" :: held 0.791s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:57:05 devstack sudo[103816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2935532c-1b18-44de-87a9-4cf8d62e47f7
Nov 06 11:57:05 devstack sudo[103816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:05 devstack cinder-volume[87165]: WARNING cinder.quota [None req-c57260d5-c183-4988-a9a0-1889c56d658c tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Nov 06 11:57:05 devstack cinder-volume[87165]: WARNING cinder.quota [None req-c57260d5-c183-4988-a9a0-1889c56d658c tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Nov 06 11:57:05 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-c57260d5-c183-4988-a9a0-1889c56d658c tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Created reservations ['6c2515b6-b7ba-46d5-9748-d7a1f8897a6c', '8cec5d96-a0f1-4205-8cdf-569201c7f065', 'f441af17-4b0a-47bb-8810-65503a4d95f1', '6f2a33a3-fd19-4f50-a6c6-eebb2825ceb5'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:57:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c57260d5-c183-4988-a9a0-1889c56d658c tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c57260d5-c183-4988-a9a0-1889c56d658c tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:05 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-c57260d5-c183-4988-a9a0-1889c56d658c tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:57:05 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-c57260d5-c183-4988-a9a0-1889c56d658c tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:57:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c57260d5-c183-4988-a9a0-1889c56d658c tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c57260d5-c183-4988-a9a0-1889c56d658c tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:05 devstack sudo[103804]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a27c6d02-62e7-4f47-b8b4-bcf56c7ead39 tempest-VolumesListAdminTestJSON-996772640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-82550ea5-d59e-4c8c-827b-8f725b835f16 1073741824" returned: 0 in 0.521s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:05 devstack sudo[103819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:57:05 devstack sudo[103819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a27c6d02-62e7-4f47-b8b4-bcf56c7ead39 tempest-VolumesListAdminTestJSON-996772640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-82550ea5-d59e-4c8c-827b-8f725b835f16 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:05 devstack sudo[103821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-82550ea5-d59e-4c8c-827b-8f725b835f16
Nov 06 11:57:05 devstack sudo[103821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:05 devstack sudo[103816]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-fd90a79b-4ae0-4394-828e-235212c50868 tempest-CinderUnicodeTest-829812763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2935532c-1b18-44de-87a9-4cf8d62e47f7" returned: 0 in 0.358s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:05 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-fd90a79b-4ae0-4394-828e-235212c50868 tempest-CinderUnicodeTest-829812763 None] Lock "cinder-quobyte-2935532c-1b18-44de-87a9-4cf8d62e47f7" released by "delete_volume" :: held 0.798s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:57:05 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-fd90a79b-4ae0-4394-828e-235212c50868 tempest-CinderUnicodeTest-829812763 None] Created reservations ['8fc7278b-2aca-4ef0-a94a-0c5683024cbd', '0ac815cd-53cf-40ff-95e4-c5e221ac7725', '6f43f059-5c6a-4565-bb6b-e5b2f38d5f68', '6dd2e8e0-f17e-4b32-a354-332c1f2c159f'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:57:05 devstack sudo[103821]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:05 devstack sudo[103819]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a27c6d02-62e7-4f47-b8b4-bcf56c7ead39 tempest-VolumesListAdminTestJSON-996772640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-82550ea5-d59e-4c8c-827b-8f725b835f16" returned: 0 in 0.287s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:05 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a27c6d02-62e7-4f47-b8b4-bcf56c7ead39 tempest-VolumesListAdminTestJSON-996772640 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:57:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a27c6d02-62e7-4f47-b8b4-bcf56c7ead39 tempest-VolumesListAdminTestJSON-996772640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c57260d5-c183-4988-a9a0-1889c56d658c tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.352s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:05 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-c57260d5-c183-4988-a9a0-1889c56d658c tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:57:05 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-c57260d5-c183-4988-a9a0-1889c56d658c tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Deleted volume successfully.
Nov 06 11:57:05 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a27c6d02-62e7-4f47-b8b4-bcf56c7ead39 tempest-VolumesListAdminTestJSON-996772640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a87afdff-1576-4ae0-8705-355056afd1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82550ea5-d59e-4c8c-827b-8f725b835f16', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:05 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a27c6d02-62e7-4f47-b8b4-bcf56c7ead39 tempest-VolumesListAdminTestJSON-996772640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27144756-cf1c-4790-a7fa-54612535bd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:05 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-a27c6d02-62e7-4f47-b8b4-bcf56c7ead39 tempest-VolumesListAdminTestJSON-996772640 None] Volume volume-82550ea5-d59e-4c8c-827b-8f725b835f16 (82550ea5-d59e-4c8c-827b-8f725b835f16): created successfully
Nov 06 11:57:05 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a27c6d02-62e7-4f47-b8b4-bcf56c7ead39 tempest-VolumesListAdminTestJSON-996772640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27144756-cf1c-4790-a7fa-54612535bd1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:05 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a27c6d02-62e7-4f47-b8b4-bcf56c7ead39 tempest-VolumesListAdminTestJSON-996772640 None] Flow 'volume_create_manager' (876b70ea-280d-467d-a72a-7e6076dfd624) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:57:05 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c57260d5-c183-4988-a9a0-1889c56d658c tempest-VolumeAndVolumeTypeFromImageTest-1701828981 None] Lock "cinder-474bd392-c1b0-4082-aef6-d5105c5b48df-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:57:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-fd90a79b-4ae0-4394-828e-235212c50868 tempest-CinderUnicodeTest-829812763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-fd90a79b-4ae0-4394-828e-235212c50868 tempest-CinderUnicodeTest-829812763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:05 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-fd90a79b-4ae0-4394-828e-235212c50868 tempest-CinderUnicodeTest-829812763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:57:05 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-fd90a79b-4ae0-4394-828e-235212c50868 tempest-CinderUnicodeTest-829812763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:57:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-fd90a79b-4ae0-4394-828e-235212c50868 tempest-CinderUnicodeTest-829812763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-fd90a79b-4ae0-4394-828e-235212c50868 tempest-CinderUnicodeTest-829812763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:05 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-a27c6d02-62e7-4f47-b8b4-bcf56c7ead39 tempest-VolumesListAdminTestJSON-996772640 None] Created volume successfully.
Nov 06 11:57:05 devstack sudo[103826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:57:05 devstack sudo[103826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:05 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-08395bda-ea31-4e76-a522-29143aea0d8a tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Acquiring lock "cinder-abafae8d-0bd6-408e-91dd-89a42643b1d9-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:57:05 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-08395bda-ea31-4e76-a522-29143aea0d8a tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "cinder-abafae8d-0bd6-408e-91dd-89a42643b1d9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:57:06 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-08395bda-ea31-4e76-a522-29143aea0d8a tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Acquiring lock "cinder-quobyte-abafae8d-0bd6-408e-91dd-89a42643b1d9" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:57:06 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-08395bda-ea31-4e76-a522-29143aea0d8a tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "cinder-quobyte-abafae8d-0bd6-408e-91dd-89a42643b1d9" acquired by "delete_volume" :: waited 0.024s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:57:06 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[da724e96-639c-464a-b91c-24ca49f71dbc]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:57:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-08395bda-ea31-4e76-a522-29143aea0d8a tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-abafae8d-0bd6-408e-91dd-89a42643b1d9 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:06 devstack sudo[103826]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-fd90a79b-4ae0-4394-828e-235212c50868 tempest-CinderUnicodeTest-829812763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.394s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:06 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-fd90a79b-4ae0-4394-828e-235212c50868 tempest-CinderUnicodeTest-829812763 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:57:06 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-fd90a79b-4ae0-4394-828e-235212c50868 tempest-CinderUnicodeTest-829812763 None] Deleted volume successfully.
Nov 06 11:57:06 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-fd90a79b-4ae0-4394-828e-235212c50868 tempest-CinderUnicodeTest-829812763 None] Lock "cinder-2935532c-1b18-44de-87a9-4cf8d62e47f7-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:57:06 devstack sudo[103828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-abafae8d-0bd6-408e-91dd-89a42643b1d9
Nov 06 11:57:06 devstack sudo[103828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:06 devstack sudo[103828]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-08395bda-ea31-4e76-a522-29143aea0d8a tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-abafae8d-0bd6-408e-91dd-89a42643b1d9" returned: 0 in 0.486s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-08395bda-ea31-4e76-a522-29143aea0d8a tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-abafae8d-0bd6-408e-91dd-89a42643b1d9 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:06 devstack sudo[103834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-abafae8d-0bd6-408e-91dd-89a42643b1d9
Nov 06 11:57:06 devstack sudo[103834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:06 devstack sudo[103834]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-08395bda-ea31-4e76-a522-29143aea0d8a tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-abafae8d-0bd6-408e-91dd-89a42643b1d9" returned: 0 in 0.317s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:06 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-08395bda-ea31-4e76-a522-29143aea0d8a tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "cinder-quobyte-abafae8d-0bd6-408e-91dd-89a42643b1d9" released by "delete_volume" :: held 0.879s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:57:07 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-08395bda-ea31-4e76-a522-29143aea0d8a tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Created reservations ['3da0769a-742d-418a-806d-f3fbcddaf59e', '2730a4e6-03ac-4bb1-b84d-167fa5f9efd8', '93552b86-f108-4d7d-b72c-15ef0e4a1ff6', 'b71bd395-bb66-40c0-9503-172b37761758'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:57:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-08395bda-ea31-4e76-a522-29143aea0d8a tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-08395bda-ea31-4e76-a522-29143aea0d8a tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:07 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-08395bda-ea31-4e76-a522-29143aea0d8a tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:57:07 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-08395bda-ea31-4e76-a522-29143aea0d8a tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:57:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-08395bda-ea31-4e76-a522-29143aea0d8a tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-08395bda-ea31-4e76-a522-29143aea0d8a tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:07 devstack sudo[103837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:57:07 devstack sudo[103837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:07 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-69777a4f-b31c-43b4-9b96-08c8eef1df3b tempest-VolumesListAdminTestJSON-996772640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:57:07 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-69777a4f-b31c-43b4-9b96-08c8eef1df3b tempest-VolumesListAdminTestJSON-996772640 None] Flow 'volume_create_manager' (5d4c4318-0f9d-4852-bf73-0db31ceaa6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:57:07 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-69777a4f-b31c-43b4-9b96-08c8eef1df3b tempest-VolumesListAdminTestJSON-996772640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87bb7e18-2aeb-49d5-95ae-219552eee209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:07 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5d97fba1-44b1-4f3f-b982-3f506fb4c1d4 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Acquiring lock "cinder-fc7e5da6-d0e3-4a25-921d-3544e3f22026-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:57:07 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-69777a4f-b31c-43b4-9b96-08c8eef1df3b tempest-VolumesListAdminTestJSON-996772640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87bb7e18-2aeb-49d5-95ae-219552eee209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-170895493',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0e723e4-1f37-4645-b9e4-06feff7bfa57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896adac6abc84781ae373c99dcf9d3ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:57:07Z,use_quota=True,user_id='929d31867c704ee98ee413dc57541fae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:07 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-69777a4f-b31c-43b4-9b96-08c8eef1df3b tempest-VolumesListAdminTestJSON-996772640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f450568-1fa8-49b9-be59-24946d554b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:07 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-69777a4f-b31c-43b4-9b96-08c8eef1df3b tempest-VolumesListAdminTestJSON-996772640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f450568-1fa8-49b9-be59-24946d554b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:07 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-69777a4f-b31c-43b4-9b96-08c8eef1df3b tempest-VolumesListAdminTestJSON-996772640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e3d9489-bc7e-448a-92b9-5bdc392ad578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:07 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-69777a4f-b31c-43b4-9b96-08c8eef1df3b tempest-VolumesListAdminTestJSON-996772640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e3d9489-bc7e-448a-92b9-5bdc392ad578) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0e723e4-1f37-4645-b9e4-06feff7bfa57', 'volume_name': 'volume-a0e723e4-1f37-4645-b9e4-06feff7bfa57', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:07 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-69777a4f-b31c-43b4-9b96-08c8eef1df3b tempest-VolumesListAdminTestJSON-996772640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3025cf15-2667-418a-b82e-6fee706d12c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:07 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-69777a4f-b31c-43b4-9b96-08c8eef1df3b tempest-VolumesListAdminTestJSON-996772640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3025cf15-2667-418a-b82e-6fee706d12c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:07 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-69777a4f-b31c-43b4-9b96-08c8eef1df3b tempest-VolumesListAdminTestJSON-996772640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d8e443a-6d5c-4b97-972f-0a83407b51ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:07 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-69777a4f-b31c-43b4-9b96-08c8eef1df3b tempest-VolumesListAdminTestJSON-996772640 None] Volume a0e723e4-1f37-4645-b9e4-06feff7bfa57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0e723e4-1f37-4645-b9e4-06feff7bfa57', 'volume_size': 1}
Nov 06 11:57:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-69777a4f-b31c-43b4-9b96-08c8eef1df3b tempest-VolumesListAdminTestJSON-996772640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-69777a4f-b31c-43b4-9b96-08c8eef1df3b tempest-VolumesListAdminTestJSON-996772640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:07 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-69777a4f-b31c-43b4-9b96-08c8eef1df3b tempest-VolumesListAdminTestJSON-996772640 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-170895493',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0e723e4-1f37-4645-b9e4-06feff7bfa57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896adac6abc84781ae373c99dcf9d3ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:57:07Z,use_quota=True,user_id='929d31867c704ee98ee413dc57541fae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:57:07 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-69777a4f-b31c-43b4-9b96-08c8eef1df3b tempest-VolumesListAdminTestJSON-996772640 None] Creating volume a0e723e4-1f37-4645-b9e4-06feff7bfa57 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:57:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-69777a4f-b31c-43b4-9b96-08c8eef1df3b tempest-VolumesListAdminTestJSON-996772640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-69777a4f-b31c-43b4-9b96-08c8eef1df3b tempest-VolumesListAdminTestJSON-996772640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:07 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-69777a4f-b31c-43b4-9b96-08c8eef1df3b tempest-VolumesListAdminTestJSON-996772640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:57:07 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-69777a4f-b31c-43b4-9b96-08c8eef1df3b tempest-VolumesListAdminTestJSON-996772640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:57:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-69777a4f-b31c-43b4-9b96-08c8eef1df3b tempest-VolumesListAdminTestJSON-996772640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:07 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-69777a4f-b31c-43b4-9b96-08c8eef1df3b tempest-VolumesListAdminTestJSON-996772640 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:57:07 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-69777a4f-b31c-43b4-9b96-08c8eef1df3b tempest-VolumesListAdminTestJSON-996772640 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:57:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-69777a4f-b31c-43b4-9b96-08c8eef1df3b tempest-VolumesListAdminTestJSON-996772640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a0e723e4-1f37-4645-b9e4-06feff7bfa57 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:07 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5d97fba1-44b1-4f3f-b982-3f506fb4c1d4 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "cinder-fc7e5da6-d0e3-4a25-921d-3544e3f22026-delete_volume" acquired by "delete_volume" :: waited 0.103s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:57:07 devstack sudo[103842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a0e723e4-1f37-4645-b9e4-06feff7bfa57 1073741824
Nov 06 11:57:07 devstack sudo[103842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:07 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5d97fba1-44b1-4f3f-b982-3f506fb4c1d4 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Acquiring lock "cinder-quobyte-fc7e5da6-d0e3-4a25-921d-3544e3f22026" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:57:07 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5d97fba1-44b1-4f3f-b982-3f506fb4c1d4 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "cinder-quobyte-fc7e5da6-d0e3-4a25-921d-3544e3f22026" acquired by "delete_volume" :: waited 0.026s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:57:07 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7681c3d-558c-4051-b1b8-425f6e45d018]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:57:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5d97fba1-44b1-4f3f-b982-3f506fb4c1d4 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fc7e5da6-d0e3-4a25-921d-3544e3f22026 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:07 devstack sudo[103837]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-08395bda-ea31-4e76-a522-29143aea0d8a tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.451s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:07 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-08395bda-ea31-4e76-a522-29143aea0d8a tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:57:07 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-08395bda-ea31-4e76-a522-29143aea0d8a tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Deleted volume successfully.
Nov 06 11:57:07 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-08395bda-ea31-4e76-a522-29143aea0d8a tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "cinder-abafae8d-0bd6-408e-91dd-89a42643b1d9-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:57:07 devstack sudo[103848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fc7e5da6-d0e3-4a25-921d-3544e3f22026
Nov 06 11:57:07 devstack sudo[103848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:07 devstack sudo[103842]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-69777a4f-b31c-43b4-9b96-08c8eef1df3b tempest-VolumesListAdminTestJSON-996772640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a0e723e4-1f37-4645-b9e4-06feff7bfa57 1073741824" returned: 0 in 0.600s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:08 devstack sudo[103848]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5d97fba1-44b1-4f3f-b982-3f506fb4c1d4 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fc7e5da6-d0e3-4a25-921d-3544e3f22026" returned: 0 in 0.494s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5d97fba1-44b1-4f3f-b982-3f506fb4c1d4 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fc7e5da6-d0e3-4a25-921d-3544e3f22026 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-69777a4f-b31c-43b4-9b96-08c8eef1df3b tempest-VolumesListAdminTestJSON-996772640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a0e723e4-1f37-4645-b9e4-06feff7bfa57 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:08 devstack sudo[103858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fc7e5da6-d0e3-4a25-921d-3544e3f22026
Nov 06 11:57:08 devstack sudo[103858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:08 devstack sudo[103860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a0e723e4-1f37-4645-b9e4-06feff7bfa57
Nov 06 11:57:08 devstack sudo[103860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:08 devstack sudo[103860]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-69777a4f-b31c-43b4-9b96-08c8eef1df3b tempest-VolumesListAdminTestJSON-996772640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a0e723e4-1f37-4645-b9e4-06feff7bfa57" returned: 0 in 0.294s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:08 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-69777a4f-b31c-43b4-9b96-08c8eef1df3b tempest-VolumesListAdminTestJSON-996772640 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:57:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-69777a4f-b31c-43b4-9b96-08c8eef1df3b tempest-VolumesListAdminTestJSON-996772640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-69777a4f-b31c-43b4-9b96-08c8eef1df3b tempest-VolumesListAdminTestJSON-996772640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d8e443a-6d5c-4b97-972f-0a83407b51ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0e723e4-1f37-4645-b9e4-06feff7bfa57', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:08 devstack sudo[103858]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-69777a4f-b31c-43b4-9b96-08c8eef1df3b tempest-VolumesListAdminTestJSON-996772640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f8530aa-f1a5-450d-a288-09e16ab03782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5d97fba1-44b1-4f3f-b982-3f506fb4c1d4 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fc7e5da6-d0e3-4a25-921d-3544e3f22026" returned: 0 in 0.376s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:08 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5d97fba1-44b1-4f3f-b982-3f506fb4c1d4 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "cinder-quobyte-fc7e5da6-d0e3-4a25-921d-3544e3f22026" released by "delete_volume" :: held 0.947s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:57:08 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-69777a4f-b31c-43b4-9b96-08c8eef1df3b tempest-VolumesListAdminTestJSON-996772640 None] Volume volume-a0e723e4-1f37-4645-b9e4-06feff7bfa57 (a0e723e4-1f37-4645-b9e4-06feff7bfa57): created successfully
Nov 06 11:57:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-69777a4f-b31c-43b4-9b96-08c8eef1df3b tempest-VolumesListAdminTestJSON-996772640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f8530aa-f1a5-450d-a288-09e16ab03782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-69777a4f-b31c-43b4-9b96-08c8eef1df3b tempest-VolumesListAdminTestJSON-996772640 None] Flow 'volume_create_manager' (5d4c4318-0f9d-4852-bf73-0db31ceaa6d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:57:08 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-69777a4f-b31c-43b4-9b96-08c8eef1df3b tempest-VolumesListAdminTestJSON-996772640 None] Created volume successfully.
Nov 06 11:57:08 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-5d97fba1-44b1-4f3f-b982-3f506fb4c1d4 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Created reservations ['f0d5ea3e-309f-4beb-82d0-51fe9485f3d2', '4730510a-0c40-4ae2-a986-542233e58610', '288b5bf5-1541-4ce7-b5b3-dd1eb30b9d2b', 'f1c34ac8-9c54-4d6c-b13d-1670afb8d681'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:57:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5d97fba1-44b1-4f3f-b982-3f506fb4c1d4 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5d97fba1-44b1-4f3f-b982-3f506fb4c1d4 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:08 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5d97fba1-44b1-4f3f-b982-3f506fb4c1d4 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:57:08 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5d97fba1-44b1-4f3f-b982-3f506fb4c1d4 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:57:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5d97fba1-44b1-4f3f-b982-3f506fb4c1d4 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5d97fba1-44b1-4f3f-b982-3f506fb4c1d4 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:08 devstack sudo[103864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:57:08 devstack sudo[103864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:08 devstack sudo[103864]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5d97fba1-44b1-4f3f-b982-3f506fb4c1d4 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.322s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:08 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-5d97fba1-44b1-4f3f-b982-3f506fb4c1d4 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:57:08 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-5d97fba1-44b1-4f3f-b982-3f506fb4c1d4 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Deleted volume successfully.
Nov 06 11:57:08 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5d97fba1-44b1-4f3f-b982-3f506fb4c1d4 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "cinder-fc7e5da6-d0e3-4a25-921d-3544e3f22026-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:57:09 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-99d5b463-8367-401c-85c8-01b9f41f3d3a tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Acquiring lock "cinder-f79a85cf-1f1b-4f00-988d-d1896df97cfb-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:57:09 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-99d5b463-8367-401c-85c8-01b9f41f3d3a tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "cinder-f79a85cf-1f1b-4f00-988d-d1896df97cfb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:57:09 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-99d5b463-8367-401c-85c8-01b9f41f3d3a tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Acquiring lock "cinder-quobyte-f79a85cf-1f1b-4f00-988d-d1896df97cfb" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:57:09 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-99d5b463-8367-401c-85c8-01b9f41f3d3a tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "cinder-quobyte-f79a85cf-1f1b-4f00-988d-d1896df97cfb" acquired by "delete_volume" :: waited 0.026s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:57:09 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceaeb000-9942-4f30-b055-60e7a5695d87]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:57:09 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-99d5b463-8367-401c-85c8-01b9f41f3d3a tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f79a85cf-1f1b-4f00-988d-d1896df97cfb {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:09 devstack sudo[103903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f79a85cf-1f1b-4f00-988d-d1896df97cfb
Nov 06 11:57:09 devstack sudo[103903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:09 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-128b7b34-60e4-4aa3-829a-dbe1f2904850 tempest-VolumesListAdminTestJSON-996772640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:57:09 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-128b7b34-60e4-4aa3-829a-dbe1f2904850 tempest-VolumesListAdminTestJSON-996772640 None] Flow 'volume_create_manager' (5ee59ab3-715a-4f51-a5d6-ff0cc1ce80d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:57:09 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-128b7b34-60e4-4aa3-829a-dbe1f2904850 tempest-VolumesListAdminTestJSON-996772640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41748513-5a87-4bc3-a9f1-bf5c011ab1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:09 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-128b7b34-60e4-4aa3-829a-dbe1f2904850 tempest-VolumesListAdminTestJSON-996772640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41748513-5a87-4bc3-a9f1-bf5c011ab1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:57:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-23840703',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdb451a1-9393-4e6e-ba6e-b821ce83f026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896adac6abc84781ae373c99dcf9d3ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:57:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:57:10Z,use_quota=True,user_id='929d31867c704ee98ee413dc57541fae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-128b7b34-60e4-4aa3-829a-dbe1f2904850 tempest-VolumesListAdminTestJSON-996772640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ccf935e-c348-44bb-8162-249afa6e26e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-128b7b34-60e4-4aa3-829a-dbe1f2904850 tempest-VolumesListAdminTestJSON-996772640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ccf935e-c348-44bb-8162-249afa6e26e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-128b7b34-60e4-4aa3-829a-dbe1f2904850 tempest-VolumesListAdminTestJSON-996772640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9a21e34-814c-410b-b9c2-efb214e96e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-128b7b34-60e4-4aa3-829a-dbe1f2904850 tempest-VolumesListAdminTestJSON-996772640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9a21e34-814c-410b-b9c2-efb214e96e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdb451a1-9393-4e6e-ba6e-b821ce83f026', 'volume_name': 'volume-fdb451a1-9393-4e6e-ba6e-b821ce83f026', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-128b7b34-60e4-4aa3-829a-dbe1f2904850 tempest-VolumesListAdminTestJSON-996772640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a3787be-4976-40c8-8497-bda995ad99e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-128b7b34-60e4-4aa3-829a-dbe1f2904850 tempest-VolumesListAdminTestJSON-996772640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a3787be-4976-40c8-8497-bda995ad99e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-128b7b34-60e4-4aa3-829a-dbe1f2904850 tempest-VolumesListAdminTestJSON-996772640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fee8b1a2-b4e8-4780-9227-90a22615e5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:10 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-128b7b34-60e4-4aa3-829a-dbe1f2904850 tempest-VolumesListAdminTestJSON-996772640 None] Volume fdb451a1-9393-4e6e-ba6e-b821ce83f026: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdb451a1-9393-4e6e-ba6e-b821ce83f026', 'volume_size': 1}
Nov 06 11:57:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-128b7b34-60e4-4aa3-829a-dbe1f2904850 tempest-VolumesListAdminTestJSON-996772640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-128b7b34-60e4-4aa3-829a-dbe1f2904850 tempest-VolumesListAdminTestJSON-996772640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:10 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-128b7b34-60e4-4aa3-829a-dbe1f2904850 tempest-VolumesListAdminTestJSON-996772640 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:57:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-23840703',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdb451a1-9393-4e6e-ba6e-b821ce83f026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896adac6abc84781ae373c99dcf9d3ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:57:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:57:10Z,use_quota=True,user_id='929d31867c704ee98ee413dc57541fae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:57:10 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-128b7b34-60e4-4aa3-829a-dbe1f2904850 tempest-VolumesListAdminTestJSON-996772640 None] Creating volume fdb451a1-9393-4e6e-ba6e-b821ce83f026 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:57:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-128b7b34-60e4-4aa3-829a-dbe1f2904850 tempest-VolumesListAdminTestJSON-996772640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-128b7b34-60e4-4aa3-829a-dbe1f2904850 tempest-VolumesListAdminTestJSON-996772640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:10 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-128b7b34-60e4-4aa3-829a-dbe1f2904850 tempest-VolumesListAdminTestJSON-996772640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:57:10 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-128b7b34-60e4-4aa3-829a-dbe1f2904850 tempest-VolumesListAdminTestJSON-996772640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:57:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-128b7b34-60e4-4aa3-829a-dbe1f2904850 tempest-VolumesListAdminTestJSON-996772640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:10 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-128b7b34-60e4-4aa3-829a-dbe1f2904850 tempest-VolumesListAdminTestJSON-996772640 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:57:10 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-128b7b34-60e4-4aa3-829a-dbe1f2904850 tempest-VolumesListAdminTestJSON-996772640 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:57:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-128b7b34-60e4-4aa3-829a-dbe1f2904850 tempest-VolumesListAdminTestJSON-996772640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fdb451a1-9393-4e6e-ba6e-b821ce83f026 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:10 devstack sudo[103905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fdb451a1-9393-4e6e-ba6e-b821ce83f026 1073741824
Nov 06 11:57:10 devstack sudo[103905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:10 devstack sudo[103903]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-99d5b463-8367-401c-85c8-01b9f41f3d3a tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f79a85cf-1f1b-4f00-988d-d1896df97cfb" returned: 0 in 0.550s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-99d5b463-8367-401c-85c8-01b9f41f3d3a tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f79a85cf-1f1b-4f00-988d-d1896df97cfb {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:10 devstack sudo[103910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f79a85cf-1f1b-4f00-988d-d1896df97cfb
Nov 06 11:57:10 devstack sudo[103910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:10 devstack sudo[103910]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-99d5b463-8367-401c-85c8-01b9f41f3d3a tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f79a85cf-1f1b-4f00-988d-d1896df97cfb" returned: 0 in 0.293s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:10 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-99d5b463-8367-401c-85c8-01b9f41f3d3a tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "cinder-quobyte-f79a85cf-1f1b-4f00-988d-d1896df97cfb" released by "delete_volume" :: held 0.930s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:57:10 devstack sudo[103905]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-128b7b34-60e4-4aa3-829a-dbe1f2904850 tempest-VolumesListAdminTestJSON-996772640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fdb451a1-9393-4e6e-ba6e-b821ce83f026 1073741824" returned: 0 in 0.619s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:10 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-99d5b463-8367-401c-85c8-01b9f41f3d3a tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Created reservations ['5d16f183-4827-4289-ba0a-6af9b19acfcd', '60880324-dd8d-44bc-a501-fe2d63ca9912', '383cca04-585a-49bc-9add-f3b2319efad1', '710b8693-5653-43f8-841d-419f6a47f367'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:57:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-128b7b34-60e4-4aa3-829a-dbe1f2904850 tempest-VolumesListAdminTestJSON-996772640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fdb451a1-9393-4e6e-ba6e-b821ce83f026 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:10 devstack sudo[103917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fdb451a1-9393-4e6e-ba6e-b821ce83f026
Nov 06 11:57:10 devstack sudo[103917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-99d5b463-8367-401c-85c8-01b9f41f3d3a tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-99d5b463-8367-401c-85c8-01b9f41f3d3a tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:10 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-99d5b463-8367-401c-85c8-01b9f41f3d3a tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:57:10 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-99d5b463-8367-401c-85c8-01b9f41f3d3a tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:57:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-99d5b463-8367-401c-85c8-01b9f41f3d3a tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-99d5b463-8367-401c-85c8-01b9f41f3d3a tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:10 devstack sudo[103919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:57:10 devstack sudo[103919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:11 devstack sudo[103917]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-128b7b34-60e4-4aa3-829a-dbe1f2904850 tempest-VolumesListAdminTestJSON-996772640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fdb451a1-9393-4e6e-ba6e-b821ce83f026" returned: 0 in 0.306s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:11 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-128b7b34-60e4-4aa3-829a-dbe1f2904850 tempest-VolumesListAdminTestJSON-996772640 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:57:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-128b7b34-60e4-4aa3-829a-dbe1f2904850 tempest-VolumesListAdminTestJSON-996772640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:11 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-128b7b34-60e4-4aa3-829a-dbe1f2904850 tempest-VolumesListAdminTestJSON-996772640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fee8b1a2-b4e8-4780-9227-90a22615e5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdb451a1-9393-4e6e-ba6e-b821ce83f026', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:11 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-128b7b34-60e4-4aa3-829a-dbe1f2904850 tempest-VolumesListAdminTestJSON-996772640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18e59286-81a5-4f6c-a5e8-f8ce9cb0e1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:11 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-128b7b34-60e4-4aa3-829a-dbe1f2904850 tempest-VolumesListAdminTestJSON-996772640 None] Volume volume-fdb451a1-9393-4e6e-ba6e-b821ce83f026 (fdb451a1-9393-4e6e-ba6e-b821ce83f026): created successfully
Nov 06 11:57:11 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-128b7b34-60e4-4aa3-829a-dbe1f2904850 tempest-VolumesListAdminTestJSON-996772640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18e59286-81a5-4f6c-a5e8-f8ce9cb0e1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:11 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-128b7b34-60e4-4aa3-829a-dbe1f2904850 tempest-VolumesListAdminTestJSON-996772640 None] Flow 'volume_create_manager' (5ee59ab3-715a-4f51-a5d6-ff0cc1ce80d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:57:11 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-128b7b34-60e4-4aa3-829a-dbe1f2904850 tempest-VolumesListAdminTestJSON-996772640 None] Created volume successfully.
Nov 06 11:57:11 devstack sudo[103919]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-99d5b463-8367-401c-85c8-01b9f41f3d3a tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.339s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:11 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-99d5b463-8367-401c-85c8-01b9f41f3d3a tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:57:11 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-99d5b463-8367-401c-85c8-01b9f41f3d3a tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Deleted volume successfully.
Nov 06 11:57:11 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-99d5b463-8367-401c-85c8-01b9f41f3d3a tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "cinder-f79a85cf-1f1b-4f00-988d-d1896df97cfb-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:57:11 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ef496445-5440-4411-9a16-02422dc56d63 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Acquiring lock "cinder-325bea40-a2ff-4406-b6d8-ea95357ed527-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:57:11 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ef496445-5440-4411-9a16-02422dc56d63 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "cinder-325bea40-a2ff-4406-b6d8-ea95357ed527-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:57:11 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ef496445-5440-4411-9a16-02422dc56d63 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Acquiring lock "cinder-quobyte-325bea40-a2ff-4406-b6d8-ea95357ed527" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:57:12 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ef496445-5440-4411-9a16-02422dc56d63 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "cinder-quobyte-325bea40-a2ff-4406-b6d8-ea95357ed527" acquired by "delete_volume" :: waited 0.024s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:57:12 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c73d55e-a02a-4124-ab5d-1539c3ca4c57]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:57:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ef496445-5440-4411-9a16-02422dc56d63 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-325bea40-a2ff-4406-b6d8-ea95357ed527 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:12 devstack sudo[103923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-325bea40-a2ff-4406-b6d8-ea95357ed527
Nov 06 11:57:12 devstack sudo[103923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:12 devstack sudo[103923]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ef496445-5440-4411-9a16-02422dc56d63 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-325bea40-a2ff-4406-b6d8-ea95357ed527" returned: 0 in 0.453s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ef496445-5440-4411-9a16-02422dc56d63 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-325bea40-a2ff-4406-b6d8-ea95357ed527 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:12 devstack sudo[103928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-325bea40-a2ff-4406-b6d8-ea95357ed527
Nov 06 11:57:12 devstack sudo[103928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:12 devstack sudo[103928]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ef496445-5440-4411-9a16-02422dc56d63 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-325bea40-a2ff-4406-b6d8-ea95357ed527" returned: 0 in 0.378s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:12 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ef496445-5440-4411-9a16-02422dc56d63 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "cinder-quobyte-325bea40-a2ff-4406-b6d8-ea95357ed527" released by "delete_volume" :: held 0.930s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:57:13 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-ef496445-5440-4411-9a16-02422dc56d63 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Created reservations ['13469ffe-0149-4c6d-b4b1-ce18530eab88', 'c9c5ad9f-f43c-45f9-bcb4-caac47221066', '78b60d09-8c50-4637-a332-f20b0ba81ef1', '1f9eb1d6-0ba0-45d7-9cea-e8f7ecf9b4b5'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:57:13 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4b3b20d-41a8-468e-96c4-3734d82e6ac3 tempest-VolumesListAdminTestJSON-2055373785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:57:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f4b3b20d-41a8-468e-96c4-3734d82e6ac3 tempest-VolumesListAdminTestJSON-2055373785 None] Flow 'volume_create_manager' (dddac7c7-1b5e-446e-9973-26602f793a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:57:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f4b3b20d-41a8-468e-96c4-3734d82e6ac3 tempest-VolumesListAdminTestJSON-2055373785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46558127-5dd6-4c42-8384-94c10479fc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ef496445-5440-4411-9a16-02422dc56d63 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ef496445-5440-4411-9a16-02422dc56d63 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:13 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ef496445-5440-4411-9a16-02422dc56d63 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:57:13 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ef496445-5440-4411-9a16-02422dc56d63 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:57:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ef496445-5440-4411-9a16-02422dc56d63 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ef496445-5440-4411-9a16-02422dc56d63 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:13 devstack sudo[103931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:57:13 devstack sudo[103931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f4b3b20d-41a8-468e-96c4-3734d82e6ac3 tempest-VolumesListAdminTestJSON-2055373785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46558127-5dd6-4c42-8384-94c10479fc25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32dedc71-9519-4684-bd28-6c8152679f5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac81e05c72b54f08ab9efcb4da47ed0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:57:13Z,use_quota=True,user_id='e3e0457dc17a4673809769ec86f0c5c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f4b3b20d-41a8-468e-96c4-3734d82e6ac3 tempest-VolumesListAdminTestJSON-2055373785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63cf74fc-c457-483b-bdd1-4f7ca583bae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f4b3b20d-41a8-468e-96c4-3734d82e6ac3 tempest-VolumesListAdminTestJSON-2055373785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63cf74fc-c457-483b-bdd1-4f7ca583bae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f4b3b20d-41a8-468e-96c4-3734d82e6ac3 tempest-VolumesListAdminTestJSON-2055373785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2dcca77-58b4-4310-ba4b-35b065645dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f4b3b20d-41a8-468e-96c4-3734d82e6ac3 tempest-VolumesListAdminTestJSON-2055373785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2dcca77-58b4-4310-ba4b-35b065645dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32dedc71-9519-4684-bd28-6c8152679f5c', 'volume_name': 'volume-32dedc71-9519-4684-bd28-6c8152679f5c', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f4b3b20d-41a8-468e-96c4-3734d82e6ac3 tempest-VolumesListAdminTestJSON-2055373785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c47e425-0462-49bc-b88a-0c2176347327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f4b3b20d-41a8-468e-96c4-3734d82e6ac3 tempest-VolumesListAdminTestJSON-2055373785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c47e425-0462-49bc-b88a-0c2176347327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f4b3b20d-41a8-468e-96c4-3734d82e6ac3 tempest-VolumesListAdminTestJSON-2055373785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d262458a-6d08-4da4-8fad-63fe535cd986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:13 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-f4b3b20d-41a8-468e-96c4-3734d82e6ac3 tempest-VolumesListAdminTestJSON-2055373785 None] Volume 32dedc71-9519-4684-bd28-6c8152679f5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32dedc71-9519-4684-bd28-6c8152679f5c', 'volume_size': 1}
Nov 06 11:57:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f4b3b20d-41a8-468e-96c4-3734d82e6ac3 tempest-VolumesListAdminTestJSON-2055373785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f4b3b20d-41a8-468e-96c4-3734d82e6ac3 tempest-VolumesListAdminTestJSON-2055373785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:13 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-f4b3b20d-41a8-468e-96c4-3734d82e6ac3 tempest-VolumesListAdminTestJSON-2055373785 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32dedc71-9519-4684-bd28-6c8152679f5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac81e05c72b54f08ab9efcb4da47ed0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:57:13Z,use_quota=True,user_id='e3e0457dc17a4673809769ec86f0c5c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:57:13 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-f4b3b20d-41a8-468e-96c4-3734d82e6ac3 tempest-VolumesListAdminTestJSON-2055373785 None] Creating volume 32dedc71-9519-4684-bd28-6c8152679f5c {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:57:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f4b3b20d-41a8-468e-96c4-3734d82e6ac3 tempest-VolumesListAdminTestJSON-2055373785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f4b3b20d-41a8-468e-96c4-3734d82e6ac3 tempest-VolumesListAdminTestJSON-2055373785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:13 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-f4b3b20d-41a8-468e-96c4-3734d82e6ac3 tempest-VolumesListAdminTestJSON-2055373785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:57:13 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-f4b3b20d-41a8-468e-96c4-3734d82e6ac3 tempest-VolumesListAdminTestJSON-2055373785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:57:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f4b3b20d-41a8-468e-96c4-3734d82e6ac3 tempest-VolumesListAdminTestJSON-2055373785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:13 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-f4b3b20d-41a8-468e-96c4-3734d82e6ac3 tempest-VolumesListAdminTestJSON-2055373785 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:57:13 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-f4b3b20d-41a8-468e-96c4-3734d82e6ac3 tempest-VolumesListAdminTestJSON-2055373785 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:57:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f4b3b20d-41a8-468e-96c4-3734d82e6ac3 tempest-VolumesListAdminTestJSON-2055373785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-32dedc71-9519-4684-bd28-6c8152679f5c 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:13 devstack sudo[103933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-32dedc71-9519-4684-bd28-6c8152679f5c 1073741824
Nov 06 11:57:13 devstack sudo[103933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:13 devstack sudo[103931]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ef496445-5440-4411-9a16-02422dc56d63 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.307s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:13 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-ef496445-5440-4411-9a16-02422dc56d63 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:57:13 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-ef496445-5440-4411-9a16-02422dc56d63 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Deleted volume successfully.
Nov 06 11:57:13 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ef496445-5440-4411-9a16-02422dc56d63 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "cinder-325bea40-a2ff-4406-b6d8-ea95357ed527-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:57:13 devstack sudo[103933]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f4b3b20d-41a8-468e-96c4-3734d82e6ac3 tempest-VolumesListAdminTestJSON-2055373785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-32dedc71-9519-4684-bd28-6c8152679f5c 1073741824" returned: 0 in 0.503s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f4b3b20d-41a8-468e-96c4-3734d82e6ac3 tempest-VolumesListAdminTestJSON-2055373785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-32dedc71-9519-4684-bd28-6c8152679f5c {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:13 devstack sudo[103940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-32dedc71-9519-4684-bd28-6c8152679f5c
Nov 06 11:57:13 devstack sudo[103940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:14 devstack sudo[103940]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f4b3b20d-41a8-468e-96c4-3734d82e6ac3 tempest-VolumesListAdminTestJSON-2055373785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-32dedc71-9519-4684-bd28-6c8152679f5c" returned: 0 in 0.385s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:14 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-f4b3b20d-41a8-468e-96c4-3734d82e6ac3 tempest-VolumesListAdminTestJSON-2055373785 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:57:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f4b3b20d-41a8-468e-96c4-3734d82e6ac3 tempest-VolumesListAdminTestJSON-2055373785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:14 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f4b3b20d-41a8-468e-96c4-3734d82e6ac3 tempest-VolumesListAdminTestJSON-2055373785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d262458a-6d08-4da4-8fad-63fe535cd986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32dedc71-9519-4684-bd28-6c8152679f5c', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:14 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f4b3b20d-41a8-468e-96c4-3734d82e6ac3 tempest-VolumesListAdminTestJSON-2055373785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68330313-159e-4e70-8506-3e6ca6a4970d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:14 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-2eb6a2e6-9d28-4dff-8945-20a2f975ebe1 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Acquiring lock "cinder-331f9373-e8e8-4267-a039-9136a0cda045-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:57:14 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-f4b3b20d-41a8-468e-96c4-3734d82e6ac3 tempest-VolumesListAdminTestJSON-2055373785 None] Volume volume-32dedc71-9519-4684-bd28-6c8152679f5c (32dedc71-9519-4684-bd28-6c8152679f5c): created successfully
Nov 06 11:57:14 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f4b3b20d-41a8-468e-96c4-3734d82e6ac3 tempest-VolumesListAdminTestJSON-2055373785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68330313-159e-4e70-8506-3e6ca6a4970d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:14 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-f4b3b20d-41a8-468e-96c4-3734d82e6ac3 tempest-VolumesListAdminTestJSON-2055373785 None] Flow 'volume_create_manager' (dddac7c7-1b5e-446e-9973-26602f793a79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:57:14 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-2eb6a2e6-9d28-4dff-8945-20a2f975ebe1 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "cinder-331f9373-e8e8-4267-a039-9136a0cda045-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:57:14 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-f4b3b20d-41a8-468e-96c4-3734d82e6ac3 tempest-VolumesListAdminTestJSON-2055373785 None] Created volume successfully.
Nov 06 11:57:14 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-2eb6a2e6-9d28-4dff-8945-20a2f975ebe1 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Acquiring lock "cinder-quobyte-331f9373-e8e8-4267-a039-9136a0cda045" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:57:14 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-2eb6a2e6-9d28-4dff-8945-20a2f975ebe1 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "cinder-quobyte-331f9373-e8e8-4267-a039-9136a0cda045" acquired by "delete_volume" :: waited 0.017s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:57:14 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e982e389-0621-4e0b-adc4-f53827081346]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:57:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2eb6a2e6-9d28-4dff-8945-20a2f975ebe1 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-331f9373-e8e8-4267-a039-9136a0cda045 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:14 devstack sudo[103943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-331f9373-e8e8-4267-a039-9136a0cda045
Nov 06 11:57:14 devstack sudo[103943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:14 devstack sudo[103943]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2eb6a2e6-9d28-4dff-8945-20a2f975ebe1 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-331f9373-e8e8-4267-a039-9136a0cda045" returned: 0 in 0.464s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2eb6a2e6-9d28-4dff-8945-20a2f975ebe1 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-331f9373-e8e8-4267-a039-9136a0cda045 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:14 devstack sudo[103949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-331f9373-e8e8-4267-a039-9136a0cda045
Nov 06 11:57:14 devstack sudo[103949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:14 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:57:14 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Flow 'volume_create_manager' (5643b912-1372-44d8-9dbf-67a8bebb89b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:57:14 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88500d5a-8b8c-4bf6-a973-1801ea6020ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:14 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88500d5a-8b8c-4bf6-a973-1801ea6020ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=380ed9bf-dc2b-4ad3-9969-d71f30581fdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6517b85a5a5340aeb08ffe683e014e14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:57:15Z,use_quota=True,user_id='61d0c563b8b84133be49884a2ffc047d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:14 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f325253-0128-4d9a-b443-533cd5d2a14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:14 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f325253-0128-4d9a-b443-533cd5d2a14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:14 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b96c66c-ecbd-4ac7-a523-0b167eaf79fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:14 devstack cinder-volume[87165]: DEBUG cinder.image.glance [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Creating Keystone auth plugin from conf {{(pid=87165) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 06 11:57:15 devstack sudo[103949]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2eb6a2e6-9d28-4dff-8945-20a2f975ebe1 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-331f9373-e8e8-4267-a039-9136a0cda045" returned: 0 in 0.297s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:15 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-2eb6a2e6-9d28-4dff-8945-20a2f975ebe1 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "cinder-quobyte-331f9373-e8e8-4267-a039-9136a0cda045" released by "delete_volume" :: held 0.829s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:57:15 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-2eb6a2e6-9d28-4dff-8945-20a2f975ebe1 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Created reservations ['2f765d17-18eb-402a-8d3f-7aceb9fe0c14', 'aec25ebf-3365-4287-a198-5443394743c3', '6ae3e427-d98d-4a04-bb32-619d07eb1247', '346098ed-e34a-4ece-a565-cfdde6220064'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:57:15 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-dd28bde9-227d-4ac1-8f6e-d145d759b3a7 tempest-VolumesListAdminTestJSON-2055373785 None] Acquiring lock "cinder-32dedc71-9519-4684-bd28-6c8152679f5c-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:57:15 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-dd28bde9-227d-4ac1-8f6e-d145d759b3a7 tempest-VolumesListAdminTestJSON-2055373785 None] Lock "cinder-32dedc71-9519-4684-bd28-6c8152679f5c-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:57:15 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b96c66c-ecbd-4ac7-a523-0b167eaf79fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '380ed9bf-dc2b-4ad3-9969-d71f30581fdd', 'volume_name': 'volume-380ed9bf-dc2b-4ad3-9969-d71f30581fdd', 'volume_size': 1, 'image_id': '2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd3c9b62604e54fcf0fd40477ca6e3eb1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6517b85a5a5340aeb08ffe683e014e14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8b559e2426528a6785000a0b94427a7a519f80465078c5daf49b0bbc39d05328b20420070ed798b0fe19b8d80b307649b5f0e4e45c10a5360f80959beab8c655', 'id': '2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c', 'created_at': datetime.datetime(2026, 11, 6, 10, 57, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 10, 57, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x742c13ceec90>}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:15 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a3c4ab8-3c89-4033-a49d-e6f44b357b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:15 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a3c4ab8-3c89-4033-a49d-e6f44b357b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:15 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea9f28df-d6a5-40a2-9b01-0a1a6ba1d161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:15 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Volume 380ed9bf-dc2b-4ad3-9969-d71f30581fdd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-380ed9bf-dc2b-4ad3-9969-d71f30581fdd', 'volume_size': 1, 'image_id': '2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd3c9b62604e54fcf0fd40477ca6e3eb1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6517b85a5a5340aeb08ffe683e014e14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8b559e2426528a6785000a0b94427a7a519f80465078c5daf49b0bbc39d05328b20420070ed798b0fe19b8d80b307649b5f0e4e45c10a5360f80959beab8c655', 'id': '2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c', 'created_at': datetime.datetime(2026, 11, 6, 10, 57, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 10, 57, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x742c13ceec90>}
Nov 06 11:57:15 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Trying to clone 380ed9bf-dc2b-4ad3-9969-d71f30581fdd from image 2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c at location (None, [{'url': 'file:///opt/stack/data/glance/images/2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c', 'metadata': {}}]). {{(pid=87165) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 06 11:57:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-2eb6a2e6-9d28-4dff-8945-20a2f975ebe1 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-2eb6a2e6-9d28-4dff-8945-20a2f975ebe1 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:15 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-2eb6a2e6-9d28-4dff-8945-20a2f975ebe1 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:57:15 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-2eb6a2e6-9d28-4dff-8945-20a2f975ebe1 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:57:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-2eb6a2e6-9d28-4dff-8945-20a2f975ebe1 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2eb6a2e6-9d28-4dff-8945-20a2f975ebe1 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:15 devstack sudo[103952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:57:15 devstack sudo[103952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:15 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a19cf229-4f4d-4e34-963a-fa03e3a53613 tempest-VolumesListAdminTestJSON-996772640 None] Acquiring lock "cinder-fdb451a1-9393-4e6e-ba6e-b821ce83f026-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:57:15 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-dd28bde9-227d-4ac1-8f6e-d145d759b3a7 tempest-VolumesListAdminTestJSON-2055373785 None] Acquiring lock "cinder-quobyte-32dedc71-9519-4684-bd28-6c8152679f5c" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:57:15 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a19cf229-4f4d-4e34-963a-fa03e3a53613 tempest-VolumesListAdminTestJSON-996772640 None] Lock "cinder-fdb451a1-9393-4e6e-ba6e-b821ce83f026-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:57:15 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-dd28bde9-227d-4ac1-8f6e-d145d759b3a7 tempest-VolumesListAdminTestJSON-2055373785 None] Lock "cinder-quobyte-32dedc71-9519-4684-bd28-6c8152679f5c" acquired by "delete_volume" :: waited 0.038s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:57:15 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9bc900-11f5-4a8e-b0e6-4703c0450063]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:57:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-dd28bde9-227d-4ac1-8f6e-d145d759b3a7 tempest-VolumesListAdminTestJSON-2055373785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-32dedc71-9519-4684-bd28-6c8152679f5c {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:15 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c_nwmwnpnsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87165) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 06 11:57:15 devstack cinder-volume[87165]: INFO cinder.image.image_utils [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Image download 0.00 MB at 0.00 MB/s
Nov 06 11:57:15 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a19cf229-4f4d-4e34-963a-fa03e3a53613 tempest-VolumesListAdminTestJSON-996772640 None] Acquiring lock "cinder-quobyte-fdb451a1-9393-4e6e-ba6e-b821ce83f026" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:57:15 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a19cf229-4f4d-4e34-963a-fa03e3a53613 tempest-VolumesListAdminTestJSON-996772640 None] Lock "cinder-quobyte-fdb451a1-9393-4e6e-ba6e-b821ce83f026" acquired by "delete_volume" :: waited 0.031s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:57:15 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1373c6cb-212c-4089-8bbe-94a34c27124d]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:57:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a19cf229-4f4d-4e34-963a-fa03e3a53613 tempest-VolumesListAdminTestJSON-996772640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fdb451a1-9393-4e6e-ba6e-b821ce83f026 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:15 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[40811346-aa6d-4c83-9c48-644587f96158]: (4, 'raw') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:57:15 devstack sudo[103954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-32dedc71-9519-4684-bd28-6c8152679f5c
Nov 06 11:57:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c_nwmwnpnsdevstack@QuobyteHD {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:15 devstack sudo[103954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:15 devstack sudo[103952]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2eb6a2e6-9d28-4dff-8945-20a2f975ebe1 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.412s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:15 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-2eb6a2e6-9d28-4dff-8945-20a2f975ebe1 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:57:15 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-2eb6a2e6-9d28-4dff-8945-20a2f975ebe1 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Deleted volume successfully.
Nov 06 11:57:15 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-2eb6a2e6-9d28-4dff-8945-20a2f975ebe1 tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "cinder-331f9373-e8e8-4267-a039-9136a0cda045-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:57:16 devstack sudo[103958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c_nwmwnpnsdevstack@QuobyteHD
Nov 06 11:57:16 devstack sudo[103958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:16 devstack sudo[103956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fdb451a1-9393-4e6e-ba6e-b821ce83f026
Nov 06 11:57:16 devstack sudo[103956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:16 devstack sudo[103954]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-dd28bde9-227d-4ac1-8f6e-d145d759b3a7 tempest-VolumesListAdminTestJSON-2055373785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-32dedc71-9519-4684-bd28-6c8152679f5c" returned: 0 in 0.555s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-dd28bde9-227d-4ac1-8f6e-d145d759b3a7 tempest-VolumesListAdminTestJSON-2055373785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-32dedc71-9519-4684-bd28-6c8152679f5c {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:16 devstack sudo[103958]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c_nwmwnpnsdevstack@QuobyteHD" returned: 0 in 0.429s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c_nwmwnpnsdevstack@QuobyteHD {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:16 devstack sudo[103966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-32dedc71-9519-4684-bd28-6c8152679f5c
Nov 06 11:57:16 devstack sudo[103966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:16 devstack sudo[103970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c_nwmwnpnsdevstack@QuobyteHD
Nov 06 11:57:16 devstack sudo[103970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:16 devstack sudo[103956]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a19cf229-4f4d-4e34-963a-fa03e3a53613 tempest-VolumesListAdminTestJSON-996772640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fdb451a1-9393-4e6e-ba6e-b821ce83f026" returned: 0 in 0.603s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a19cf229-4f4d-4e34-963a-fa03e3a53613 tempest-VolumesListAdminTestJSON-996772640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fdb451a1-9393-4e6e-ba6e-b821ce83f026 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:16 devstack sudo[103973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fdb451a1-9393-4e6e-ba6e-b821ce83f026
Nov 06 11:57:16 devstack sudo[103973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:16 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-81543f0f-58a3-4fa2-8ae6-298da79d3a0e tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Acquiring lock "cinder-93b92557-830a-4739-91d4-14295dcf6c9e-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:57:16 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-81543f0f-58a3-4fa2-8ae6-298da79d3a0e tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "cinder-93b92557-830a-4739-91d4-14295dcf6c9e-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:57:16 devstack sudo[103966]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-dd28bde9-227d-4ac1-8f6e-d145d759b3a7 tempest-VolumesListAdminTestJSON-2055373785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-32dedc71-9519-4684-bd28-6c8152679f5c" returned: 0 in 0.425s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:16 devstack sudo[103970]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c_nwmwnpnsdevstack@QuobyteHD" returned: 1 in 0.414s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c_nwmwnpnsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 11:57:16 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Temporary image 2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c is fetched for user 61d0c563b8b84133be49884a2ffc047d. {{(pid=87165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 06 11:57:16 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-81543f0f-58a3-4fa2-8ae6-298da79d3a0e tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Acquiring lock "cinder-quobyte-93b92557-830a-4739-91d4-14295dcf6c9e" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:57:16 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-dd28bde9-227d-4ac1-8f6e-d145d759b3a7 tempest-VolumesListAdminTestJSON-2055373785 None] Lock "cinder-quobyte-32dedc71-9519-4684-bd28-6c8152679f5c" released by "delete_volume" :: held 1.088s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:57:16 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-81543f0f-58a3-4fa2-8ae6-298da79d3a0e tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "cinder-quobyte-93b92557-830a-4739-91d4-14295dcf6c9e" acquired by "delete_volume" :: waited 0.037s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:57:16 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d04028e-3b67-48a9-b464-6153429116c7]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:57:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-81543f0f-58a3-4fa2-8ae6-298da79d3a0e tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-93b92557-830a-4739-91d4-14295dcf6c9e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:16 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43584f0-ec33-42ba-9ff3-0d6325afd07d]: (4, 'raw') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:57:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c_nwmwnpnsdevstack@QuobyteHD {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:16 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-dd28bde9-227d-4ac1-8f6e-d145d759b3a7 tempest-VolumesListAdminTestJSON-2055373785 None] Created reservations ['133b1fe2-05ff-4956-9c8a-479611d2f54f', '67a9daed-821b-472a-aa86-1d2e80a12cbf', '8b92b81a-32cd-4897-a24b-f9e180d5c5cf', '1e631a94-3f86-4e99-8307-040678621f8b'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:57:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-dd28bde9-227d-4ac1-8f6e-d145d759b3a7 tempest-VolumesListAdminTestJSON-2055373785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-dd28bde9-227d-4ac1-8f6e-d145d759b3a7 tempest-VolumesListAdminTestJSON-2055373785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:16 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-dd28bde9-227d-4ac1-8f6e-d145d759b3a7 tempest-VolumesListAdminTestJSON-2055373785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:57:16 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-dd28bde9-227d-4ac1-8f6e-d145d759b3a7 tempest-VolumesListAdminTestJSON-2055373785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:57:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-dd28bde9-227d-4ac1-8f6e-d145d759b3a7 tempest-VolumesListAdminTestJSON-2055373785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-dd28bde9-227d-4ac1-8f6e-d145d759b3a7 tempest-VolumesListAdminTestJSON-2055373785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:16 devstack sudo[103973]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a19cf229-4f4d-4e34-963a-fa03e3a53613 tempest-VolumesListAdminTestJSON-996772640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fdb451a1-9393-4e6e-ba6e-b821ce83f026" returned: 0 in 0.534s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:17 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a19cf229-4f4d-4e34-963a-fa03e3a53613 tempest-VolumesListAdminTestJSON-996772640 None] Lock "cinder-quobyte-fdb451a1-9393-4e6e-ba6e-b821ce83f026" released by "delete_volume" :: held 1.205s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:57:17 devstack sudo[103982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:57:17 devstack sudo[103982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:17 devstack sudo[103979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-93b92557-830a-4739-91d4-14295dcf6c9e
Nov 06 11:57:17 devstack sudo[103979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:17 devstack sudo[103980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c_nwmwnpnsdevstack@QuobyteHD
Nov 06 11:57:17 devstack sudo[103980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:17 devstack cinder-volume[87165]: DEBUG oslo_service.periodic_task [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 11:57:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:57:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:57:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:17 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-a19cf229-4f4d-4e34-963a-fa03e3a53613 tempest-VolumesListAdminTestJSON-996772640 None] Created reservations ['ecee164c-2a28-4981-90e0-175856f55a14', '6f8d6c86-2dd7-4ded-8301-07c922a8a210', '2a4adced-6910-45bd-89c1-cc6ea5144208', '0cd66148-bd88-4a2f-bffc-6c08d10e322a'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:57:17 devstack sudo[103986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:57:17 devstack sudo[103986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a19cf229-4f4d-4e34-963a-fa03e3a53613 tempest-VolumesListAdminTestJSON-996772640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a19cf229-4f4d-4e34-963a-fa03e3a53613 tempest-VolumesListAdminTestJSON-996772640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a19cf229-4f4d-4e34-963a-fa03e3a53613 tempest-VolumesListAdminTestJSON-996772640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:57:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a19cf229-4f4d-4e34-963a-fa03e3a53613 tempest-VolumesListAdminTestJSON-996772640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:57:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a19cf229-4f4d-4e34-963a-fa03e3a53613 tempest-VolumesListAdminTestJSON-996772640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a19cf229-4f4d-4e34-963a-fa03e3a53613 tempest-VolumesListAdminTestJSON-996772640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:17 devstack sudo[103988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:57:17 devstack sudo[103988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:17 devstack sudo[103979]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-81543f0f-58a3-4fa2-8ae6-298da79d3a0e tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-93b92557-830a-4739-91d4-14295dcf6c9e" returned: 0 in 0.735s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-81543f0f-58a3-4fa2-8ae6-298da79d3a0e tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-93b92557-830a-4739-91d4-14295dcf6c9e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:17 devstack sudo[103980]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c_nwmwnpnsdevstack@QuobyteHD" returned: 0 in 0.727s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c_nwmwnpnsdevstack@QuobyteHD {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:17 devstack sudo[103995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-93b92557-830a-4739-91d4-14295dcf6c9e
Nov 06 11:57:17 devstack sudo[103995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:17 devstack sudo[103982]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-dd28bde9-227d-4ac1-8f6e-d145d759b3a7 tempest-VolumesListAdminTestJSON-2055373785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.730s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:17 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-dd28bde9-227d-4ac1-8f6e-d145d759b3a7 tempest-VolumesListAdminTestJSON-2055373785 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:57:17 devstack sudo[103988]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:17 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-dd28bde9-227d-4ac1-8f6e-d145d759b3a7 tempest-VolumesListAdminTestJSON-2055373785 None] Deleted volume successfully.
Nov 06 11:57:17 devstack sudo[103986]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a19cf229-4f4d-4e34-963a-fa03e3a53613 tempest-VolumesListAdminTestJSON-996772640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.380s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:17 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-a19cf229-4f4d-4e34-963a-fa03e3a53613 tempest-VolumesListAdminTestJSON-996772640 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:57:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.579s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:17 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:57:17 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-a19cf229-4f4d-4e34-963a-fa03e3a53613 tempest-VolumesListAdminTestJSON-996772640 None] Deleted volume successfully.
Nov 06 11:57:17 devstack cinder-volume[87165]: DEBUG oslo_service.periodic_task [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running periodic task VolumeManager._thread_info {{(pid=87165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 11:57:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] thread count: 29 {{(pid=87165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 11:57:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] thread info: [<_MainThread(MainThread, started 127732956901504)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127732842693056)>, <Thread(Thread-3 (stat_writer), started daemon 127732841891136)>, <Thread(Rabbit-heartbeat, started daemon 127732842515648)>, <Thread(Thread-5 (_runner), started daemon 127732840534464)>, <Thread(Thread-7 (_runner), started daemon 127732840636032)>, <Thread(fd_logger, started daemon 127732838664256)>, <Thread(privsep_reader, started daemon 127732838673408)>, <Thread(tpool_thread_0, started daemon 127732829828800)>, <Thread(tpool_thread_1, started daemon 127732821436096)>, <Thread(tpool_thread_2, started daemon 127732813043392)>, <Thread(tpool_thread_3, started daemon 127732804650688)>, <Thread(tpool_thread_4, started daemon 127732796257984)>, <Thread(tpool_thread_5, started daemon 127732787865280)>, <Thread(tpool_thread_6, started daemon 127732779456192)>, <Thread(tpool_thread_7, started daemon 127732771047104)>, <Thread(tpool_thread_8, started daemon 127732762638016)>, <Thread(tpool_thread_9, started daemon 127732754228928)>, <Thread(tpool_thread_10, started daemon 127732745819840)>, <Thread(tpool_thread_11, started daemon 127732737410752)>, <Thread(tpool_thread_12, started daemon 127732729001664)>, <Thread(tpool_thread_13, started daemon 127732720592576)>, <Thread(tpool_thread_14, started daemon 127732712183488)>, <Thread(tpool_thread_15, started daemon 127732703774400)>, <Thread(tpool_thread_16, started daemon 127732695365312)>, <Thread(tpool_thread_17, started daemon 127732686956224)>, <Thread(tpool_thread_18, started daemon 127732678547136)>, <Thread(tpool_thread_19, started daemon 127732670138048)>, <Thread(Rabbit-heartbeat, started daemon 127732832631296)>] {{(pid=87165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 11:57:17 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-dd28bde9-227d-4ac1-8f6e-d145d759b3a7 tempest-VolumesListAdminTestJSON-2055373785 None] Lock "cinder-32dedc71-9519-4684-bd28-6c8152679f5c-delete_volume" released by "delete_volume" :: held 2.448s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:57:17 devstack sudo[103999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c_nwmwnpnsdevstack@QuobyteHD
Nov 06 11:57:17 devstack sudo[103999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:17 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a19cf229-4f4d-4e34-963a-fa03e3a53613 tempest-VolumesListAdminTestJSON-996772640 None] Lock "cinder-fdb451a1-9393-4e6e-ba6e-b821ce83f026-delete_volume" released by "delete_volume" :: held 2.180s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:57:17 devstack sudo[103995]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-81543f0f-58a3-4fa2-8ae6-298da79d3a0e tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-93b92557-830a-4739-91d4-14295dcf6c9e" returned: 0 in 0.412s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:17 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-81543f0f-58a3-4fa2-8ae6-298da79d3a0e tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "cinder-quobyte-93b92557-830a-4739-91d4-14295dcf6c9e" released by "delete_volume" :: held 1.207s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:57:18 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-f6fccde1-878b-445c-b839-a40f7ad62a6e tempest-VolumesListAdminTestJSON-996772640 None] Acquiring lock "cinder-a0e723e4-1f37-4645-b9e4-06feff7bfa57-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:57:18 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-f6fccde1-878b-445c-b839-a40f7ad62a6e tempest-VolumesListAdminTestJSON-996772640 None] Lock "cinder-a0e723e4-1f37-4645-b9e4-06feff7bfa57-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:57:18 devstack sudo[103999]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c_nwmwnpnsdevstack@QuobyteHD" returned: 1 in 0.502s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c_nwmwnpnsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 11:57:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:18 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=380ed9bf-dc2b-4ad3-9969-d71f30581fdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6517b85a5a5340aeb08ffe683e014e14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:57:15Z,use_quota=True,user_id='61d0c563b8b84133be49884a2ffc047d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:57:18 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Creating volume 380ed9bf-dc2b-4ad3-9969-d71f30581fdd {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:57:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:18 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:57:18 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:57:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:18 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:57:18 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:57:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-380ed9bf-dc2b-4ad3-9969-d71f30581fdd 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:18 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-81543f0f-58a3-4fa2-8ae6-298da79d3a0e tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Created reservations ['2b205460-bf15-487e-b603-d2ad94ab6e06', '843903a3-67fa-4866-9e7d-fae9ac32312d', 'c5dfbfad-8043-40e4-9f84-d5b7cb2f25dc', 'd1daead6-fee9-419a-97a8-6b6bfe4f583d'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:57:18 devstack sudo[104006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-380ed9bf-dc2b-4ad3-9969-d71f30581fdd 1073741824
Nov 06 11:57:18 devstack sudo[104006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:18 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-f6fccde1-878b-445c-b839-a40f7ad62a6e tempest-VolumesListAdminTestJSON-996772640 None] Acquiring lock "cinder-quobyte-a0e723e4-1f37-4645-b9e4-06feff7bfa57" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:57:18 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-f6fccde1-878b-445c-b839-a40f7ad62a6e tempest-VolumesListAdminTestJSON-996772640 None] Lock "cinder-quobyte-a0e723e4-1f37-4645-b9e4-06feff7bfa57" acquired by "delete_volume" :: waited 0.019s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:57:18 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[444bb8ca-ba07-4905-8f49-7b76bc52fe68]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:57:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f6fccde1-878b-445c-b839-a40f7ad62a6e tempest-VolumesListAdminTestJSON-996772640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a0e723e4-1f37-4645-b9e4-06feff7bfa57 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-81543f0f-58a3-4fa2-8ae6-298da79d3a0e tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-81543f0f-58a3-4fa2-8ae6-298da79d3a0e tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:18 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-81543f0f-58a3-4fa2-8ae6-298da79d3a0e tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:57:18 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-81543f0f-58a3-4fa2-8ae6-298da79d3a0e tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:57:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-81543f0f-58a3-4fa2-8ae6-298da79d3a0e tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-81543f0f-58a3-4fa2-8ae6-298da79d3a0e tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:18 devstack sudo[104009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:57:18 devstack sudo[104009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:18 devstack sudo[104008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a0e723e4-1f37-4645-b9e4-06feff7bfa57
Nov 06 11:57:18 devstack sudo[104008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:18 devstack sudo[104009]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-81543f0f-58a3-4fa2-8ae6-298da79d3a0e tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.425s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:18 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-81543f0f-58a3-4fa2-8ae6-298da79d3a0e tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:57:18 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-81543f0f-58a3-4fa2-8ae6-298da79d3a0e tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Deleted volume successfully.
Nov 06 11:57:18 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-81543f0f-58a3-4fa2-8ae6-298da79d3a0e tempest-CreateVolumesFromSourceVolumeTest-1312225407 None] Lock "cinder-93b92557-830a-4739-91d4-14295dcf6c9e-delete_volume" released by "delete_volume" :: held 2.178s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:57:18 devstack sudo[104006]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-380ed9bf-dc2b-4ad3-9969-d71f30581fdd 1073741824" returned: 0 in 0.738s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:18 devstack sudo[104008]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f6fccde1-878b-445c-b839-a40f7ad62a6e tempest-VolumesListAdminTestJSON-996772640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a0e723e4-1f37-4645-b9e4-06feff7bfa57" returned: 0 in 0.627s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f6fccde1-878b-445c-b839-a40f7ad62a6e tempest-VolumesListAdminTestJSON-996772640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a0e723e4-1f37-4645-b9e4-06feff7bfa57 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-380ed9bf-dc2b-4ad3-9969-d71f30581fdd {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:18 devstack sudo[104020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a0e723e4-1f37-4645-b9e4-06feff7bfa57
Nov 06 11:57:18 devstack sudo[104020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:18 devstack sudo[104021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-380ed9bf-dc2b-4ad3-9969-d71f30581fdd
Nov 06 11:57:18 devstack sudo[104021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:19 devstack sudo[104020]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f6fccde1-878b-445c-b839-a40f7ad62a6e tempest-VolumesListAdminTestJSON-996772640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a0e723e4-1f37-4645-b9e4-06feff7bfa57" returned: 0 in 0.355s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:19 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-f6fccde1-878b-445c-b839-a40f7ad62a6e tempest-VolumesListAdminTestJSON-996772640 None] Lock "cinder-quobyte-a0e723e4-1f37-4645-b9e4-06feff7bfa57" released by "delete_volume" :: held 1.047s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:57:19 devstack sudo[104021]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-380ed9bf-dc2b-4ad3-9969-d71f30581fdd" returned: 0 in 0.428s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:19 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] <== create_volume: return (1264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:57:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.267s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:19 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-f6fccde1-878b-445c-b839-a40f7ad62a6e tempest-VolumesListAdminTestJSON-996772640 None] Created reservations ['6ac1a789-3ef9-46a3-966a-04d29e6b1f66', '914a5284-b252-4b3c-8e01-ed91805b09a5', '69672e3b-a684-445c-9c16-780585a6eaa3', '502846df-8dcd-4f2e-b8b3-99a6a5f7d68e'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:57:19 devstack cinder-volume[87165]: DEBUG cinder.volume.volume_utils [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Attempting download of 2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c ((None, [{'url': 'file:///opt/stack/data/glance/images/2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c', 'metadata': {}}])) to volume 380ed9bf-dc2b-4ad3-9969-d71f30581fdd. {{(pid=87165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 06 11:57:19 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[413aad31-a285-4b73-b795-71864afd9c2b]: (4, 'raw') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:57:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c_vg70p70f {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f6fccde1-878b-445c-b839-a40f7ad62a6e tempest-VolumesListAdminTestJSON-996772640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f6fccde1-878b-445c-b839-a40f7ad62a6e tempest-VolumesListAdminTestJSON-996772640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:19 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-f6fccde1-878b-445c-b839-a40f7ad62a6e tempest-VolumesListAdminTestJSON-996772640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:57:19 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-f6fccde1-878b-445c-b839-a40f7ad62a6e tempest-VolumesListAdminTestJSON-996772640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:57:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f6fccde1-878b-445c-b839-a40f7ad62a6e tempest-VolumesListAdminTestJSON-996772640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f6fccde1-878b-445c-b839-a40f7ad62a6e tempest-VolumesListAdminTestJSON-996772640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:19 devstack sudo[104027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:57:19 devstack sudo[104027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:19 devstack sudo[104026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c_vg70p70f
Nov 06 11:57:19 devstack sudo[104026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:19 devstack sudo[104027]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f6fccde1-878b-445c-b839-a40f7ad62a6e tempest-VolumesListAdminTestJSON-996772640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.307s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:19 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-f6fccde1-878b-445c-b839-a40f7ad62a6e tempest-VolumesListAdminTestJSON-996772640 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:57:19 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-f6fccde1-878b-445c-b839-a40f7ad62a6e tempest-VolumesListAdminTestJSON-996772640 None] Deleted volume successfully.
Nov 06 11:57:19 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-f6fccde1-878b-445c-b839-a40f7ad62a6e tempest-VolumesListAdminTestJSON-996772640 None] Lock "cinder-a0e723e4-1f37-4645-b9e4-06feff7bfa57-delete_volume" released by "delete_volume" :: held 1.832s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:57:19 devstack sudo[104026]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c_vg70p70f" returned: 0 in 0.416s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c_vg70p70f {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:20 devstack sudo[104033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c_vg70p70f
Nov 06 11:57:20 devstack sudo[104033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:20 devstack sudo[104033]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c_vg70p70f" returned: 1 in 0.447s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c_vg70p70f' failed. Not Retrying. {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 11:57:20 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d33ab9-849a-4701-a4b0-e7a4daf3a58f]: (4, 'raw') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:57:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c_nwmwnpnsdevstack@QuobyteHD {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:20 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a8475a4c-c601-4932-8e77-a023bffa14fb tempest-VolumesListAdminTestJSON-996772640 None] Acquiring lock "cinder-82550ea5-d59e-4c8c-827b-8f725b835f16-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:57:20 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a8475a4c-c601-4932-8e77-a023bffa14fb tempest-VolumesListAdminTestJSON-996772640 None] Lock "cinder-82550ea5-d59e-4c8c-827b-8f725b835f16-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:57:20 devstack sudo[104037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c_nwmwnpnsdevstack@QuobyteHD
Nov 06 11:57:20 devstack sudo[104037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:20 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a8475a4c-c601-4932-8e77-a023bffa14fb tempest-VolumesListAdminTestJSON-996772640 None] Acquiring lock "cinder-quobyte-82550ea5-d59e-4c8c-827b-8f725b835f16" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:57:20 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a8475a4c-c601-4932-8e77-a023bffa14fb tempest-VolumesListAdminTestJSON-996772640 None] Lock "cinder-quobyte-82550ea5-d59e-4c8c-827b-8f725b835f16" acquired by "delete_volume" :: waited 0.024s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:57:20 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d8f09a-f4cb-4ed8-a501-aa529931144e]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:57:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a8475a4c-c601-4932-8e77-a023bffa14fb tempest-VolumesListAdminTestJSON-996772640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-82550ea5-d59e-4c8c-827b-8f725b835f16 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:20 devstack sudo[104039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-82550ea5-d59e-4c8c-827b-8f725b835f16
Nov 06 11:57:20 devstack sudo[104039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:20 devstack sudo[104037]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c_nwmwnpnsdevstack@QuobyteHD" returned: 0 in 0.469s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c_nwmwnpnsdevstack@QuobyteHD {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:20 devstack sudo[104043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c_nwmwnpnsdevstack@QuobyteHD
Nov 06 11:57:20 devstack sudo[104043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:21 devstack sudo[104039]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a8475a4c-c601-4932-8e77-a023bffa14fb tempest-VolumesListAdminTestJSON-996772640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-82550ea5-d59e-4c8c-827b-8f725b835f16" returned: 0 in 0.487s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a8475a4c-c601-4932-8e77-a023bffa14fb tempest-VolumesListAdminTestJSON-996772640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-82550ea5-d59e-4c8c-827b-8f725b835f16 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:21 devstack sudo[104048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-82550ea5-d59e-4c8c-827b-8f725b835f16
Nov 06 11:57:21 devstack sudo[104048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:21 devstack sudo[104043]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c_nwmwnpnsdevstack@QuobyteHD" returned: 1 in 0.412s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c_nwmwnpnsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 11:57:21 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] 2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c was raw, converting to qcow2 {{(pid=87165) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 06 11:57:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c_nwmwnpnsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-380ed9bf-dc2b-4ad3-9969-d71f30581fdd {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:21 devstack sudo[104053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c_nwmwnpnsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-380ed9bf-dc2b-4ad3-9969-d71f30581fdd
Nov 06 11:57:21 devstack sudo[104053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:21 devstack sudo[104048]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a8475a4c-c601-4932-8e77-a023bffa14fb tempest-VolumesListAdminTestJSON-996772640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-82550ea5-d59e-4c8c-827b-8f725b835f16" returned: 0 in 0.330s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:21 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a8475a4c-c601-4932-8e77-a023bffa14fb tempest-VolumesListAdminTestJSON-996772640 None] Lock "cinder-quobyte-82550ea5-d59e-4c8c-827b-8f725b835f16" released by "delete_volume" :: held 0.902s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:57:21 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:SELECT=158,cinder:INSERT=61,cinder:UPDATE=249,cinder:DELETE=23 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 11:57:21 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:UPDATE=235,cinder:SELECT=172,cinder:INSERT=64,cinder:DELETE=19 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 11:57:21 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-a8475a4c-c601-4932-8e77-a023bffa14fb tempest-VolumesListAdminTestJSON-996772640 None] Created reservations ['19513e25-c93c-4f6e-90b1-cbb03ea3befe', 'b0ba4c0d-c770-4027-9ca9-be82c1be83c6', '80233fc8-ca32-458c-9fa4-6f6d7e209686', 'ca09f902-482f-4720-a657-9d5d2b286fac'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:57:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a8475a4c-c601-4932-8e77-a023bffa14fb tempest-VolumesListAdminTestJSON-996772640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a8475a4c-c601-4932-8e77-a023bffa14fb tempest-VolumesListAdminTestJSON-996772640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:21 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a8475a4c-c601-4932-8e77-a023bffa14fb tempest-VolumesListAdminTestJSON-996772640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:57:21 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a8475a4c-c601-4932-8e77-a023bffa14fb tempest-VolumesListAdminTestJSON-996772640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:57:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a8475a4c-c601-4932-8e77-a023bffa14fb tempest-VolumesListAdminTestJSON-996772640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a8475a4c-c601-4932-8e77-a023bffa14fb tempest-VolumesListAdminTestJSON-996772640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:21 devstack sudo[104059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:57:21 devstack sudo[104059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:21 devstack sudo[104059]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a8475a4c-c601-4932-8e77-a023bffa14fb tempest-VolumesListAdminTestJSON-996772640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.304s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:21 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-a8475a4c-c601-4932-8e77-a023bffa14fb tempest-VolumesListAdminTestJSON-996772640 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:57:22 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-a8475a4c-c601-4932-8e77-a023bffa14fb tempest-VolumesListAdminTestJSON-996772640 None] Deleted volume successfully.
Nov 06 11:57:22 devstack sudo[104053]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c_nwmwnpnsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-380ed9bf-dc2b-4ad3-9969-d71f30581fdd" returned: 0 in 0.757s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:22 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c_nwmwnpnsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-380ed9bf-dc2b-4ad3-9969-d71f30581fdd {{(pid=87165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 11:57:22 devstack cinder-volume[87165]: INFO cinder.image.image_utils [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Converted 0.00 MB image at 0.00 MB/s
Nov 06 11:57:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-380ed9bf-dc2b-4ad3-9969-d71f30581fdd 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:22 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a8475a4c-c601-4932-8e77-a023bffa14fb tempest-VolumesListAdminTestJSON-996772640 None] Lock "cinder-82550ea5-d59e-4c8c-827b-8f725b835f16-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:57:22 devstack sudo[104062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-380ed9bf-dc2b-4ad3-9969-d71f30581fdd 1G
Nov 06 11:57:22 devstack sudo[104062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:22 devstack sudo[104062]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-380ed9bf-dc2b-4ad3-9969-d71f30581fdd 1G" returned: 0 in 0.436s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:22 devstack cinder-volume[87165]: DEBUG cinder.volume.volume_utils [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Downloaded image 2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c ((None, [{'url': 'file:///opt/stack/data/glance/images/2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c', 'metadata': {}}])) to volume 380ed9bf-dc2b-4ad3-9969-d71f30581fdd successfully. {{(pid=87165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 06 11:57:22 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Temporary image 2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c for user 61d0c563b8b84133be49884a2ffc047d is deleted. {{(pid=87165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 06 11:57:22 devstack cinder-volume[87165]: DEBUG cinder.volume.volume_utils [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Marking volume 380ed9bf-dc2b-4ad3-9969-d71f30581fdd as bootable. {{(pid=87165) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 06 11:57:22 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Copying metadata from image 2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c to 380ed9bf-dc2b-4ad3-9969-d71f30581fdd. {{(pid=87165) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 06 11:57:22 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Creating volume glance metadata for volume 380ed9bf-dc2b-4ad3-9969-d71f30581fdd backed by image 2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c with: {'image_id': '2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'd3c9b62604e54fcf0fd40477ca6e3eb1', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87165) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 06 11:57:22 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea9f28df-d6a5-40a2-9b01-0a1a6ba1d161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-380ed9bf-dc2b-4ad3-9969-d71f30581fdd', 'volume_size': 1, 'image_id': '2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd3c9b62604e54fcf0fd40477ca6e3eb1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6517b85a5a5340aeb08ffe683e014e14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8b559e2426528a6785000a0b94427a7a519f80465078c5daf49b0bbc39d05328b20420070ed798b0fe19b8d80b307649b5f0e4e45c10a5360f80959beab8c655', 'id': '2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c', 'created_at': datetime.datetime(2026, 11, 6, 10, 57, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 10, 57, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2cc3aa47-a5b9-49be-af50-f5cbaacf6c5c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x742c13ceec90>}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:22 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e82629de-c91f-4360-bd84-2c95279db613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:22 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Volume volume-380ed9bf-dc2b-4ad3-9969-d71f30581fdd (380ed9bf-dc2b-4ad3-9969-d71f30581fdd): created successfully
Nov 06 11:57:22 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e82629de-c91f-4360-bd84-2c95279db613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:22 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Flow 'volume_create_manager' (5643b912-1372-44d8-9dbf-67a8bebb89b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:57:22 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-9743ee70-1415-4d8c-8c0d-cef9bc0e70a1 tempest-VolumeImageDependencyTests-2059598220 None] Created volume successfully.
Nov 06 11:57:23 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-95bb484d-55a7-4144-95e7-6d42d01b9789 tempest-VolumeImageDependencyTests-2059598220 None] Acquiring lock "cinder-380ed9bf-dc2b-4ad3-9969-d71f30581fdd-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:57:23 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-95bb484d-55a7-4144-95e7-6d42d01b9789 tempest-VolumeImageDependencyTests-2059598220 None] Lock "cinder-380ed9bf-dc2b-4ad3-9969-d71f30581fdd-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:57:23 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-95bb484d-55a7-4144-95e7-6d42d01b9789 tempest-VolumeImageDependencyTests-2059598220 None] Acquiring lock "cinder-quobyte-380ed9bf-dc2b-4ad3-9969-d71f30581fdd" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:57:23 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-95bb484d-55a7-4144-95e7-6d42d01b9789 tempest-VolumeImageDependencyTests-2059598220 None] Lock "cinder-quobyte-380ed9bf-dc2b-4ad3-9969-d71f30581fdd" acquired by "delete_volume" :: waited 0.022s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:57:24 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d40373-75d5-427c-9010-d468fabbc65e]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:57:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-95bb484d-55a7-4144-95e7-6d42d01b9789 tempest-VolumeImageDependencyTests-2059598220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-380ed9bf-dc2b-4ad3-9969-d71f30581fdd {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:24 devstack sudo[104067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-380ed9bf-dc2b-4ad3-9969-d71f30581fdd
Nov 06 11:57:24 devstack sudo[104067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:24 devstack sudo[104067]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-95bb484d-55a7-4144-95e7-6d42d01b9789 tempest-VolumeImageDependencyTests-2059598220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-380ed9bf-dc2b-4ad3-9969-d71f30581fdd" returned: 0 in 0.450s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-95bb484d-55a7-4144-95e7-6d42d01b9789 tempest-VolumeImageDependencyTests-2059598220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-380ed9bf-dc2b-4ad3-9969-d71f30581fdd {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:24 devstack sudo[104073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-380ed9bf-dc2b-4ad3-9969-d71f30581fdd
Nov 06 11:57:24 devstack sudo[104073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:24 devstack sudo[104073]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-95bb484d-55a7-4144-95e7-6d42d01b9789 tempest-VolumeImageDependencyTests-2059598220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-380ed9bf-dc2b-4ad3-9969-d71f30581fdd" returned: 0 in 0.361s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:24 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-95bb484d-55a7-4144-95e7-6d42d01b9789 tempest-VolumeImageDependencyTests-2059598220 None] Lock "cinder-quobyte-380ed9bf-dc2b-4ad3-9969-d71f30581fdd" released by "delete_volume" :: held 0.881s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:57:24 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-95bb484d-55a7-4144-95e7-6d42d01b9789 tempest-VolumeImageDependencyTests-2059598220 None] Created reservations ['74190d7c-3754-40b8-814e-bfdff1087cdd', 'f5d17f38-8137-4610-ba67-fdfa769b0374', '2e78d720-23be-4604-a084-830b0b091bf2', '18029aca-dcff-4045-8c61-6e5ee6eeb3cc'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:57:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-95bb484d-55a7-4144-95e7-6d42d01b9789 tempest-VolumeImageDependencyTests-2059598220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-95bb484d-55a7-4144-95e7-6d42d01b9789 tempest-VolumeImageDependencyTests-2059598220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:25 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-95bb484d-55a7-4144-95e7-6d42d01b9789 tempest-VolumeImageDependencyTests-2059598220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:57:25 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-95bb484d-55a7-4144-95e7-6d42d01b9789 tempest-VolumeImageDependencyTests-2059598220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:57:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-95bb484d-55a7-4144-95e7-6d42d01b9789 tempest-VolumeImageDependencyTests-2059598220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-95bb484d-55a7-4144-95e7-6d42d01b9789 tempest-VolumeImageDependencyTests-2059598220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:25 devstack sudo[104077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:57:25 devstack sudo[104077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:25 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-e38f54cd-01b2-4bc0-9722-6006deb162a0 tempest-ProjectReaderTests-1877265631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:57:25 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e38f54cd-01b2-4bc0-9722-6006deb162a0 tempest-ProjectReaderTests-1877265631 None] Flow 'volume_create_manager' (9c6d6084-a780-48ff-b2b4-14c0a1889a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:57:25 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e38f54cd-01b2-4bc0-9722-6006deb162a0 tempest-ProjectReaderTests-1877265631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a0919ff-7b4a-4d1f-aef3-491032b26015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:25 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e38f54cd-01b2-4bc0-9722-6006deb162a0 tempest-ProjectReaderTests-1877265631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a0919ff-7b4a-4d1f-aef3-491032b26015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:57:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1060503421',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3b489dd-618a-4fdb-9ea6-a70e3a77bfb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bddf2b01cd6042ebaf96c51f7ce74db1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:57:25Z,use_quota=True,user_id='f18ad92dc6954340a7e6f088e2b58835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:25 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e38f54cd-01b2-4bc0-9722-6006deb162a0 tempest-ProjectReaderTests-1877265631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4b65be7-4ed8-45f4-b406-1ab2908c3b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:25 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e38f54cd-01b2-4bc0-9722-6006deb162a0 tempest-ProjectReaderTests-1877265631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4b65be7-4ed8-45f4-b406-1ab2908c3b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:25 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e38f54cd-01b2-4bc0-9722-6006deb162a0 tempest-ProjectReaderTests-1877265631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af41f57b-ea8b-4379-9b38-9febf80929f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:25 devstack sudo[104077]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:25 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e38f54cd-01b2-4bc0-9722-6006deb162a0 tempest-ProjectReaderTests-1877265631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af41f57b-ea8b-4379-9b38-9febf80929f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3b489dd-618a-4fdb-9ea6-a70e3a77bfb9', 'volume_name': 'volume-f3b489dd-618a-4fdb-9ea6-a70e3a77bfb9', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:25 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e38f54cd-01b2-4bc0-9722-6006deb162a0 tempest-ProjectReaderTests-1877265631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c454a49-9930-4c2c-b282-e76101230100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:25 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e38f54cd-01b2-4bc0-9722-6006deb162a0 tempest-ProjectReaderTests-1877265631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c454a49-9930-4c2c-b282-e76101230100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:25 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e38f54cd-01b2-4bc0-9722-6006deb162a0 tempest-ProjectReaderTests-1877265631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a87b872f-1b6f-4852-91f9-3bedf9008f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:25 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-e38f54cd-01b2-4bc0-9722-6006deb162a0 tempest-ProjectReaderTests-1877265631 None] Volume f3b489dd-618a-4fdb-9ea6-a70e3a77bfb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3b489dd-618a-4fdb-9ea6-a70e3a77bfb9', 'volume_size': 1}
Nov 06 11:57:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e38f54cd-01b2-4bc0-9722-6006deb162a0 tempest-ProjectReaderTests-1877265631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e38f54cd-01b2-4bc0-9722-6006deb162a0 tempest-ProjectReaderTests-1877265631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:25 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-e38f54cd-01b2-4bc0-9722-6006deb162a0 tempest-ProjectReaderTests-1877265631 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:57:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1060503421',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3b489dd-618a-4fdb-9ea6-a70e3a77bfb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bddf2b01cd6042ebaf96c51f7ce74db1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:57:25Z,use_quota=True,user_id='f18ad92dc6954340a7e6f088e2b58835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:57:25 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-e38f54cd-01b2-4bc0-9722-6006deb162a0 tempest-ProjectReaderTests-1877265631 None] Creating volume f3b489dd-618a-4fdb-9ea6-a70e3a77bfb9 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:57:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e38f54cd-01b2-4bc0-9722-6006deb162a0 tempest-ProjectReaderTests-1877265631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e38f54cd-01b2-4bc0-9722-6006deb162a0 tempest-ProjectReaderTests-1877265631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:25 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-e38f54cd-01b2-4bc0-9722-6006deb162a0 tempest-ProjectReaderTests-1877265631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:57:25 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-e38f54cd-01b2-4bc0-9722-6006deb162a0 tempest-ProjectReaderTests-1877265631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:57:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e38f54cd-01b2-4bc0-9722-6006deb162a0 tempest-ProjectReaderTests-1877265631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:25 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-e38f54cd-01b2-4bc0-9722-6006deb162a0 tempest-ProjectReaderTests-1877265631 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:57:25 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-e38f54cd-01b2-4bc0-9722-6006deb162a0 tempest-ProjectReaderTests-1877265631 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:57:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e38f54cd-01b2-4bc0-9722-6006deb162a0 tempest-ProjectReaderTests-1877265631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f3b489dd-618a-4fdb-9ea6-a70e3a77bfb9 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-95bb484d-55a7-4144-95e7-6d42d01b9789 tempest-VolumeImageDependencyTests-2059598220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.357s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:25 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-95bb484d-55a7-4144-95e7-6d42d01b9789 tempest-VolumeImageDependencyTests-2059598220 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:57:25 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-95bb484d-55a7-4144-95e7-6d42d01b9789 tempest-VolumeImageDependencyTests-2059598220 None] Deleted volume successfully.
Nov 06 11:57:25 devstack sudo[104080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f3b489dd-618a-4fdb-9ea6-a70e3a77bfb9 1073741824
Nov 06 11:57:25 devstack sudo[104080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:25 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-95bb484d-55a7-4144-95e7-6d42d01b9789 tempest-VolumeImageDependencyTests-2059598220 None] Lock "cinder-380ed9bf-dc2b-4ad3-9969-d71f30581fdd-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:57:26 devstack sudo[104080]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e38f54cd-01b2-4bc0-9722-6006deb162a0 tempest-ProjectReaderTests-1877265631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f3b489dd-618a-4fdb-9ea6-a70e3a77bfb9 1073741824" returned: 0 in 0.548s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e38f54cd-01b2-4bc0-9722-6006deb162a0 tempest-ProjectReaderTests-1877265631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f3b489dd-618a-4fdb-9ea6-a70e3a77bfb9 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:26 devstack sudo[104086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f3b489dd-618a-4fdb-9ea6-a70e3a77bfb9
Nov 06 11:57:26 devstack sudo[104086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:26 devstack sudo[104086]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e38f54cd-01b2-4bc0-9722-6006deb162a0 tempest-ProjectReaderTests-1877265631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f3b489dd-618a-4fdb-9ea6-a70e3a77bfb9" returned: 0 in 0.375s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:26 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-e38f54cd-01b2-4bc0-9722-6006deb162a0 tempest-ProjectReaderTests-1877265631 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:57:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e38f54cd-01b2-4bc0-9722-6006deb162a0 tempest-ProjectReaderTests-1877265631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:26 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e38f54cd-01b2-4bc0-9722-6006deb162a0 tempest-ProjectReaderTests-1877265631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a87b872f-1b6f-4852-91f9-3bedf9008f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3b489dd-618a-4fdb-9ea6-a70e3a77bfb9', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:26 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e38f54cd-01b2-4bc0-9722-6006deb162a0 tempest-ProjectReaderTests-1877265631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d46a20-7eb0-4568-a7bd-8dcf30802fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:26 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-e38f54cd-01b2-4bc0-9722-6006deb162a0 tempest-ProjectReaderTests-1877265631 None] Volume volume-f3b489dd-618a-4fdb-9ea6-a70e3a77bfb9 (f3b489dd-618a-4fdb-9ea6-a70e3a77bfb9): created successfully
Nov 06 11:57:26 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e38f54cd-01b2-4bc0-9722-6006deb162a0 tempest-ProjectReaderTests-1877265631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d46a20-7eb0-4568-a7bd-8dcf30802fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:26 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e38f54cd-01b2-4bc0-9722-6006deb162a0 tempest-ProjectReaderTests-1877265631 None] Flow 'volume_create_manager' (9c6d6084-a780-48ff-b2b4-14c0a1889a5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:57:26 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-e38f54cd-01b2-4bc0-9722-6006deb162a0 tempest-ProjectReaderTests-1877265631 None] Created volume successfully.
Nov 06 11:57:27 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-298415e1-a09e-433c-aa75-fe19de457473 tempest-ProjectReaderTests-1877265631 None] Acquiring lock "cinder-f3b489dd-618a-4fdb-9ea6-a70e3a77bfb9-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:57:27 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-298415e1-a09e-433c-aa75-fe19de457473 tempest-ProjectReaderTests-1877265631 None] Lock "cinder-f3b489dd-618a-4fdb-9ea6-a70e3a77bfb9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:57:27 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-298415e1-a09e-433c-aa75-fe19de457473 tempest-ProjectReaderTests-1877265631 None] Acquiring lock "cinder-quobyte-f3b489dd-618a-4fdb-9ea6-a70e3a77bfb9" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:57:28 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-298415e1-a09e-433c-aa75-fe19de457473 tempest-ProjectReaderTests-1877265631 None] Lock "cinder-quobyte-f3b489dd-618a-4fdb-9ea6-a70e3a77bfb9" acquired by "delete_volume" :: waited 0.037s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:57:28 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[532900e5-cb8b-41a7-a386-d6b8a1724b7b]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:57:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-298415e1-a09e-433c-aa75-fe19de457473 tempest-ProjectReaderTests-1877265631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f3b489dd-618a-4fdb-9ea6-a70e3a77bfb9 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:28 devstack sudo[104089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f3b489dd-618a-4fdb-9ea6-a70e3a77bfb9
Nov 06 11:57:28 devstack sudo[104089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:28 devstack sudo[104089]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-298415e1-a09e-433c-aa75-fe19de457473 tempest-ProjectReaderTests-1877265631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f3b489dd-618a-4fdb-9ea6-a70e3a77bfb9" returned: 0 in 0.519s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-298415e1-a09e-433c-aa75-fe19de457473 tempest-ProjectReaderTests-1877265631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f3b489dd-618a-4fdb-9ea6-a70e3a77bfb9 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:28 devstack sudo[104094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f3b489dd-618a-4fdb-9ea6-a70e3a77bfb9
Nov 06 11:57:28 devstack sudo[104094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:28 devstack sudo[104094]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-298415e1-a09e-433c-aa75-fe19de457473 tempest-ProjectReaderTests-1877265631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f3b489dd-618a-4fdb-9ea6-a70e3a77bfb9" returned: 0 in 0.334s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:28 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-298415e1-a09e-433c-aa75-fe19de457473 tempest-ProjectReaderTests-1877265631 None] Lock "cinder-quobyte-f3b489dd-618a-4fdb-9ea6-a70e3a77bfb9" released by "delete_volume" :: held 0.935s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:57:29 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-298415e1-a09e-433c-aa75-fe19de457473 tempest-ProjectReaderTests-1877265631 None] Created reservations ['4dc65dec-e04b-46e6-a642-ad84b9ca37c3', 'feef8b3f-bbc0-43fb-be5f-8cd0c0157863', '8aa7f830-380a-40c1-8b6f-a676d7800356', '2b500094-3a4f-48cc-920e-9bf1dfff1738'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:57:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-298415e1-a09e-433c-aa75-fe19de457473 tempest-ProjectReaderTests-1877265631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-298415e1-a09e-433c-aa75-fe19de457473 tempest-ProjectReaderTests-1877265631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:29 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-298415e1-a09e-433c-aa75-fe19de457473 tempest-ProjectReaderTests-1877265631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:57:29 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-298415e1-a09e-433c-aa75-fe19de457473 tempest-ProjectReaderTests-1877265631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:57:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-298415e1-a09e-433c-aa75-fe19de457473 tempest-ProjectReaderTests-1877265631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-298415e1-a09e-433c-aa75-fe19de457473 tempest-ProjectReaderTests-1877265631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:29 devstack sudo[104097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:57:29 devstack sudo[104097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:29 devstack sudo[104097]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-298415e1-a09e-433c-aa75-fe19de457473 tempest-ProjectReaderTests-1877265631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.348s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:29 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-298415e1-a09e-433c-aa75-fe19de457473 tempest-ProjectReaderTests-1877265631 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:57:29 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-298415e1-a09e-433c-aa75-fe19de457473 tempest-ProjectReaderTests-1877265631 None] Deleted volume successfully.
Nov 06 11:57:29 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-298415e1-a09e-433c-aa75-fe19de457473 tempest-ProjectReaderTests-1877265631 None] Lock "cinder-f3b489dd-618a-4fdb-9ea6-a70e3a77bfb9-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:57:30 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-4889d2c1-37d5-4610-b9d4-bc290485b1f2 tempest-ProjectReaderTests-1877265631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:57:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4889d2c1-37d5-4610-b9d4-bc290485b1f2 tempest-ProjectReaderTests-1877265631 None] Flow 'volume_create_manager' (4a247b98-2357-4903-9e71-286b4ec61ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:57:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4889d2c1-37d5-4610-b9d4-bc290485b1f2 tempest-ProjectReaderTests-1877265631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87e1c57b-fc49-4bb8-907c-98fa3b957c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4889d2c1-37d5-4610-b9d4-bc290485b1f2 tempest-ProjectReaderTests-1877265631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87e1c57b-fc49-4bb8-907c-98fa3b957c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-496861620',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3526e64-5844-482c-b2fc-8e89f91cdf84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bddf2b01cd6042ebaf96c51f7ce74db1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:57:31Z,use_quota=True,user_id='f18ad92dc6954340a7e6f088e2b58835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4889d2c1-37d5-4610-b9d4-bc290485b1f2 tempest-ProjectReaderTests-1877265631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3603ec62-3a8b-42f5-b48c-519b41d1c4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4889d2c1-37d5-4610-b9d4-bc290485b1f2 tempest-ProjectReaderTests-1877265631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3603ec62-3a8b-42f5-b48c-519b41d1c4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4889d2c1-37d5-4610-b9d4-bc290485b1f2 tempest-ProjectReaderTests-1877265631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c420f3bf-aa75-47a8-9c15-bd0c1d5ae9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4889d2c1-37d5-4610-b9d4-bc290485b1f2 tempest-ProjectReaderTests-1877265631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c420f3bf-aa75-47a8-9c15-bd0c1d5ae9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3526e64-5844-482c-b2fc-8e89f91cdf84', 'volume_name': 'volume-f3526e64-5844-482c-b2fc-8e89f91cdf84', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4889d2c1-37d5-4610-b9d4-bc290485b1f2 tempest-ProjectReaderTests-1877265631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83c5df9d-a400-4dab-b3fc-cdefe05c44cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4889d2c1-37d5-4610-b9d4-bc290485b1f2 tempest-ProjectReaderTests-1877265631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83c5df9d-a400-4dab-b3fc-cdefe05c44cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4889d2c1-37d5-4610-b9d4-bc290485b1f2 tempest-ProjectReaderTests-1877265631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f65dfe34-a9e4-4e3d-97b3-8c52a1c5ad5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:31 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-4889d2c1-37d5-4610-b9d4-bc290485b1f2 tempest-ProjectReaderTests-1877265631 None] Volume f3526e64-5844-482c-b2fc-8e89f91cdf84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3526e64-5844-482c-b2fc-8e89f91cdf84', 'volume_size': 1}
Nov 06 11:57:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4889d2c1-37d5-4610-b9d4-bc290485b1f2 tempest-ProjectReaderTests-1877265631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4889d2c1-37d5-4610-b9d4-bc290485b1f2 tempest-ProjectReaderTests-1877265631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:31 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-4889d2c1-37d5-4610-b9d4-bc290485b1f2 tempest-ProjectReaderTests-1877265631 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-496861620',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3526e64-5844-482c-b2fc-8e89f91cdf84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bddf2b01cd6042ebaf96c51f7ce74db1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:57:31Z,use_quota=True,user_id='f18ad92dc6954340a7e6f088e2b58835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:57:31 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-4889d2c1-37d5-4610-b9d4-bc290485b1f2 tempest-ProjectReaderTests-1877265631 None] Creating volume f3526e64-5844-482c-b2fc-8e89f91cdf84 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:57:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4889d2c1-37d5-4610-b9d4-bc290485b1f2 tempest-ProjectReaderTests-1877265631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4889d2c1-37d5-4610-b9d4-bc290485b1f2 tempest-ProjectReaderTests-1877265631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:31 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-4889d2c1-37d5-4610-b9d4-bc290485b1f2 tempest-ProjectReaderTests-1877265631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:57:31 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-4889d2c1-37d5-4610-b9d4-bc290485b1f2 tempest-ProjectReaderTests-1877265631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:57:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4889d2c1-37d5-4610-b9d4-bc290485b1f2 tempest-ProjectReaderTests-1877265631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:31 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-4889d2c1-37d5-4610-b9d4-bc290485b1f2 tempest-ProjectReaderTests-1877265631 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:57:31 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-4889d2c1-37d5-4610-b9d4-bc290485b1f2 tempest-ProjectReaderTests-1877265631 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:57:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4889d2c1-37d5-4610-b9d4-bc290485b1f2 tempest-ProjectReaderTests-1877265631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f3526e64-5844-482c-b2fc-8e89f91cdf84 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:31 devstack sudo[104100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f3526e64-5844-482c-b2fc-8e89f91cdf84 1073741824
Nov 06 11:57:31 devstack sudo[104100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:31 devstack sudo[104100]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4889d2c1-37d5-4610-b9d4-bc290485b1f2 tempest-ProjectReaderTests-1877265631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f3526e64-5844-482c-b2fc-8e89f91cdf84 1073741824" returned: 0 in 0.595s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4889d2c1-37d5-4610-b9d4-bc290485b1f2 tempest-ProjectReaderTests-1877265631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f3526e64-5844-482c-b2fc-8e89f91cdf84 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:31 devstack sudo[104106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f3526e64-5844-482c-b2fc-8e89f91cdf84
Nov 06 11:57:31 devstack sudo[104106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:32 devstack sudo[104106]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4889d2c1-37d5-4610-b9d4-bc290485b1f2 tempest-ProjectReaderTests-1877265631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f3526e64-5844-482c-b2fc-8e89f91cdf84" returned: 0 in 0.346s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:32 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-4889d2c1-37d5-4610-b9d4-bc290485b1f2 tempest-ProjectReaderTests-1877265631 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:57:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4889d2c1-37d5-4610-b9d4-bc290485b1f2 tempest-ProjectReaderTests-1877265631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4889d2c1-37d5-4610-b9d4-bc290485b1f2 tempest-ProjectReaderTests-1877265631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f65dfe34-a9e4-4e3d-97b3-8c52a1c5ad5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3526e64-5844-482c-b2fc-8e89f91cdf84', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4889d2c1-37d5-4610-b9d4-bc290485b1f2 tempest-ProjectReaderTests-1877265631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (700288b8-85f8-43fd-904c-c64e12026623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:32 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-4889d2c1-37d5-4610-b9d4-bc290485b1f2 tempest-ProjectReaderTests-1877265631 None] Volume volume-f3526e64-5844-482c-b2fc-8e89f91cdf84 (f3526e64-5844-482c-b2fc-8e89f91cdf84): created successfully
Nov 06 11:57:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4889d2c1-37d5-4610-b9d4-bc290485b1f2 tempest-ProjectReaderTests-1877265631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (700288b8-85f8-43fd-904c-c64e12026623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4889d2c1-37d5-4610-b9d4-bc290485b1f2 tempest-ProjectReaderTests-1877265631 None] Flow 'volume_create_manager' (4a247b98-2357-4903-9e71-286b4ec61ac1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:57:32 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-4889d2c1-37d5-4610-b9d4-bc290485b1f2 tempest-ProjectReaderTests-1877265631 None] Created volume successfully.
Nov 06 11:57:33 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-3cec65fe-f3ef-4624-aef9-7d99b1b5175c tempest-ProjectReaderTests-1877265631 None] Acquiring lock "cinder-f3526e64-5844-482c-b2fc-8e89f91cdf84-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:57:33 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-3cec65fe-f3ef-4624-aef9-7d99b1b5175c tempest-ProjectReaderTests-1877265631 None] Lock "cinder-f3526e64-5844-482c-b2fc-8e89f91cdf84-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:57:33 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-3cec65fe-f3ef-4624-aef9-7d99b1b5175c tempest-ProjectReaderTests-1877265631 None] Acquiring lock "cinder-quobyte-f3526e64-5844-482c-b2fc-8e89f91cdf84" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:57:33 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-3cec65fe-f3ef-4624-aef9-7d99b1b5175c tempest-ProjectReaderTests-1877265631 None] Lock "cinder-quobyte-f3526e64-5844-482c-b2fc-8e89f91cdf84" acquired by "delete_volume" :: waited 0.027s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:57:33 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf1f873-97f0-4435-a0fb-14f81a1e29b1]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:57:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3cec65fe-f3ef-4624-aef9-7d99b1b5175c tempest-ProjectReaderTests-1877265631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f3526e64-5844-482c-b2fc-8e89f91cdf84 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:33 devstack sudo[104109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f3526e64-5844-482c-b2fc-8e89f91cdf84
Nov 06 11:57:33 devstack sudo[104109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:33 devstack sudo[104109]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3cec65fe-f3ef-4624-aef9-7d99b1b5175c tempest-ProjectReaderTests-1877265631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f3526e64-5844-482c-b2fc-8e89f91cdf84" returned: 0 in 0.466s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3cec65fe-f3ef-4624-aef9-7d99b1b5175c tempest-ProjectReaderTests-1877265631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f3526e64-5844-482c-b2fc-8e89f91cdf84 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:33 devstack sudo[104114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f3526e64-5844-482c-b2fc-8e89f91cdf84
Nov 06 11:57:33 devstack sudo[104114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:34 devstack sudo[104114]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3cec65fe-f3ef-4624-aef9-7d99b1b5175c tempest-ProjectReaderTests-1877265631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f3526e64-5844-482c-b2fc-8e89f91cdf84" returned: 0 in 0.413s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:34 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-3cec65fe-f3ef-4624-aef9-7d99b1b5175c tempest-ProjectReaderTests-1877265631 None] Lock "cinder-quobyte-f3526e64-5844-482c-b2fc-8e89f91cdf84" released by "delete_volume" :: held 0.957s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:57:34 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-3cec65fe-f3ef-4624-aef9-7d99b1b5175c tempest-ProjectReaderTests-1877265631 None] Created reservations ['32bcf06a-64ea-4362-9c5f-3f52d4bde3c5', '8967bccc-8a10-4d94-887b-a54b209a4b41', 'ec71df74-0cb1-4c69-854a-0925ee53166b', 'e60d1346-555b-4af2-818b-adc0aeaf122e'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:57:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3cec65fe-f3ef-4624-aef9-7d99b1b5175c tempest-ProjectReaderTests-1877265631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3cec65fe-f3ef-4624-aef9-7d99b1b5175c tempest-ProjectReaderTests-1877265631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:34 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-3cec65fe-f3ef-4624-aef9-7d99b1b5175c tempest-ProjectReaderTests-1877265631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:57:34 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-3cec65fe-f3ef-4624-aef9-7d99b1b5175c tempest-ProjectReaderTests-1877265631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:57:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3cec65fe-f3ef-4624-aef9-7d99b1b5175c tempest-ProjectReaderTests-1877265631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3cec65fe-f3ef-4624-aef9-7d99b1b5175c tempest-ProjectReaderTests-1877265631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:34 devstack sudo[104117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:57:34 devstack sudo[104117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:34 devstack sudo[104117]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3cec65fe-f3ef-4624-aef9-7d99b1b5175c tempest-ProjectReaderTests-1877265631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.354s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:34 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-3cec65fe-f3ef-4624-aef9-7d99b1b5175c tempest-ProjectReaderTests-1877265631 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:57:35 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-3cec65fe-f3ef-4624-aef9-7d99b1b5175c tempest-ProjectReaderTests-1877265631 None] Deleted volume successfully.
Nov 06 11:57:35 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-3cec65fe-f3ef-4624-aef9-7d99b1b5175c tempest-ProjectReaderTests-1877265631 None] Lock "cinder-f3526e64-5844-482c-b2fc-8e89f91cdf84-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:57:35 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:57:35 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] Flow 'volume_create_manager' (ecf6534c-7aa9-4b24-8a3a-61bf62e2e454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:57:35 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e0856fa-8b1c-49ea-a1ca-626f3d6f9cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:35 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e0856fa-8b1c-49ea-a1ca-626f3d6f9cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-857944567',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63e31c6c-376f-43d8-af42-f82b2bd3a051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7de7e333a7f4c5ab8b1536a54b0d0bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:57:36Z,use_quota=True,user_id='c656684a1c5640be9626415921c97350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:35 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (293e0b34-2a51-4fcd-8fe1-5e923a3d913a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:35 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (293e0b34-2a51-4fcd-8fe1-5e923a3d913a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (876d7ff6-8c00-4ffd-be81-64cdae5f6a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:36 devstack cinder-volume[87165]: DEBUG cinder.image.glance [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] Creating Keystone auth plugin from conf {{(pid=87165) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 06 11:57:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (876d7ff6-8c00-4ffd-be81-64cdae5f6a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '63e31c6c-376f-43d8-af42-f82b2bd3a051', 'volume_name': 'volume-63e31c6c-376f-43d8-af42-f82b2bd3a051', 'volume_size': 1, 'image_id': 'c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '28942f14a9e2424ca7367c6efa5fb47a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'created_at': datetime.datetime(2026, 11, 6, 10, 37, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 10, 37, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c315441d-48d2-43fb-b56a-c983b5a6f9cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x742c1e3ad730>}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (541124eb-04ea-45e3-a191-8f0e658ccf67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (541124eb-04ea-45e3-a191-8f0e658ccf67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deda2ca6-0405-42ef-9600-c53bac6652b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:36 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] Volume 63e31c6c-376f-43d8-af42-f82b2bd3a051: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-63e31c6c-376f-43d8-af42-f82b2bd3a051', 'volume_size': 1, 'image_id': 'c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '28942f14a9e2424ca7367c6efa5fb47a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'created_at': datetime.datetime(2026, 11, 6, 10, 37, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 10, 37, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c315441d-48d2-43fb-b56a-c983b5a6f9cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x742c1e3ad730>}
Nov 06 11:57:36 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] Trying to clone 63e31c6c-376f-43d8-af42-f82b2bd3a051 from image c315441d-48d2-43fb-b56a-c983b5a6f9cd at location (None, [{'url': 'file:///opt/stack/data/glance/images/c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'metadata': {}}]). {{(pid=87165) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 06 11:57:37 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_3g3s81ibdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87165) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 06 11:57:37 devstack cinder-volume[87165]: INFO cinder.image.image_utils [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] Image download 20.69 MB at 20.69 MB/s
Nov 06 11:57:37 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3280aebd-9a9b-466e-9d71-5342a89f0c7c]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:57:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_3g3s81ibdevstack@QuobyteHD {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:37 devstack sudo[104123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_3g3s81ibdevstack@QuobyteHD
Nov 06 11:57:37 devstack sudo[104123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:37 devstack sudo[104123]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_3g3s81ibdevstack@QuobyteHD" returned: 0 in 0.447s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:37 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] Temporary image c315441d-48d2-43fb-b56a-c983b5a6f9cd is fetched for user c656684a1c5640be9626415921c97350. {{(pid=87165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 06 11:57:37 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6252699e-7a3d-4e21-94c4-6cdf1b9fc8b4]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:57:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_3g3s81ibdevstack@QuobyteHD {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:37 devstack sudo[104129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_3g3s81ibdevstack@QuobyteHD
Nov 06 11:57:37 devstack sudo[104129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:38 devstack sudo[104129]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_3g3s81ibdevstack@QuobyteHD" returned: 0 in 0.466s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:38 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-857944567',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63e31c6c-376f-43d8-af42-f82b2bd3a051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7de7e333a7f4c5ab8b1536a54b0d0bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:57:36Z,use_quota=True,user_id='c656684a1c5640be9626415921c97350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:57:38 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] Creating volume 63e31c6c-376f-43d8-af42-f82b2bd3a051 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:57:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:38 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:57:38 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:57:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:38 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:57:38 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:57:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-63e31c6c-376f-43d8-af42-f82b2bd3a051 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:38 devstack sudo[104134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-63e31c6c-376f-43d8-af42-f82b2bd3a051 1073741824
Nov 06 11:57:38 devstack sudo[104134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:38 devstack sudo[104134]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-63e31c6c-376f-43d8-af42-f82b2bd3a051 1073741824" returned: 0 in 0.615s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-63e31c6c-376f-43d8-af42-f82b2bd3a051 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:39 devstack sudo[104142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-63e31c6c-376f-43d8-af42-f82b2bd3a051
Nov 06 11:57:39 devstack sudo[104142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:39 devstack sudo[104142]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-63e31c6c-376f-43d8-af42-f82b2bd3a051" returned: 0 in 0.302s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:39 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:57:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:39 devstack cinder-volume[87165]: DEBUG cinder.volume.volume_utils [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] Attempting download of c315441d-48d2-43fb-b56a-c983b5a6f9cd ((None, [{'url': 'file:///opt/stack/data/glance/images/c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'metadata': {}}])) to volume 63e31c6c-376f-43d8-af42-f82b2bd3a051. {{(pid=87165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 06 11:57:39 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b412b22-10a1-40d7-b19f-2975eec943d6]: (4, 'raw') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:57:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c315441d-48d2-43fb-b56a-c983b5a6f9cd_8sa6noha {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:39 devstack sudo[104145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c315441d-48d2-43fb-b56a-c983b5a6f9cd_8sa6noha
Nov 06 11:57:39 devstack sudo[104145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:39 devstack sudo[104145]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c315441d-48d2-43fb-b56a-c983b5a6f9cd_8sa6noha" returned: 0 in 0.443s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c315441d-48d2-43fb-b56a-c983b5a6f9cd_8sa6noha {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:39 devstack sudo[104149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c315441d-48d2-43fb-b56a-c983b5a6f9cd_8sa6noha
Nov 06 11:57:39 devstack sudo[104149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:40 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e59a0db-1a0a-4fc3-98c5-4b0e9c618229 tempest-SnapshotDependencyTests-640174777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:57:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6e59a0db-1a0a-4fc3-98c5-4b0e9c618229 tempest-SnapshotDependencyTests-640174777 None] Flow 'volume_create_manager' (e406117b-6337-4cec-8f98-33cadcab1f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:57:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6e59a0db-1a0a-4fc3-98c5-4b0e9c618229 tempest-SnapshotDependencyTests-640174777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6da3c8f7-d1b7-449f-915e-bd26357b1a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6e59a0db-1a0a-4fc3-98c5-4b0e9c618229 tempest-SnapshotDependencyTests-640174777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6da3c8f7-d1b7-449f-915e-bd26357b1a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-350841637',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96254a87-19ef-4c5d-a921-83035e5d56ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6912fdcf55634de7bd76efaaf77e2722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:57:40Z,use_quota=True,user_id='06ddaece989a4d6095a85ebb360aea04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6e59a0db-1a0a-4fc3-98c5-4b0e9c618229 tempest-SnapshotDependencyTests-640174777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dcbff8c-3d14-4af0-ab1e-f2c39779dd1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6e59a0db-1a0a-4fc3-98c5-4b0e9c618229 tempest-SnapshotDependencyTests-640174777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dcbff8c-3d14-4af0-ab1e-f2c39779dd1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6e59a0db-1a0a-4fc3-98c5-4b0e9c618229 tempest-SnapshotDependencyTests-640174777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64ac3943-cb5f-4d37-bd0a-d64d9ccf67b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6e59a0db-1a0a-4fc3-98c5-4b0e9c618229 tempest-SnapshotDependencyTests-640174777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64ac3943-cb5f-4d37-bd0a-d64d9ccf67b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96254a87-19ef-4c5d-a921-83035e5d56ce', 'volume_name': 'volume-96254a87-19ef-4c5d-a921-83035e5d56ce', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6e59a0db-1a0a-4fc3-98c5-4b0e9c618229 tempest-SnapshotDependencyTests-640174777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (529de6ef-a138-4491-81cd-c365b21ebc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6e59a0db-1a0a-4fc3-98c5-4b0e9c618229 tempest-SnapshotDependencyTests-640174777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (529de6ef-a138-4491-81cd-c365b21ebc0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6e59a0db-1a0a-4fc3-98c5-4b0e9c618229 tempest-SnapshotDependencyTests-640174777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7226e614-95ca-49ca-9e8e-9dde360b5f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:40 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-6e59a0db-1a0a-4fc3-98c5-4b0e9c618229 tempest-SnapshotDependencyTests-640174777 None] Volume 96254a87-19ef-4c5d-a921-83035e5d56ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96254a87-19ef-4c5d-a921-83035e5d56ce', 'volume_size': 1}
Nov 06 11:57:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6e59a0db-1a0a-4fc3-98c5-4b0e9c618229 tempest-SnapshotDependencyTests-640174777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6e59a0db-1a0a-4fc3-98c5-4b0e9c618229 tempest-SnapshotDependencyTests-640174777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:40 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-6e59a0db-1a0a-4fc3-98c5-4b0e9c618229 tempest-SnapshotDependencyTests-640174777 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-350841637',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96254a87-19ef-4c5d-a921-83035e5d56ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6912fdcf55634de7bd76efaaf77e2722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:57:40Z,use_quota=True,user_id='06ddaece989a4d6095a85ebb360aea04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:57:40 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-6e59a0db-1a0a-4fc3-98c5-4b0e9c618229 tempest-SnapshotDependencyTests-640174777 None] Creating volume 96254a87-19ef-4c5d-a921-83035e5d56ce {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:57:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6e59a0db-1a0a-4fc3-98c5-4b0e9c618229 tempest-SnapshotDependencyTests-640174777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6e59a0db-1a0a-4fc3-98c5-4b0e9c618229 tempest-SnapshotDependencyTests-640174777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:40 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-6e59a0db-1a0a-4fc3-98c5-4b0e9c618229 tempest-SnapshotDependencyTests-640174777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:57:40 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-6e59a0db-1a0a-4fc3-98c5-4b0e9c618229 tempest-SnapshotDependencyTests-640174777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:57:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6e59a0db-1a0a-4fc3-98c5-4b0e9c618229 tempest-SnapshotDependencyTests-640174777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:40 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-6e59a0db-1a0a-4fc3-98c5-4b0e9c618229 tempest-SnapshotDependencyTests-640174777 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:57:40 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-6e59a0db-1a0a-4fc3-98c5-4b0e9c618229 tempest-SnapshotDependencyTests-640174777 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:57:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6e59a0db-1a0a-4fc3-98c5-4b0e9c618229 tempest-SnapshotDependencyTests-640174777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:40 devstack sudo[104149]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c315441d-48d2-43fb-b56a-c983b5a6f9cd_8sa6noha" returned: 1 in 0.483s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c315441d-48d2-43fb-b56a-c983b5a6f9cd_8sa6noha' failed. Not Retrying. {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 11:57:40 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f843cdad-799c-46c9-a5d5-432a9c420523]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:57:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_3g3s81ibdevstack@QuobyteHD {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:40 devstack sudo[104153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce 1073741824
Nov 06 11:57:40 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:40 devstack sudo[104154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_3g3s81ibdevstack@QuobyteHD
Nov 06 11:57:40 devstack sudo[104154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:40 devstack sudo[104154]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_3g3s81ibdevstack@QuobyteHD" returned: 0 in 0.460s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:40 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] c315441d-48d2-43fb-b56a-c983b5a6f9cd was qcow2, converting to qcow2 {{(pid=87165) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 06 11:57:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_3g3s81ibdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-63e31c6c-376f-43d8-af42-f82b2bd3a051 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:40 devstack sudo[104164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_3g3s81ibdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-63e31c6c-376f-43d8-af42-f82b2bd3a051
Nov 06 11:57:40 devstack sudo[104164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:40 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6e59a0db-1a0a-4fc3-98c5-4b0e9c618229 tempest-SnapshotDependencyTests-640174777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce 1073741824" returned: 0 in 0.685s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6e59a0db-1a0a-4fc3-98c5-4b0e9c618229 tempest-SnapshotDependencyTests-640174777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:41 devstack sudo[104166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce
Nov 06 11:57:41 devstack sudo[104166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:41 devstack sudo[104166]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6e59a0db-1a0a-4fc3-98c5-4b0e9c618229 tempest-SnapshotDependencyTests-640174777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce" returned: 0 in 0.358s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:41 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-6e59a0db-1a0a-4fc3-98c5-4b0e9c618229 tempest-SnapshotDependencyTests-640174777 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:57:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6e59a0db-1a0a-4fc3-98c5-4b0e9c618229 tempest-SnapshotDependencyTests-640174777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:41 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6e59a0db-1a0a-4fc3-98c5-4b0e9c618229 tempest-SnapshotDependencyTests-640174777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7226e614-95ca-49ca-9e8e-9dde360b5f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96254a87-19ef-4c5d-a921-83035e5d56ce', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:41 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6e59a0db-1a0a-4fc3-98c5-4b0e9c618229 tempest-SnapshotDependencyTests-640174777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f92df60c-f9ac-4f1d-864d-73bfb957197a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:41 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-6e59a0db-1a0a-4fc3-98c5-4b0e9c618229 tempest-SnapshotDependencyTests-640174777 None] Volume volume-96254a87-19ef-4c5d-a921-83035e5d56ce (96254a87-19ef-4c5d-a921-83035e5d56ce): created successfully
Nov 06 11:57:41 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6e59a0db-1a0a-4fc3-98c5-4b0e9c618229 tempest-SnapshotDependencyTests-640174777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f92df60c-f9ac-4f1d-864d-73bfb957197a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:41 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6e59a0db-1a0a-4fc3-98c5-4b0e9c618229 tempest-SnapshotDependencyTests-640174777 None] Flow 'volume_create_manager' (e406117b-6337-4cec-8f98-33cadcab1f4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:57:41 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-6e59a0db-1a0a-4fc3-98c5-4b0e9c618229 tempest-SnapshotDependencyTests-640174777 None] Created volume successfully.
Nov 06 11:57:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-496e6b8b-6f57-4ecf-90ea-53ea32a027d6 tempest-SnapshotDependencyTests-640174777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-496e6b8b-6f57-4ecf-90ea-53ea32a027d6 tempest-SnapshotDependencyTests-640174777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:42 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-496e6b8b-6f57-4ecf-90ea-53ea32a027d6 tempest-SnapshotDependencyTests-640174777 None] Creating offline snapshot fae1835d-760b-4753-a3f9-c0edfab86d94 of volume 96254a87-19ef-4c5d-a921-83035e5d56ce {{(pid=87165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 11:57:42 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7213eed-5d68-498d-922f-523fc21e5426]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:57:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-496e6b8b-6f57-4ecf-90ea-53ea32a027d6 tempest-SnapshotDependencyTests-640174777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:42 devstack sudo[104174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce
Nov 06 11:57:42 devstack sudo[104174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:43 devstack sudo[104174]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-496e6b8b-6f57-4ecf-90ea-53ea32a027d6 tempest-SnapshotDependencyTests-640174777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce" returned: 0 in 0.503s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-496e6b8b-6f57-4ecf-90ea-53ea32a027d6 tempest-SnapshotDependencyTests-640174777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce.fae1835d-760b-4753-a3f9-c0edfab86d94 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:43 devstack sudo[104181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce.fae1835d-760b-4753-a3f9-c0edfab86d94 1G
Nov 06 11:57:43 devstack sudo[104181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:43 devstack sudo[104164]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_3g3s81ibdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-63e31c6c-376f-43d8-af42-f82b2bd3a051" returned: 0 in 2.642s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:43 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_3g3s81ibdevstack@QuobyteHD, size 112.00 MB, duration 2.65 sec, destination /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-63e31c6c-376f-43d8-af42-f82b2bd3a051 {{(pid=87165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 11:57:43 devstack cinder-volume[87165]: INFO cinder.image.image_utils [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] Converted 112.00 MB image at 42.33 MB/s
Nov 06 11:57:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-63e31c6c-376f-43d8-af42-f82b2bd3a051 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:43 devstack sudo[104185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-63e31c6c-376f-43d8-af42-f82b2bd3a051 1G
Nov 06 11:57:43 devstack sudo[104185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:43 devstack sudo[104181]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-496e6b8b-6f57-4ecf-90ea-53ea32a027d6 tempest-SnapshotDependencyTests-640174777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce.fae1835d-760b-4753-a3f9-c0edfab86d94 1G" returned: 0 in 0.577s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-496e6b8b-6f57-4ecf-90ea-53ea32a027d6 tempest-SnapshotDependencyTests-640174777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96254a87-19ef-4c5d-a921-83035e5d56ce -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce.fae1835d-760b-4753-a3f9-c0edfab86d94 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:43 devstack sudo[104192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96254a87-19ef-4c5d-a921-83035e5d56ce -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce.fae1835d-760b-4753-a3f9-c0edfab86d94
Nov 06 11:57:43 devstack sudo[104192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:43 devstack sudo[104185]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-63e31c6c-376f-43d8-af42-f82b2bd3a051 1G" returned: 0 in 0.507s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:43 devstack cinder-volume[87165]: DEBUG cinder.volume.volume_utils [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] Downloaded image c315441d-48d2-43fb-b56a-c983b5a6f9cd ((None, [{'url': 'file:///opt/stack/data/glance/images/c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'metadata': {}}])) to volume 63e31c6c-376f-43d8-af42-f82b2bd3a051 successfully. {{(pid=87165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 06 11:57:43 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] Temporary image c315441d-48d2-43fb-b56a-c983b5a6f9cd for user c656684a1c5640be9626415921c97350 is deleted. {{(pid=87165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 06 11:57:43 devstack cinder-volume[87165]: DEBUG cinder.volume.volume_utils [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] Marking volume 63e31c6c-376f-43d8-af42-f82b2bd3a051 as bootable. {{(pid=87165) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 06 11:57:43 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] Copying metadata from image c315441d-48d2-43fb-b56a-c983b5a6f9cd to 63e31c6c-376f-43d8-af42-f82b2bd3a051. {{(pid=87165) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 06 11:57:43 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] Creating volume glance metadata for volume 63e31c6c-376f-43d8-af42-f82b2bd3a051 backed by image c315441d-48d2-43fb-b56a-c983b5a6f9cd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87165) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 06 11:57:44 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deda2ca6-0405-42ef-9600-c53bac6652b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63e31c6c-376f-43d8-af42-f82b2bd3a051', 'volume_size': 1, 'image_id': 'c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '28942f14a9e2424ca7367c6efa5fb47a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'created_at': datetime.datetime(2026, 11, 6, 10, 37, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 10, 37, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c315441d-48d2-43fb-b56a-c983b5a6f9cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x742c1e3ad730>}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:44 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16c1ee7a-d23f-41ad-b602-9b32415a4264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:44 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] Volume volume-63e31c6c-376f-43d8-af42-f82b2bd3a051 (63e31c6c-376f-43d8-af42-f82b2bd3a051): created successfully
Nov 06 11:57:44 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16c1ee7a-d23f-41ad-b602-9b32415a4264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:44 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] Flow 'volume_create_manager' (ecf6534c-7aa9-4b24-8a3a-61bf62e2e454) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:57:44 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-ca06ae5b-578a-40fd-870a-1d3ff538e402 tempest-VolumesExtendTest-696145693 None] Created volume successfully.
Nov 06 11:57:44 devstack sudo[104192]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-496e6b8b-6f57-4ecf-90ea-53ea32a027d6 tempest-SnapshotDependencyTests-640174777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96254a87-19ef-4c5d-a921-83035e5d56ce -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce.fae1835d-760b-4753-a3f9-c0edfab86d94" returned: 0 in 0.417s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:44 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-496e6b8b-6f57-4ecf-90ea-53ea32a027d6 tempest-SnapshotDependencyTests-640174777 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce.fae1835d-760b-4753-a3f9-c0edfab86d94 is being set with open permissions: ugo+rw
Nov 06 11:57:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-496e6b8b-6f57-4ecf-90ea-53ea32a027d6 tempest-SnapshotDependencyTests-640174777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce.fae1835d-760b-4753-a3f9-c0edfab86d94 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:44 devstack sudo[104199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce.fae1835d-760b-4753-a3f9-c0edfab86d94
Nov 06 11:57:44 devstack sudo[104199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:44 devstack sudo[104199]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-496e6b8b-6f57-4ecf-90ea-53ea32a027d6 tempest-SnapshotDependencyTests-640174777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce.fae1835d-760b-4753-a3f9-c0edfab86d94" returned: 0 in 0.308s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-496e6b8b-6f57-4ecf-90ea-53ea32a027d6 tempest-SnapshotDependencyTests-640174777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:44 devstack sudo[104202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce.info
Nov 06 11:57:44 devstack sudo[104202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f16ce762-366e-45a2-8524-c84c07258ba6 tempest-VolumesExtendTest-696145693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:44 devstack sudo[104202]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-496e6b8b-6f57-4ecf-90ea-53ea32a027d6 tempest-SnapshotDependencyTests-640174777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce.info" returned: 0 in 0.368s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:44 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-496e6b8b-6f57-4ecf-90ea-53ea32a027d6 tempest-SnapshotDependencyTests-640174777 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce.info is being set with open permissions: ugo+rw
Nov 06 11:57:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-496e6b8b-6f57-4ecf-90ea-53ea32a027d6 tempest-SnapshotDependencyTests-640174777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:44 devstack sudo[104206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce.info
Nov 06 11:57:44 devstack sudo[104206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:45 devstack sudo[104206]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-496e6b8b-6f57-4ecf-90ea-53ea32a027d6 tempest-SnapshotDependencyTests-640174777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce.info" returned: 0 in 0.266s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-496e6b8b-6f57-4ecf-90ea-53ea32a027d6 tempest-SnapshotDependencyTests-640174777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.598s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f16ce762-366e-45a2-8524-c84c07258ba6 tempest-VolumesExtendTest-696145693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.414s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:45 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[af67ce1b-8a6a-4605-b806-316be4619c72]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:57:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f16ce762-366e-45a2-8524-c84c07258ba6 tempest-VolumesExtendTest-696145693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-63e31c6c-376f-43d8-af42-f82b2bd3a051 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:45 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-496e6b8b-6f57-4ecf-90ea-53ea32a027d6 tempest-SnapshotDependencyTests-640174777 None] Create snapshot completed successfully
Nov 06 11:57:45 devstack sudo[104209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-63e31c6c-376f-43d8-af42-f82b2bd3a051
Nov 06 11:57:45 devstack sudo[104209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:45 devstack sudo[104209]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f16ce762-366e-45a2-8524-c84c07258ba6 tempest-VolumesExtendTest-696145693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-63e31c6c-376f-43d8-af42-f82b2bd3a051" returned: 0 in 0.381s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f16ce762-366e-45a2-8524-c84c07258ba6 tempest-VolumesExtendTest-696145693 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-63e31c6c-376f-43d8-af42-f82b2bd3a051 2G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f16ce762-366e-45a2-8524-c84c07258ba6 tempest-VolumesExtendTest-696145693 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-63e31c6c-376f-43d8-af42-f82b2bd3a051 2G" returned: 0 in 0.124s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f16ce762-366e-45a2-8524-c84c07258ba6 tempest-VolumesExtendTest-696145693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.528s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:45 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-f16ce762-366e-45a2-8524-c84c07258ba6 tempest-VolumesExtendTest-696145693 None] Extend volume completed successfully.
Nov 06 11:57:46 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-61a68a69-f3c2-4204-9e15-feb635c1a606 tempest-ProjectReaderTests-810269047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:57:46 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-61a68a69-f3c2-4204-9e15-feb635c1a606 tempest-ProjectReaderTests-810269047 None] Flow 'volume_create_manager' (e6aa48ab-be16-4c71-b39e-773876927d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:57:46 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-61a68a69-f3c2-4204-9e15-feb635c1a606 tempest-ProjectReaderTests-810269047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f92b0045-72eb-4f0a-9e0c-e644d3308776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:46 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-61a68a69-f3c2-4204-9e15-feb635c1a606 tempest-ProjectReaderTests-810269047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f92b0045-72eb-4f0a-9e0c-e644d3308776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-292833809',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e1f496c-367e-4484-9df6-62f1786b7ee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca0c313b43344408a79c02b025b7700f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:57:46Z,use_quota=True,user_id='8919b4ff5895438a8ded389048c5e286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:46 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-61a68a69-f3c2-4204-9e15-feb635c1a606 tempest-ProjectReaderTests-810269047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (110293d6-92c5-40d5-9dd3-9e943af27004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:46 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-61a68a69-f3c2-4204-9e15-feb635c1a606 tempest-ProjectReaderTests-810269047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (110293d6-92c5-40d5-9dd3-9e943af27004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:46 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-61a68a69-f3c2-4204-9e15-feb635c1a606 tempest-ProjectReaderTests-810269047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e357f1f1-4648-420a-9feb-e2ae2548915a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:46 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-61a68a69-f3c2-4204-9e15-feb635c1a606 tempest-ProjectReaderTests-810269047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e357f1f1-4648-420a-9feb-e2ae2548915a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e1f496c-367e-4484-9df6-62f1786b7ee6', 'volume_name': 'volume-4e1f496c-367e-4484-9df6-62f1786b7ee6', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:46 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-61a68a69-f3c2-4204-9e15-feb635c1a606 tempest-ProjectReaderTests-810269047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b17e502-1c63-4dbe-96d3-cdbe0882c344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:46 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-61a68a69-f3c2-4204-9e15-feb635c1a606 tempest-ProjectReaderTests-810269047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b17e502-1c63-4dbe-96d3-cdbe0882c344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:46 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-61a68a69-f3c2-4204-9e15-feb635c1a606 tempest-ProjectReaderTests-810269047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb3ccee5-0510-4158-a9fa-d07b3f741f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:46 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-61a68a69-f3c2-4204-9e15-feb635c1a606 tempest-ProjectReaderTests-810269047 None] Volume 4e1f496c-367e-4484-9df6-62f1786b7ee6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e1f496c-367e-4484-9df6-62f1786b7ee6', 'volume_size': 1}
Nov 06 11:57:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-61a68a69-f3c2-4204-9e15-feb635c1a606 tempest-ProjectReaderTests-810269047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-61a68a69-f3c2-4204-9e15-feb635c1a606 tempest-ProjectReaderTests-810269047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:46 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-61a68a69-f3c2-4204-9e15-feb635c1a606 tempest-ProjectReaderTests-810269047 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-292833809',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e1f496c-367e-4484-9df6-62f1786b7ee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca0c313b43344408a79c02b025b7700f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:57:46Z,use_quota=True,user_id='8919b4ff5895438a8ded389048c5e286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:57:46 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-61a68a69-f3c2-4204-9e15-feb635c1a606 tempest-ProjectReaderTests-810269047 None] Creating volume 4e1f496c-367e-4484-9df6-62f1786b7ee6 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:57:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-61a68a69-f3c2-4204-9e15-feb635c1a606 tempest-ProjectReaderTests-810269047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-61a68a69-f3c2-4204-9e15-feb635c1a606 tempest-ProjectReaderTests-810269047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:46 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-61a68a69-f3c2-4204-9e15-feb635c1a606 tempest-ProjectReaderTests-810269047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:57:46 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-61a68a69-f3c2-4204-9e15-feb635c1a606 tempest-ProjectReaderTests-810269047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:57:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-61a68a69-f3c2-4204-9e15-feb635c1a606 tempest-ProjectReaderTests-810269047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:46 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-61a68a69-f3c2-4204-9e15-feb635c1a606 tempest-ProjectReaderTests-810269047 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:57:46 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-61a68a69-f3c2-4204-9e15-feb635c1a606 tempest-ProjectReaderTests-810269047 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:57:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-61a68a69-f3c2-4204-9e15-feb635c1a606 tempest-ProjectReaderTests-810269047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4e1f496c-367e-4484-9df6-62f1786b7ee6 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:46 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-4dbaa191-9894-441a-b246-608e0fe936e2 tempest-VolumesExtendTest-696145693 None] Acquiring lock "cinder-63e31c6c-376f-43d8-af42-f82b2bd3a051-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:57:46 devstack sudo[104220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4e1f496c-367e-4484-9df6-62f1786b7ee6 1073741824
Nov 06 11:57:46 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-4dbaa191-9894-441a-b246-608e0fe936e2 tempest-VolumesExtendTest-696145693 None] Lock "cinder-63e31c6c-376f-43d8-af42-f82b2bd3a051-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:57:46 devstack sudo[104220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:46 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:57:46 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] Flow 'volume_create_manager' (bdd2568d-4e01-47ee-8a5b-506c6ec06bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:57:46 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cf520a3-cab9-4b7f-8a16-54335d24d9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:46 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cf520a3-cab9-4b7f-8a16-54335d24d9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d95cfd29-9c7c-43b1-9640-3027e68da945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6912fdcf55634de7bd76efaaf77e2722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fae1835d-760b-4753-a3f9-c0edfab86d94,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:57:47Z,use_quota=True,user_id='06ddaece989a4d6095a85ebb360aea04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:46 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15c741d2-bdd0-43ce-a56e-26c07c061e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:46 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15c741d2-bdd0-43ce-a56e-26c07c061e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:46 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f46c7230-d911-40cb-9c43-bb3cb86d4b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:46 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f46c7230-d911-40cb-9c43-bb3cb86d4b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd95cfd29-9c7c-43b1-9640-3027e68da945', 'volume_name': 'volume-d95cfd29-9c7c-43b1-9640-3027e68da945', 'volume_size': 1, 'snapshot_id': 'fae1835d-760b-4753-a3f9-c0edfab86d94'}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:46 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52bb1afc-1bd0-400a-8a70-f1ab5e981cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:46 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52bb1afc-1bd0-400a-8a70-f1ab5e981cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:46 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac44c13f-ff7a-49d5-919a-cc99f4c7760b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:46 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] Volume d95cfd29-9c7c-43b1-9640-3027e68da945: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d95cfd29-9c7c-43b1-9640-3027e68da945', 'volume_size': 1, 'snapshot_id': 'fae1835d-760b-4753-a3f9-c0edfab86d94'}
Nov 06 11:57:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:46 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-4dbaa191-9894-441a-b246-608e0fe936e2 tempest-VolumesExtendTest-696145693 None] Acquiring lock "cinder-quobyte-63e31c6c-376f-43d8-af42-f82b2bd3a051" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:57:46 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-4dbaa191-9894-441a-b246-608e0fe936e2 tempest-VolumesExtendTest-696145693 None] Lock "cinder-quobyte-63e31c6c-376f-43d8-af42-f82b2bd3a051" acquired by "delete_volume" :: waited 0.015s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:57:47 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[650c7eaf-4776-4045-99fb-c74096792156]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:57:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4dbaa191-9894-441a-b246-608e0fe936e2 tempest-VolumesExtendTest-696145693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-63e31c6c-376f-43d8-af42-f82b2bd3a051 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:47 devstack sudo[104225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-63e31c6c-376f-43d8-af42-f82b2bd3a051
Nov 06 11:57:47 devstack sudo[104225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:47 devstack sudo[104220]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-61a68a69-f3c2-4204-9e15-feb635c1a606 tempest-ProjectReaderTests-810269047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4e1f496c-367e-4484-9df6-62f1786b7ee6 1073741824" returned: 0 in 0.473s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-61a68a69-f3c2-4204-9e15-feb635c1a606 tempest-ProjectReaderTests-810269047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4e1f496c-367e-4484-9df6-62f1786b7ee6 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:47 devstack sudo[104227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4e1f496c-367e-4484-9df6-62f1786b7ee6
Nov 06 11:57:47 devstack sudo[104227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:47 devstack sudo[104225]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4dbaa191-9894-441a-b246-608e0fe936e2 tempest-VolumesExtendTest-696145693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-63e31c6c-376f-43d8-af42-f82b2bd3a051" returned: 0 in 0.421s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4dbaa191-9894-441a-b246-608e0fe936e2 tempest-VolumesExtendTest-696145693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-63e31c6c-376f-43d8-af42-f82b2bd3a051 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:47 devstack sudo[104232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-63e31c6c-376f-43d8-af42-f82b2bd3a051
Nov 06 11:57:47 devstack sudo[104232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:47 devstack sudo[104227]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-61a68a69-f3c2-4204-9e15-feb635c1a606 tempest-ProjectReaderTests-810269047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4e1f496c-367e-4484-9df6-62f1786b7ee6" returned: 0 in 0.290s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:47 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-61a68a69-f3c2-4204-9e15-feb635c1a606 tempest-ProjectReaderTests-810269047 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:57:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-61a68a69-f3c2-4204-9e15-feb635c1a606 tempest-ProjectReaderTests-810269047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.622s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:47 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] Acquiring lock "cinder-quobyte-fae1835d-760b-4753-a3f9-c0edfab86d94-d95cfd29-9c7c-43b1-9640-3027e68da945" by "_create_volume_from_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:57:47 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-61a68a69-f3c2-4204-9e15-feb635c1a606 tempest-ProjectReaderTests-810269047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb3ccee5-0510-4158-a9fa-d07b3f741f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e1f496c-367e-4484-9df6-62f1786b7ee6', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:47 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-61a68a69-f3c2-4204-9e15-feb635c1a606 tempest-ProjectReaderTests-810269047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc946200-515c-4c46-8674-c72f3baf362e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:47 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] Lock "cinder-quobyte-fae1835d-760b-4753-a3f9-c0edfab86d94-d95cfd29-9c7c-43b1-9640-3027e68da945" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:57:47 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] Creating volume d95cfd29-9c7c-43b1-9640-3027e68da945 from snapshot fae1835d-760b-4753-a3f9-c0edfab86d94 {{(pid=87165) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 06 11:57:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:47 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:57:47 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:57:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:47 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:57:47 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] Acquiring lock "cinder-quobyte-d95cfd29-9c7c-43b1-9640-3027e68da945" by "_copy_volume_from_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:57:47 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-61a68a69-f3c2-4204-9e15-feb635c1a606 tempest-ProjectReaderTests-810269047 None] Volume volume-4e1f496c-367e-4484-9df6-62f1786b7ee6 (4e1f496c-367e-4484-9df6-62f1786b7ee6): created successfully
Nov 06 11:57:47 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-61a68a69-f3c2-4204-9e15-feb635c1a606 tempest-ProjectReaderTests-810269047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc946200-515c-4c46-8674-c72f3baf362e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:47 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-61a68a69-f3c2-4204-9e15-feb635c1a606 tempest-ProjectReaderTests-810269047 None] Flow 'volume_create_manager' (e6aa48ab-be16-4c71-b39e-773876927d25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:57:47 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] Lock "cinder-quobyte-d95cfd29-9c7c-43b1-9640-3027e68da945" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:57:47 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] snapshot: fae1835d-760b-4753-a3f9-c0edfab86d94, volume: d95cfd29-9c7c-43b1-9640-3027e68da945,  {{(pid=87165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 06 11:57:47 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-61a68a69-f3c2-4204-9e15-feb635c1a606 tempest-ProjectReaderTests-810269047 None] Created volume successfully.
Nov 06 11:57:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:47 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:57:47 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:57:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:47 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a83de6b-45dd-4772-a423-a3a7b6c542e5]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:57:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce.fae1835d-760b-4753-a3f9-c0edfab86d94 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:47 devstack sudo[104232]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4dbaa191-9894-441a-b246-608e0fe936e2 tempest-VolumesExtendTest-696145693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-63e31c6c-376f-43d8-af42-f82b2bd3a051" returned: 0 in 0.255s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:47 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-4dbaa191-9894-441a-b246-608e0fe936e2 tempest-VolumesExtendTest-696145693 None] Lock "cinder-quobyte-63e31c6c-376f-43d8-af42-f82b2bd3a051" released by "delete_volume" :: held 0.722s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:57:47 devstack sudo[104236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce.fae1835d-760b-4753-a3f9-c0edfab86d94
Nov 06 11:57:47 devstack sudo[104236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:47 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-4dbaa191-9894-441a-b246-608e0fe936e2 tempest-VolumesExtendTest-696145693 None] Created reservations ['86803749-330a-4528-b9e9-560e36a5ae9f', 'e714f530-6d13-49f5-9de1-7252f100ea7c', '9141e821-73b7-4404-96dd-b35512d176dd', 'abb41e85-dad8-4ea1-b4d8-e0737ca1d1b2'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:57:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4dbaa191-9894-441a-b246-608e0fe936e2 tempest-VolumesExtendTest-696145693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4dbaa191-9894-441a-b246-608e0fe936e2 tempest-VolumesExtendTest-696145693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:47 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-4dbaa191-9894-441a-b246-608e0fe936e2 tempest-VolumesExtendTest-696145693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:57:47 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-4dbaa191-9894-441a-b246-608e0fe936e2 tempest-VolumesExtendTest-696145693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:57:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4dbaa191-9894-441a-b246-608e0fe936e2 tempest-VolumesExtendTest-696145693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4dbaa191-9894-441a-b246-608e0fe936e2 tempest-VolumesExtendTest-696145693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:47 devstack sudo[104238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:57:47 devstack sudo[104238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:48 devstack sudo[104236]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce.fae1835d-760b-4753-a3f9-c0edfab86d94" returned: 0 in 0.393s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:48 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96254a87-19ef-4c5d-a921-83035e5d56ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:57:48 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be88112-9c8b-41c5-a866-f7d9de2c8050]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:57:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:48 devstack sudo[104238]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4dbaa191-9894-441a-b246-608e0fe936e2 tempest-VolumesExtendTest-696145693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.262s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:48 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-4dbaa191-9894-441a-b246-608e0fe936e2 tempest-VolumesExtendTest-696145693 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:57:48 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-4dbaa191-9894-441a-b246-608e0fe936e2 tempest-VolumesExtendTest-696145693 None] Deleted volume successfully.
Nov 06 11:57:48 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-4dbaa191-9894-441a-b246-608e0fe936e2 tempest-VolumesExtendTest-696145693 None] Lock "cinder-63e31c6c-376f-43d8-af42-f82b2bd3a051-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:57:48 devstack sudo[104243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce
Nov 06 11:57:48 devstack sudo[104243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:48 devstack sudo[104243]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce" returned: 0 in 0.382s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:48 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce {{(pid=87165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 06 11:57:48 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] Creating direct copy from snapshot {{(pid=87165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 06 11:57:48 devstack cinder-volume[87165]: DEBUG cinder.utils [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] Path /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d95cfd29-9c7c-43b1-9640-3027e68da945 not found in is_blk_device check {{(pid=87165) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 06 11:57:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d95cfd29-9c7c-43b1-9640-3027e68da945 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:48 devstack sudo[104249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d95cfd29-9c7c-43b1-9640-3027e68da945
Nov 06 11:57:48 devstack sudo[104249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:48 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b421fe34-3ea3-4916-a1df-e2b7c35fd215 tempest-ProjectReaderTests-810269047 None] Acquiring lock "cinder-4e1f496c-367e-4484-9df6-62f1786b7ee6-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:57:48 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b421fe34-3ea3-4916-a1df-e2b7c35fd215 tempest-ProjectReaderTests-810269047 None] Lock "cinder-4e1f496c-367e-4484-9df6-62f1786b7ee6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:57:48 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b421fe34-3ea3-4916-a1df-e2b7c35fd215 tempest-ProjectReaderTests-810269047 None] Acquiring lock "cinder-quobyte-4e1f496c-367e-4484-9df6-62f1786b7ee6" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:57:48 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b421fe34-3ea3-4916-a1df-e2b7c35fd215 tempest-ProjectReaderTests-810269047 None] Lock "cinder-quobyte-4e1f496c-367e-4484-9df6-62f1786b7ee6" acquired by "delete_volume" :: waited 0.016s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:57:48 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2869b08e-0fed-4da7-9d50-638a52a3c8ab]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:57:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b421fe34-3ea3-4916-a1df-e2b7c35fd215 tempest-ProjectReaderTests-810269047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4e1f496c-367e-4484-9df6-62f1786b7ee6 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:48 devstack sudo[104255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4e1f496c-367e-4484-9df6-62f1786b7ee6
Nov 06 11:57:48 devstack sudo[104255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:49 devstack sudo[104255]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b421fe34-3ea3-4916-a1df-e2b7c35fd215 tempest-ProjectReaderTests-810269047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4e1f496c-367e-4484-9df6-62f1786b7ee6" returned: 0 in 0.619s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b421fe34-3ea3-4916-a1df-e2b7c35fd215 tempest-ProjectReaderTests-810269047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4e1f496c-367e-4484-9df6-62f1786b7ee6 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:49 devstack sudo[104267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4e1f496c-367e-4484-9df6-62f1786b7ee6
Nov 06 11:57:49 devstack sudo[104267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:49 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c6beaef-6ddc-49f9-aecd-cd77fa895c0b tempest-VolumesExtendTest-696145693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:57:49 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6c6beaef-6ddc-49f9-aecd-cd77fa895c0b tempest-VolumesExtendTest-696145693 None] Flow 'volume_create_manager' (f34bc662-533e-426d-bb2d-bfee460e9784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:57:49 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6c6beaef-6ddc-49f9-aecd-cd77fa895c0b tempest-VolumesExtendTest-696145693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e56e23a-6e09-436f-abca-8b9164039c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:49 devstack sudo[104267]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:49 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6c6beaef-6ddc-49f9-aecd-cd77fa895c0b tempest-VolumesExtendTest-696145693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e56e23a-6e09-436f-abca-8b9164039c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1571053048',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acfbac72-65fd-4691-940b-d7abe3ff645a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7de7e333a7f4c5ab8b1536a54b0d0bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:57:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:57:50Z,use_quota=True,user_id='c656684a1c5640be9626415921c97350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:49 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6c6beaef-6ddc-49f9-aecd-cd77fa895c0b tempest-VolumesExtendTest-696145693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (415a3019-253e-4111-9c22-ed18c7f4a1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:49 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6c6beaef-6ddc-49f9-aecd-cd77fa895c0b tempest-VolumesExtendTest-696145693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (415a3019-253e-4111-9c22-ed18c7f4a1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:49 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6c6beaef-6ddc-49f9-aecd-cd77fa895c0b tempest-VolumesExtendTest-696145693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3967ac1b-70b5-42ca-83a1-5ca31ea28ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:49 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6c6beaef-6ddc-49f9-aecd-cd77fa895c0b tempest-VolumesExtendTest-696145693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3967ac1b-70b5-42ca-83a1-5ca31ea28ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acfbac72-65fd-4691-940b-d7abe3ff645a', 'volume_name': 'volume-acfbac72-65fd-4691-940b-d7abe3ff645a', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:49 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6c6beaef-6ddc-49f9-aecd-cd77fa895c0b tempest-VolumesExtendTest-696145693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49e55574-ef9b-45e3-8650-545c7af67820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:49 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6c6beaef-6ddc-49f9-aecd-cd77fa895c0b tempest-VolumesExtendTest-696145693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49e55574-ef9b-45e3-8650-545c7af67820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:49 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6c6beaef-6ddc-49f9-aecd-cd77fa895c0b tempest-VolumesExtendTest-696145693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24d5b7fb-651f-4ea0-bc1c-22611e62ad48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:49 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-6c6beaef-6ddc-49f9-aecd-cd77fa895c0b tempest-VolumesExtendTest-696145693 None] Volume acfbac72-65fd-4691-940b-d7abe3ff645a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acfbac72-65fd-4691-940b-d7abe3ff645a', 'volume_size': 1}
Nov 06 11:57:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6c6beaef-6ddc-49f9-aecd-cd77fa895c0b tempest-VolumesExtendTest-696145693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b421fe34-3ea3-4916-a1df-e2b7c35fd215 tempest-ProjectReaderTests-810269047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4e1f496c-367e-4484-9df6-62f1786b7ee6" returned: 0 in 0.579s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:49 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b421fe34-3ea3-4916-a1df-e2b7c35fd215 tempest-ProjectReaderTests-810269047 None] Lock "cinder-quobyte-4e1f496c-367e-4484-9df6-62f1786b7ee6" released by "delete_volume" :: held 1.253s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:57:50 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-b421fe34-3ea3-4916-a1df-e2b7c35fd215 tempest-ProjectReaderTests-810269047 None] Created reservations ['c4ee9fd1-552e-40f4-b222-b81afc52bcf8', '834b7dbf-8b71-4eb5-8bdf-df1554e26306', '7c720ce2-f054-4a58-b551-e0b25e7e3a5f', '8a4e441c-c641-406f-a09d-1e657e52f088'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:57:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b421fe34-3ea3-4916-a1df-e2b7c35fd215 tempest-ProjectReaderTests-810269047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b421fe34-3ea3-4916-a1df-e2b7c35fd215 tempest-ProjectReaderTests-810269047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:50 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b421fe34-3ea3-4916-a1df-e2b7c35fd215 tempest-ProjectReaderTests-810269047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:57:50 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b421fe34-3ea3-4916-a1df-e2b7c35fd215 tempest-ProjectReaderTests-810269047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:57:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b421fe34-3ea3-4916-a1df-e2b7c35fd215 tempest-ProjectReaderTests-810269047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b421fe34-3ea3-4916-a1df-e2b7c35fd215 tempest-ProjectReaderTests-810269047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:50 devstack sudo[104270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:57:50 devstack sudo[104270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:50 devstack sudo[104270]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b421fe34-3ea3-4916-a1df-e2b7c35fd215 tempest-ProjectReaderTests-810269047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.513s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:50 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-b421fe34-3ea3-4916-a1df-e2b7c35fd215 tempest-ProjectReaderTests-810269047 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:57:50 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-b421fe34-3ea3-4916-a1df-e2b7c35fd215 tempest-ProjectReaderTests-810269047 None] Deleted volume successfully.
Nov 06 11:57:50 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b421fe34-3ea3-4916-a1df-e2b7c35fd215 tempest-ProjectReaderTests-810269047 None] Lock "cinder-4e1f496c-367e-4484-9df6-62f1786b7ee6-delete_volume" released by "delete_volume" :: held 2.111s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:57:51 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-398ff7f9-436a-4bbe-8355-ee222f94923c tempest-ProjectReaderTests-810269047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:57:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-398ff7f9-436a-4bbe-8355-ee222f94923c tempest-ProjectReaderTests-810269047 None] Flow 'volume_create_manager' (647c132d-074c-4b79-8ced-1215110d1413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:57:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-398ff7f9-436a-4bbe-8355-ee222f94923c tempest-ProjectReaderTests-810269047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37990d89-c2b9-4dae-a26a-5e29f668b855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-398ff7f9-436a-4bbe-8355-ee222f94923c tempest-ProjectReaderTests-810269047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37990d89-c2b9-4dae-a26a-5e29f668b855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1625948753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54e61954-198d-469c-bdd8-4027c3442e08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca0c313b43344408a79c02b025b7700f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:57:51Z,use_quota=True,user_id='8919b4ff5895438a8ded389048c5e286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-398ff7f9-436a-4bbe-8355-ee222f94923c tempest-ProjectReaderTests-810269047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b90f2817-7482-444e-9449-92521457dcc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-398ff7f9-436a-4bbe-8355-ee222f94923c tempest-ProjectReaderTests-810269047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b90f2817-7482-444e-9449-92521457dcc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-398ff7f9-436a-4bbe-8355-ee222f94923c tempest-ProjectReaderTests-810269047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fdbcecf-1c8d-47b0-bbf6-039ebbdb41a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-398ff7f9-436a-4bbe-8355-ee222f94923c tempest-ProjectReaderTests-810269047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fdbcecf-1c8d-47b0-bbf6-039ebbdb41a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54e61954-198d-469c-bdd8-4027c3442e08', 'volume_name': 'volume-54e61954-198d-469c-bdd8-4027c3442e08', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-398ff7f9-436a-4bbe-8355-ee222f94923c tempest-ProjectReaderTests-810269047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (364a1991-98ef-4f97-9909-fdf554adb076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-398ff7f9-436a-4bbe-8355-ee222f94923c tempest-ProjectReaderTests-810269047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (364a1991-98ef-4f97-9909-fdf554adb076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:51 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-398ff7f9-436a-4bbe-8355-ee222f94923c tempest-ProjectReaderTests-810269047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91451e90-6511-490e-979a-dd282cc45444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:51 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-398ff7f9-436a-4bbe-8355-ee222f94923c tempest-ProjectReaderTests-810269047 None] Volume 54e61954-198d-469c-bdd8-4027c3442e08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54e61954-198d-469c-bdd8-4027c3442e08', 'volume_size': 1}
Nov 06 11:57:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-398ff7f9-436a-4bbe-8355-ee222f94923c tempest-ProjectReaderTests-810269047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:54 devstack sudo[104249]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d95cfd29-9c7c-43b1-9640-3027e68da945" returned: 0 in 6.436s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:54 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] Image conversion details: src /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce, size 1024.00 MB, duration 6.44 sec, destination /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d95cfd29-9c7c-43b1-9640-3027e68da945 {{(pid=87165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 11:57:54 devstack cinder-volume[87165]: INFO cinder.image.image_utils [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] Converted 1024.00 MB image at 159.07 MB/s
Nov 06 11:57:54 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d95cfd29-9c7c-43b1-9640-3027e68da945 is being set with open permissions: ugo+rw
Nov 06 11:57:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d95cfd29-9c7c-43b1-9640-3027e68da945 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:54 devstack sudo[104274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d95cfd29-9c7c-43b1-9640-3027e68da945
Nov 06 11:57:54 devstack sudo[104274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:55 devstack sudo[104274]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d95cfd29-9c7c-43b1-9640-3027e68da945" returned: 0 in 0.234s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:55 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] Lock "cinder-quobyte-d95cfd29-9c7c-43b1-9640-3027e68da945" released by "_copy_volume_from_snapshot" :: held 7.541s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:57:55 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] Lock "cinder-quobyte-fae1835d-760b-4753-a3f9-c0edfab86d94-d95cfd29-9c7c-43b1-9640-3027e68da945" released by "_create_volume_from_snapshot" :: held 7.618s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:57:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.649s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6c6beaef-6ddc-49f9-aecd-cd77fa895c0b tempest-VolumesExtendTest-696145693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.267s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:55 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-6c6beaef-6ddc-49f9-aecd-cd77fa895c0b tempest-VolumesExtendTest-696145693 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1571053048',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acfbac72-65fd-4691-940b-d7abe3ff645a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7de7e333a7f4c5ab8b1536a54b0d0bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:57:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:57:50Z,use_quota=True,user_id='c656684a1c5640be9626415921c97350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:57:55 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-6c6beaef-6ddc-49f9-aecd-cd77fa895c0b tempest-VolumesExtendTest-696145693 None] Creating volume acfbac72-65fd-4691-940b-d7abe3ff645a {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:57:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6c6beaef-6ddc-49f9-aecd-cd77fa895c0b tempest-VolumesExtendTest-696145693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6c6beaef-6ddc-49f9-aecd-cd77fa895c0b tempest-VolumesExtendTest-696145693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:55 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-6c6beaef-6ddc-49f9-aecd-cd77fa895c0b tempest-VolumesExtendTest-696145693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:57:55 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-6c6beaef-6ddc-49f9-aecd-cd77fa895c0b tempest-VolumesExtendTest-696145693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:57:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6c6beaef-6ddc-49f9-aecd-cd77fa895c0b tempest-VolumesExtendTest-696145693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:55 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-6c6beaef-6ddc-49f9-aecd-cd77fa895c0b tempest-VolumesExtendTest-696145693 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:57:55 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-6c6beaef-6ddc-49f9-aecd-cd77fa895c0b tempest-VolumesExtendTest-696145693 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:57:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6c6beaef-6ddc-49f9-aecd-cd77fa895c0b tempest-VolumesExtendTest-696145693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:55 devstack sudo[104277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a 1073741824
Nov 06 11:57:55 devstack sudo[104277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:55 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac44c13f-ff7a-49d5-919a-cc99f4c7760b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d95cfd29-9c7c-43b1-9640-3027e68da945', 'volume_size': 1, 'snapshot_id': 'fae1835d-760b-4753-a3f9-c0edfab86d94'}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:55 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e79daa66-e33e-4e59-9e5c-a356d26562f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:55 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] Volume volume-d95cfd29-9c7c-43b1-9640-3027e68da945 (d95cfd29-9c7c-43b1-9640-3027e68da945): created successfully
Nov 06 11:57:55 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e79daa66-e33e-4e59-9e5c-a356d26562f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:55 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] Flow 'volume_create_manager' (bdd2568d-4e01-47ee-8a5b-506c6ec06bee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:57:55 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-51ce898d-dd01-4989-b28d-26956c930381 tempest-SnapshotDependencyTests-640174777 None] Created volume successfully.
Nov 06 11:57:55 devstack sudo[104277]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6c6beaef-6ddc-49f9-aecd-cd77fa895c0b tempest-VolumesExtendTest-696145693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a 1073741824" returned: 0 in 0.426s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6c6beaef-6ddc-49f9-aecd-cd77fa895c0b tempest-VolumesExtendTest-696145693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:55 devstack sudo[104283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a
Nov 06 11:57:55 devstack sudo[104283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:55 devstack sudo[104283]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6c6beaef-6ddc-49f9-aecd-cd77fa895c0b tempest-VolumesExtendTest-696145693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a" returned: 0 in 0.232s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:55 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-6c6beaef-6ddc-49f9-aecd-cd77fa895c0b tempest-VolumesExtendTest-696145693 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:57:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6c6beaef-6ddc-49f9-aecd-cd77fa895c0b tempest-VolumesExtendTest-696145693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-398ff7f9-436a-4bbe-8355-ee222f94923c tempest-ProjectReaderTests-810269047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.213s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:55 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-398ff7f9-436a-4bbe-8355-ee222f94923c tempest-ProjectReaderTests-810269047 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1625948753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54e61954-198d-469c-bdd8-4027c3442e08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca0c313b43344408a79c02b025b7700f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:57:51Z,use_quota=True,user_id='8919b4ff5895438a8ded389048c5e286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:57:55 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-398ff7f9-436a-4bbe-8355-ee222f94923c tempest-ProjectReaderTests-810269047 None] Creating volume 54e61954-198d-469c-bdd8-4027c3442e08 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:57:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-398ff7f9-436a-4bbe-8355-ee222f94923c tempest-ProjectReaderTests-810269047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-398ff7f9-436a-4bbe-8355-ee222f94923c tempest-ProjectReaderTests-810269047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:55 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-398ff7f9-436a-4bbe-8355-ee222f94923c tempest-ProjectReaderTests-810269047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:57:55 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-398ff7f9-436a-4bbe-8355-ee222f94923c tempest-ProjectReaderTests-810269047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:57:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-398ff7f9-436a-4bbe-8355-ee222f94923c tempest-ProjectReaderTests-810269047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:55 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-398ff7f9-436a-4bbe-8355-ee222f94923c tempest-ProjectReaderTests-810269047 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:57:55 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-398ff7f9-436a-4bbe-8355-ee222f94923c tempest-ProjectReaderTests-810269047 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:57:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-398ff7f9-436a-4bbe-8355-ee222f94923c tempest-ProjectReaderTests-810269047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-54e61954-198d-469c-bdd8-4027c3442e08 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:55 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6c6beaef-6ddc-49f9-aecd-cd77fa895c0b tempest-VolumesExtendTest-696145693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24d5b7fb-651f-4ea0-bc1c-22611e62ad48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acfbac72-65fd-4691-940b-d7abe3ff645a', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:55 devstack sudo[104286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-54e61954-198d-469c-bdd8-4027c3442e08 1073741824
Nov 06 11:57:55 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6c6beaef-6ddc-49f9-aecd-cd77fa895c0b tempest-VolumesExtendTest-696145693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eefa6431-478f-42d8-916c-b71313390af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:55 devstack sudo[104286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:55 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-6c6beaef-6ddc-49f9-aecd-cd77fa895c0b tempest-VolumesExtendTest-696145693 None] Volume volume-acfbac72-65fd-4691-940b-d7abe3ff645a (acfbac72-65fd-4691-940b-d7abe3ff645a): created successfully
Nov 06 11:57:55 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6c6beaef-6ddc-49f9-aecd-cd77fa895c0b tempest-VolumesExtendTest-696145693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eefa6431-478f-42d8-916c-b71313390af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:55 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6c6beaef-6ddc-49f9-aecd-cd77fa895c0b tempest-VolumesExtendTest-696145693 None] Flow 'volume_create_manager' (f34bc662-533e-426d-bb2d-bfee460e9784) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:57:55 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-6c6beaef-6ddc-49f9-aecd-cd77fa895c0b tempest-VolumesExtendTest-696145693 None] Created volume successfully.
Nov 06 11:57:56 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0898ae97-f9f6-4b59-a144-502ed9cbaec3 tempest-SnapshotDependencyTests-640174777 None] Acquiring lock "cinder-fae1835d-760b-4753-a3f9-c0edfab86d94-delete_snapshot" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:57:56 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0898ae97-f9f6-4b59-a144-502ed9cbaec3 tempest-SnapshotDependencyTests-640174777 None] Lock "cinder-fae1835d-760b-4753-a3f9-c0edfab86d94-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:57:56 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0898ae97-f9f6-4b59-a144-502ed9cbaec3 tempest-SnapshotDependencyTests-640174777 None] Acquiring lock "cinder-quobyte-96254a87-19ef-4c5d-a921-83035e5d56ce" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:57:56 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0898ae97-f9f6-4b59-a144-502ed9cbaec3 tempest-SnapshotDependencyTests-640174777 None] Lock "cinder-quobyte-96254a87-19ef-4c5d-a921-83035e5d56ce" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:57:56 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0898ae97-f9f6-4b59-a144-502ed9cbaec3 tempest-SnapshotDependencyTests-640174777 None] Acquiring lock "cinder-quobyte-fae1835d-760b-4753-a3f9-c0edfab86d94" by "_delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:57:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4904a223-e7c2-405b-a90c-1a59adba1c30 tempest-VolumesExtendTest-696145693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:56 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0898ae97-f9f6-4b59-a144-502ed9cbaec3 tempest-SnapshotDependencyTests-640174777 None] Lock "cinder-quobyte-fae1835d-760b-4753-a3f9-c0edfab86d94" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:57:56 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-0898ae97-f9f6-4b59-a144-502ed9cbaec3 tempest-SnapshotDependencyTests-640174777 None] Deleting offline snapshot fae1835d-760b-4753-a3f9-c0edfab86d94 of volume 96254a87-19ef-4c5d-a921-83035e5d56ce {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 11:57:56 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-0898ae97-f9f6-4b59-a144-502ed9cbaec3 tempest-SnapshotDependencyTests-640174777 None] snapshot_file for this snap is: volume-96254a87-19ef-4c5d-a921-83035e5d56ce.fae1835d-760b-4753-a3f9-c0edfab86d94 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 11:57:56 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[79dcfbb9-571d-498a-942a-bedaba1e643d]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:57:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0898ae97-f9f6-4b59-a144-502ed9cbaec3 tempest-SnapshotDependencyTests-640174777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce.fae1835d-760b-4753-a3f9-c0edfab86d94 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:56 devstack sudo[104286]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-398ff7f9-436a-4bbe-8355-ee222f94923c tempest-ProjectReaderTests-810269047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-54e61954-198d-469c-bdd8-4027c3442e08 1073741824" returned: 0 in 0.557s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-398ff7f9-436a-4bbe-8355-ee222f94923c tempest-ProjectReaderTests-810269047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-54e61954-198d-469c-bdd8-4027c3442e08 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:56 devstack sudo[104293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-54e61954-198d-469c-bdd8-4027c3442e08
Nov 06 11:57:56 devstack sudo[104293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:56 devstack sudo[104292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce.fae1835d-760b-4753-a3f9-c0edfab86d94
Nov 06 11:57:56 devstack sudo[104292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:56 devstack sudo[104293]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-398ff7f9-436a-4bbe-8355-ee222f94923c tempest-ProjectReaderTests-810269047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-54e61954-198d-469c-bdd8-4027c3442e08" returned: 0 in 0.273s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:56 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-398ff7f9-436a-4bbe-8355-ee222f94923c tempest-ProjectReaderTests-810269047 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:57:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-398ff7f9-436a-4bbe-8355-ee222f94923c tempest-ProjectReaderTests-810269047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4904a223-e7c2-405b-a90c-1a59adba1c30 tempest-VolumesExtendTest-696145693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.399s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:56 devstack sudo[104292]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:56 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-398ff7f9-436a-4bbe-8355-ee222f94923c tempest-ProjectReaderTests-810269047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91451e90-6511-490e-979a-dd282cc45444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54e61954-198d-469c-bdd8-4027c3442e08', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:56 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-398ff7f9-436a-4bbe-8355-ee222f94923c tempest-ProjectReaderTests-810269047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a2e3b1b-9af2-4134-8919-16a3e1cc6a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0898ae97-f9f6-4b59-a144-502ed9cbaec3 tempest-SnapshotDependencyTests-640174777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce.fae1835d-760b-4753-a3f9-c0edfab86d94" returned: 0 in 0.377s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:56 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-0898ae97-f9f6-4b59-a144-502ed9cbaec3 tempest-SnapshotDependencyTests-640174777 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96254a87-19ef-4c5d-a921-83035e5d56ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:57:56 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-4904a223-e7c2-405b-a90c-1a59adba1c30 tempest-VolumesExtendTest-696145693 None] Creating offline snapshot 69d26456-0ff0-4ecf-91d6-37f639773baa of volume acfbac72-65fd-4691-940b-d7abe3ff645a {{(pid=87165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 11:57:56 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-398ff7f9-436a-4bbe-8355-ee222f94923c tempest-ProjectReaderTests-810269047 None] Volume volume-54e61954-198d-469c-bdd8-4027c3442e08 (54e61954-198d-469c-bdd8-4027c3442e08): created successfully
Nov 06 11:57:56 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-398ff7f9-436a-4bbe-8355-ee222f94923c tempest-ProjectReaderTests-810269047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a2e3b1b-9af2-4134-8919-16a3e1cc6a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:56 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-398ff7f9-436a-4bbe-8355-ee222f94923c tempest-ProjectReaderTests-810269047 None] Flow 'volume_create_manager' (647c132d-074c-4b79-8ced-1215110d1413) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:57:56 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[252f4216-9dd5-4b1b-9ea2-06a8ff553d52]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:57:56 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cb8da9-f219-465c-bc53-e92ef9de4a78]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:57:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0898ae97-f9f6-4b59-a144-502ed9cbaec3 tempest-SnapshotDependencyTests-640174777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4904a223-e7c2-405b-a90c-1a59adba1c30 tempest-VolumesExtendTest-696145693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:56 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-398ff7f9-436a-4bbe-8355-ee222f94923c tempest-ProjectReaderTests-810269047 None] Created volume successfully.
Nov 06 11:57:56 devstack sudo[104301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce
Nov 06 11:57:56 devstack sudo[104301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:56 devstack sudo[104302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a
Nov 06 11:57:56 devstack sudo[104302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:57 devstack sudo[104302]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4904a223-e7c2-405b-a90c-1a59adba1c30 tempest-VolumesExtendTest-696145693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a" returned: 0 in 0.366s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4904a223-e7c2-405b-a90c-1a59adba1c30 tempest-VolumesExtendTest-696145693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a.69d26456-0ff0-4ecf-91d6-37f639773baa 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:57 devstack sudo[104310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a.69d26456-0ff0-4ecf-91d6-37f639773baa 1G
Nov 06 11:57:57 devstack sudo[104310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:57 devstack sudo[104301]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0898ae97-f9f6-4b59-a144-502ed9cbaec3 tempest-SnapshotDependencyTests-640174777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce" returned: 0 in 0.570s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0898ae97-f9f6-4b59-a144-502ed9cbaec3 tempest-SnapshotDependencyTests-640174777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce.fae1835d-760b-4753-a3f9-c0edfab86d94 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:57 devstack sudo[104313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce.fae1835d-760b-4753-a3f9-c0edfab86d94
Nov 06 11:57:57 devstack sudo[104313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:57 devstack sudo[104310]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4904a223-e7c2-405b-a90c-1a59adba1c30 tempest-VolumesExtendTest-696145693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a.69d26456-0ff0-4ecf-91d6-37f639773baa 1G" returned: 0 in 0.417s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4904a223-e7c2-405b-a90c-1a59adba1c30 tempest-VolumesExtendTest-696145693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acfbac72-65fd-4691-940b-d7abe3ff645a -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a.69d26456-0ff0-4ecf-91d6-37f639773baa {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:57 devstack sudo[104320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acfbac72-65fd-4691-940b-d7abe3ff645a -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a.69d26456-0ff0-4ecf-91d6-37f639773baa
Nov 06 11:57:57 devstack sudo[104320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:57 devstack sudo[104313]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0898ae97-f9f6-4b59-a144-502ed9cbaec3 tempest-SnapshotDependencyTests-640174777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce.fae1835d-760b-4753-a3f9-c0edfab86d94" returned: 0 in 0.355s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0898ae97-f9f6-4b59-a144-502ed9cbaec3 tempest-SnapshotDependencyTests-640174777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce.fae1835d-760b-4753-a3f9-c0edfab86d94 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:57 devstack sudo[104324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce.fae1835d-760b-4753-a3f9-c0edfab86d94
Nov 06 11:57:57 devstack sudo[104324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:57 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-abf72556-fbab-48eb-8b07-d0f22ced49cd tempest-ProjectReaderTests-810269047 None] Acquiring lock "cinder-54e61954-198d-469c-bdd8-4027c3442e08-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:57:57 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-abf72556-fbab-48eb-8b07-d0f22ced49cd tempest-ProjectReaderTests-810269047 None] Lock "cinder-54e61954-198d-469c-bdd8-4027c3442e08-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:57:57 devstack sudo[104320]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:57 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-abf72556-fbab-48eb-8b07-d0f22ced49cd tempest-ProjectReaderTests-810269047 None] Acquiring lock "cinder-quobyte-54e61954-198d-469c-bdd8-4027c3442e08" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:57:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4904a223-e7c2-405b-a90c-1a59adba1c30 tempest-VolumesExtendTest-696145693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acfbac72-65fd-4691-940b-d7abe3ff645a -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a.69d26456-0ff0-4ecf-91d6-37f639773baa" returned: 0 in 0.335s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:57 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-4904a223-e7c2-405b-a90c-1a59adba1c30 tempest-VolumesExtendTest-696145693 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a.69d26456-0ff0-4ecf-91d6-37f639773baa is being set with open permissions: ugo+rw
Nov 06 11:57:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4904a223-e7c2-405b-a90c-1a59adba1c30 tempest-VolumesExtendTest-696145693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a.69d26456-0ff0-4ecf-91d6-37f639773baa {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:57 devstack sudo[104329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a.69d26456-0ff0-4ecf-91d6-37f639773baa
Nov 06 11:57:57 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-abf72556-fbab-48eb-8b07-d0f22ced49cd tempest-ProjectReaderTests-810269047 None] Lock "cinder-quobyte-54e61954-198d-469c-bdd8-4027c3442e08" acquired by "delete_volume" :: waited 0.030s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:57:57 devstack sudo[104329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:57 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[441fd8b9-5c68-44a0-a38e-62509347b50d]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:57:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-abf72556-fbab-48eb-8b07-d0f22ced49cd tempest-ProjectReaderTests-810269047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-54e61954-198d-469c-bdd8-4027c3442e08 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:58 devstack sudo[104324]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0898ae97-f9f6-4b59-a144-502ed9cbaec3 tempest-SnapshotDependencyTests-640174777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce.fae1835d-760b-4753-a3f9-c0edfab86d94" returned: 0 in 0.272s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:58 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0898ae97-f9f6-4b59-a144-502ed9cbaec3 tempest-SnapshotDependencyTests-640174777 None] Lock "cinder-quobyte-fae1835d-760b-4753-a3f9-c0edfab86d94" released by "_delete_snapshot" :: held 1.717s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:57:58 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0898ae97-f9f6-4b59-a144-502ed9cbaec3 tempest-SnapshotDependencyTests-640174777 None] Lock "cinder-quobyte-96254a87-19ef-4c5d-a921-83035e5d56ce" released by "delete_snapshot" :: held 1.751s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:57:58 devstack sudo[104332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-54e61954-198d-469c-bdd8-4027c3442e08
Nov 06 11:57:58 devstack sudo[104332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:58 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-0898ae97-f9f6-4b59-a144-502ed9cbaec3 tempest-SnapshotDependencyTests-640174777 None] Created reservations ['7b93601d-d2a9-46e1-b040-1990ed9261b4', '47e398d2-e6c6-4488-abc1-49ea128a9c3c', 'f5921844-c12c-43ce-8c33-cef5b5aa847d', 'e091834f-da97-40b1-a4a6-4807d97a780c'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:57:58 devstack sudo[104329]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4904a223-e7c2-405b-a90c-1a59adba1c30 tempest-VolumesExtendTest-696145693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a.69d26456-0ff0-4ecf-91d6-37f639773baa" returned: 0 in 0.279s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:58 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-0898ae97-f9f6-4b59-a144-502ed9cbaec3 tempest-SnapshotDependencyTests-640174777 None] Delete snapshot completed successfully.
Nov 06 11:57:58 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0898ae97-f9f6-4b59-a144-502ed9cbaec3 tempest-SnapshotDependencyTests-640174777 None] Lock "cinder-fae1835d-760b-4753-a3f9-c0edfab86d94-delete_snapshot" released by "delete_snapshot" :: held 1.968s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:57:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4904a223-e7c2-405b-a90c-1a59adba1c30 tempest-VolumesExtendTest-696145693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:58 devstack sudo[104336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a.info
Nov 06 11:57:58 devstack sudo[104336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:58 devstack sudo[104332]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-abf72556-fbab-48eb-8b07-d0f22ced49cd tempest-ProjectReaderTests-810269047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-54e61954-198d-469c-bdd8-4027c3442e08" returned: 0 in 0.449s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-abf72556-fbab-48eb-8b07-d0f22ced49cd tempest-ProjectReaderTests-810269047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-54e61954-198d-469c-bdd8-4027c3442e08 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:58 devstack sudo[104341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-54e61954-198d-469c-bdd8-4027c3442e08
Nov 06 11:57:58 devstack sudo[104341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:58 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-10f7ef7a-5204-47b2-b9f1-a274225befc6 tempest-SnapshotDependencyTests-640174777 None] Acquiring lock "cinder-96254a87-19ef-4c5d-a921-83035e5d56ce-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:57:58 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-10f7ef7a-5204-47b2-b9f1-a274225befc6 tempest-SnapshotDependencyTests-640174777 None] Lock "cinder-96254a87-19ef-4c5d-a921-83035e5d56ce-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:57:58 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-10f7ef7a-5204-47b2-b9f1-a274225befc6 tempest-SnapshotDependencyTests-640174777 None] Acquiring lock "cinder-quobyte-96254a87-19ef-4c5d-a921-83035e5d56ce" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:57:58 devstack sudo[104336]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4904a223-e7c2-405b-a90c-1a59adba1c30 tempest-VolumesExtendTest-696145693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a.info" returned: 0 in 0.338s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:58 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-4904a223-e7c2-405b-a90c-1a59adba1c30 tempest-VolumesExtendTest-696145693 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a.info is being set with open permissions: ugo+rw
Nov 06 11:57:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4904a223-e7c2-405b-a90c-1a59adba1c30 tempest-VolumesExtendTest-696145693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:58 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-10f7ef7a-5204-47b2-b9f1-a274225befc6 tempest-SnapshotDependencyTests-640174777 None] Lock "cinder-quobyte-96254a87-19ef-4c5d-a921-83035e5d56ce" acquired by "delete_volume" :: waited 0.031s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:57:58 devstack sudo[104344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a.info
Nov 06 11:57:58 devstack sudo[104344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:58 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6258700c-fe8d-4ebb-baf3-87b8370fb7d3]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:57:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-10f7ef7a-5204-47b2-b9f1-a274225befc6 tempest-SnapshotDependencyTests-640174777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:58 devstack sudo[104341]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-abf72556-fbab-48eb-8b07-d0f22ced49cd tempest-ProjectReaderTests-810269047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-54e61954-198d-469c-bdd8-4027c3442e08" returned: 0 in 0.319s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:58 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-abf72556-fbab-48eb-8b07-d0f22ced49cd tempest-ProjectReaderTests-810269047 None] Lock "cinder-quobyte-54e61954-198d-469c-bdd8-4027c3442e08" released by "delete_volume" :: held 0.812s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:57:58 devstack sudo[104346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce
Nov 06 11:57:58 devstack sudo[104346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:58 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-abf72556-fbab-48eb-8b07-d0f22ced49cd tempest-ProjectReaderTests-810269047 None] Created reservations ['6e42d8dc-7390-4262-9037-648db76bc7ff', '1c206550-90ee-4246-b3d9-5175efd6db39', '8d443b18-740d-4cf4-9f53-6c5b789a07ee', '25015436-1f0d-44c3-9cfd-8bd127e837c6'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:57:58 devstack sudo[104344]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-abf72556-fbab-48eb-8b07-d0f22ced49cd tempest-ProjectReaderTests-810269047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-abf72556-fbab-48eb-8b07-d0f22ced49cd tempest-ProjectReaderTests-810269047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:58 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-abf72556-fbab-48eb-8b07-d0f22ced49cd tempest-ProjectReaderTests-810269047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:57:58 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-abf72556-fbab-48eb-8b07-d0f22ced49cd tempest-ProjectReaderTests-810269047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:57:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-abf72556-fbab-48eb-8b07-d0f22ced49cd tempest-ProjectReaderTests-810269047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-abf72556-fbab-48eb-8b07-d0f22ced49cd tempest-ProjectReaderTests-810269047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4904a223-e7c2-405b-a90c-1a59adba1c30 tempest-VolumesExtendTest-696145693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a.info" returned: 0 in 0.298s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:58 devstack sudo[104350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:57:58 devstack sudo[104350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4904a223-e7c2-405b-a90c-1a59adba1c30 tempest-VolumesExtendTest-696145693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.214s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:58 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-4904a223-e7c2-405b-a90c-1a59adba1c30 tempest-VolumesExtendTest-696145693 None] Create snapshot completed successfully
Nov 06 11:57:59 devstack sudo[104346]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-10f7ef7a-5204-47b2-b9f1-a274225befc6 tempest-SnapshotDependencyTests-640174777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce" returned: 0 in 0.447s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-10f7ef7a-5204-47b2-b9f1-a274225befc6 tempest-SnapshotDependencyTests-640174777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:59 devstack sudo[104355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce
Nov 06 11:57:59 devstack sudo[104355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:59 devstack sudo[104350]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-abf72556-fbab-48eb-8b07-d0f22ced49cd tempest-ProjectReaderTests-810269047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.287s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:59 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-abf72556-fbab-48eb-8b07-d0f22ced49cd tempest-ProjectReaderTests-810269047 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:57:59 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-abf72556-fbab-48eb-8b07-d0f22ced49cd tempest-ProjectReaderTests-810269047 None] Deleted volume successfully.
Nov 06 11:57:59 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-abf72556-fbab-48eb-8b07-d0f22ced49cd tempest-ProjectReaderTests-810269047 None] Lock "cinder-54e61954-198d-469c-bdd8-4027c3442e08-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:57:59 devstack sudo[104355]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-10f7ef7a-5204-47b2-b9f1-a274225befc6 tempest-SnapshotDependencyTests-640174777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-96254a87-19ef-4c5d-a921-83035e5d56ce" returned: 0 in 0.275s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:59 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-10f7ef7a-5204-47b2-b9f1-a274225befc6 tempest-SnapshotDependencyTests-640174777 None] Lock "cinder-quobyte-96254a87-19ef-4c5d-a921-83035e5d56ce" released by "delete_volume" :: held 0.807s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:57:59 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-10f7ef7a-5204-47b2-b9f1-a274225befc6 tempest-SnapshotDependencyTests-640174777 None] Created reservations ['c81f899b-0d26-49e8-9fb3-f6e96adfd4a1', 'd26a4a8f-d741-4896-9f8a-817f6782c9da', '3395fe3b-d906-4c0a-bfc7-045153fa1e1f', 'b4b6c664-6177-40c7-b2f3-604ff69ff6af'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:57:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-10f7ef7a-5204-47b2-b9f1-a274225befc6 tempest-SnapshotDependencyTests-640174777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-10f7ef7a-5204-47b2-b9f1-a274225befc6 tempest-SnapshotDependencyTests-640174777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:59 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-10f7ef7a-5204-47b2-b9f1-a274225befc6 tempest-SnapshotDependencyTests-640174777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:57:59 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-10f7ef7a-5204-47b2-b9f1-a274225befc6 tempest-SnapshotDependencyTests-640174777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:57:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-10f7ef7a-5204-47b2-b9f1-a274225befc6 tempest-SnapshotDependencyTests-640174777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:57:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-10f7ef7a-5204-47b2-b9f1-a274225befc6 tempest-SnapshotDependencyTests-640174777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:59 devstack sudo[104359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:57:59 devstack sudo[104359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a457328f-0904-4e18-9cb8-36528309c740 tempest-VolumesExtendTest-696145693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a457328f-0904-4e18-9cb8-36528309c740 tempest-VolumesExtendTest-696145693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:57:59 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a421d66-9d14-40e4-9aba-eb30acf93ebf tempest-ProjectReaderTests-810269047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:57:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5a421d66-9d14-40e4-9aba-eb30acf93ebf tempest-ProjectReaderTests-810269047 None] Flow 'volume_create_manager' (9b1f69bc-9d09-4f52-bd71-8bac707c0df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:57:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5a421d66-9d14-40e4-9aba-eb30acf93ebf tempest-ProjectReaderTests-810269047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (def17d49-b8d0-4650-9ab3-3037c7ce72ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:59 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c186fad-c12f-4e0e-8d19-8d2ff90af867]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:57:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a457328f-0904-4e18-9cb8-36528309c740 tempest-VolumesExtendTest-696145693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5a421d66-9d14-40e4-9aba-eb30acf93ebf tempest-ProjectReaderTests-810269047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (def17d49-b8d0-4650-9ab3-3037c7ce72ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:57:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1493275226',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04ecfffc-2a0d-489e-9230-15eaebca5af5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca0c313b43344408a79c02b025b7700f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:58:00Z,use_quota=True,user_id='8919b4ff5895438a8ded389048c5e286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5a421d66-9d14-40e4-9aba-eb30acf93ebf tempest-ProjectReaderTests-810269047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (074a0b61-f1f2-4bc5-87fc-f4f9ed94d6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5a421d66-9d14-40e4-9aba-eb30acf93ebf tempest-ProjectReaderTests-810269047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (074a0b61-f1f2-4bc5-87fc-f4f9ed94d6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5a421d66-9d14-40e4-9aba-eb30acf93ebf tempest-ProjectReaderTests-810269047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3059f55a-a3b9-4c81-9fc0-526c60280d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5a421d66-9d14-40e4-9aba-eb30acf93ebf tempest-ProjectReaderTests-810269047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3059f55a-a3b9-4c81-9fc0-526c60280d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04ecfffc-2a0d-489e-9230-15eaebca5af5', 'volume_name': 'volume-04ecfffc-2a0d-489e-9230-15eaebca5af5', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5a421d66-9d14-40e4-9aba-eb30acf93ebf tempest-ProjectReaderTests-810269047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a12e186d-bf1e-42d4-b9cd-d71766d1a25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5a421d66-9d14-40e4-9aba-eb30acf93ebf tempest-ProjectReaderTests-810269047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a12e186d-bf1e-42d4-b9cd-d71766d1a25b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:57:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5a421d66-9d14-40e4-9aba-eb30acf93ebf tempest-ProjectReaderTests-810269047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9f30bcd-bab3-446d-8cce-f94347f22ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:57:59 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-5a421d66-9d14-40e4-9aba-eb30acf93ebf tempest-ProjectReaderTests-810269047 None] Volume 04ecfffc-2a0d-489e-9230-15eaebca5af5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04ecfffc-2a0d-489e-9230-15eaebca5af5', 'volume_size': 1}
Nov 06 11:57:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5a421d66-9d14-40e4-9aba-eb30acf93ebf tempest-ProjectReaderTests-810269047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:57:59 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d8787eb9-4fc9-4f57-9d1f-619d2e28d515 tempest-SnapshotDependencyTests-640174777 None] Acquiring lock "cinder-d95cfd29-9c7c-43b1-9640-3027e68da945-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:57:59 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d8787eb9-4fc9-4f57-9d1f-619d2e28d515 tempest-SnapshotDependencyTests-640174777 None] Lock "cinder-d95cfd29-9c7c-43b1-9640-3027e68da945-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:57:59 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d8787eb9-4fc9-4f57-9d1f-619d2e28d515 tempest-SnapshotDependencyTests-640174777 None] Acquiring lock "cinder-quobyte-d95cfd29-9c7c-43b1-9640-3027e68da945" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:57:59 devstack sudo[104361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a
Nov 06 11:57:59 devstack sudo[104361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:57:59 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d8787eb9-4fc9-4f57-9d1f-619d2e28d515 tempest-SnapshotDependencyTests-640174777 None] Lock "cinder-quobyte-d95cfd29-9c7c-43b1-9640-3027e68da945" acquired by "delete_volume" :: waited 0.020s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:57:59 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5740f79d-b4b4-438e-9574-ca0820c6b4ad]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:57:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d8787eb9-4fc9-4f57-9d1f-619d2e28d515 tempest-SnapshotDependencyTests-640174777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d95cfd29-9c7c-43b1-9640-3027e68da945 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:57:59 devstack sudo[104359]: pam_unix(sudo:session): session closed for user root
Nov 06 11:57:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-10f7ef7a-5204-47b2-b9f1-a274225befc6 tempest-SnapshotDependencyTests-640174777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.321s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:57:59 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-10f7ef7a-5204-47b2-b9f1-a274225befc6 tempest-SnapshotDependencyTests-640174777 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:57:59 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-10f7ef7a-5204-47b2-b9f1-a274225befc6 tempest-SnapshotDependencyTests-640174777 None] Deleted volume successfully.
Nov 06 11:57:59 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-10f7ef7a-5204-47b2-b9f1-a274225befc6 tempest-SnapshotDependencyTests-640174777 None] Lock "cinder-96254a87-19ef-4c5d-a921-83035e5d56ce-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:58:00 devstack sudo[104364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d95cfd29-9c7c-43b1-9640-3027e68da945
Nov 06 11:58:00 devstack sudo[104364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:58:00 devstack sudo[104361]: pam_unix(sudo:session): session closed for user root
Nov 06 11:58:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a457328f-0904-4e18-9cb8-36528309c740 tempest-VolumesExtendTest-696145693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a" returned: 0 in 0.444s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:58:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a457328f-0904-4e18-9cb8-36528309c740 tempest-VolumesExtendTest-696145693 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a.69d26456-0ff0-4ecf-91d6-37f639773baa 2G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:58:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a457328f-0904-4e18-9cb8-36528309c740 tempest-VolumesExtendTest-696145693 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a.69d26456-0ff0-4ecf-91d6-37f639773baa 2G" returned: 0 in 0.119s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:58:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a457328f-0904-4e18-9cb8-36528309c740 tempest-VolumesExtendTest-696145693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.630s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:58:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5a421d66-9d14-40e4-9aba-eb30acf93ebf tempest-ProjectReaderTests-810269047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.516s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:58:00 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5a421d66-9d14-40e4-9aba-eb30acf93ebf tempest-ProjectReaderTests-810269047 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:57:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1493275226',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04ecfffc-2a0d-489e-9230-15eaebca5af5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca0c313b43344408a79c02b025b7700f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:58:00Z,use_quota=True,user_id='8919b4ff5895438a8ded389048c5e286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:58:00 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-5a421d66-9d14-40e4-9aba-eb30acf93ebf tempest-ProjectReaderTests-810269047 None] Creating volume 04ecfffc-2a0d-489e-9230-15eaebca5af5 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:58:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5a421d66-9d14-40e4-9aba-eb30acf93ebf tempest-ProjectReaderTests-810269047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:58:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5a421d66-9d14-40e4-9aba-eb30acf93ebf tempest-ProjectReaderTests-810269047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:58:00 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5a421d66-9d14-40e4-9aba-eb30acf93ebf tempest-ProjectReaderTests-810269047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:58:00 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5a421d66-9d14-40e4-9aba-eb30acf93ebf tempest-ProjectReaderTests-810269047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:58:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5a421d66-9d14-40e4-9aba-eb30acf93ebf tempest-ProjectReaderTests-810269047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:58:00 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5a421d66-9d14-40e4-9aba-eb30acf93ebf tempest-ProjectReaderTests-810269047 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:58:00 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-5a421d66-9d14-40e4-9aba-eb30acf93ebf tempest-ProjectReaderTests-810269047 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:58:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5a421d66-9d14-40e4-9aba-eb30acf93ebf tempest-ProjectReaderTests-810269047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-04ecfffc-2a0d-489e-9230-15eaebca5af5 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:58:00 devstack sudo[104364]: pam_unix(sudo:session): session closed for user root
Nov 06 11:58:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d8787eb9-4fc9-4f57-9d1f-619d2e28d515 tempest-SnapshotDependencyTests-640174777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d95cfd29-9c7c-43b1-9640-3027e68da945" returned: 0 in 0.416s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:58:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d8787eb9-4fc9-4f57-9d1f-619d2e28d515 tempest-SnapshotDependencyTests-640174777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d95cfd29-9c7c-43b1-9640-3027e68da945 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:58:00 devstack sudo[104376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-04ecfffc-2a0d-489e-9230-15eaebca5af5 1073741824
Nov 06 11:58:00 devstack sudo[104376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:58:00 devstack sudo[104378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d95cfd29-9c7c-43b1-9640-3027e68da945
Nov 06 11:58:00 devstack sudo[104378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:58:00 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-a457328f-0904-4e18-9cb8-36528309c740 tempest-VolumesExtendTest-696145693 None] Extend volume completed successfully.
Nov 06 11:58:00 devstack sudo[104378]: pam_unix(sudo:session): session closed for user root
Nov 06 11:58:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d8787eb9-4fc9-4f57-9d1f-619d2e28d515 tempest-SnapshotDependencyTests-640174777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d95cfd29-9c7c-43b1-9640-3027e68da945" returned: 0 in 0.270s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:58:00 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d8787eb9-4fc9-4f57-9d1f-619d2e28d515 tempest-SnapshotDependencyTests-640174777 None] Lock "cinder-quobyte-d95cfd29-9c7c-43b1-9640-3027e68da945" released by "delete_volume" :: held 0.743s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:58:00 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-d8787eb9-4fc9-4f57-9d1f-619d2e28d515 tempest-SnapshotDependencyTests-640174777 None] Created reservations ['386fb01b-829c-4878-8c19-788264628445', '3ca97c9c-bfaf-47b0-8a2e-10b7afc2e3fa', 'dc00b140-ebb8-4fbd-842d-381bc395eff2', '19e7a277-a32b-43de-9bab-79ae0f12e8fb'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:58:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d8787eb9-4fc9-4f57-9d1f-619d2e28d515 tempest-SnapshotDependencyTests-640174777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:58:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d8787eb9-4fc9-4f57-9d1f-619d2e28d515 tempest-SnapshotDependencyTests-640174777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:58:00 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-d8787eb9-4fc9-4f57-9d1f-619d2e28d515 tempest-SnapshotDependencyTests-640174777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:58:00 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-d8787eb9-4fc9-4f57-9d1f-619d2e28d515 tempest-SnapshotDependencyTests-640174777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:58:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d8787eb9-4fc9-4f57-9d1f-619d2e28d515 tempest-SnapshotDependencyTests-640174777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:58:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d8787eb9-4fc9-4f57-9d1f-619d2e28d515 tempest-SnapshotDependencyTests-640174777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:58:00 devstack sudo[104376]: pam_unix(sudo:session): session closed for user root
Nov 06 11:58:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5a421d66-9d14-40e4-9aba-eb30acf93ebf tempest-ProjectReaderTests-810269047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-04ecfffc-2a0d-489e-9230-15eaebca5af5 1073741824" returned: 0 in 0.459s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:58:00 devstack sudo[104385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:58:00 devstack sudo[104385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:58:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5a421d66-9d14-40e4-9aba-eb30acf93ebf tempest-ProjectReaderTests-810269047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-04ecfffc-2a0d-489e-9230-15eaebca5af5 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:58:00 devstack sudo[104387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-04ecfffc-2a0d-489e-9230-15eaebca5af5
Nov 06 11:58:00 devstack sudo[104387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:58:00 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0d0fe816-167c-4111-891d-ec06ec2301d3 tempest-VolumesExtendTest-696145693 None] Acquiring lock "cinder-69d26456-0ff0-4ecf-91d6-37f639773baa-delete_snapshot" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:58:00 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0d0fe816-167c-4111-891d-ec06ec2301d3 tempest-VolumesExtendTest-696145693 None] Lock "cinder-69d26456-0ff0-4ecf-91d6-37f639773baa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:58:00 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0d0fe816-167c-4111-891d-ec06ec2301d3 tempest-VolumesExtendTest-696145693 None] Acquiring lock "cinder-quobyte-acfbac72-65fd-4691-940b-d7abe3ff645a" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:58:00 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0d0fe816-167c-4111-891d-ec06ec2301d3 tempest-VolumesExtendTest-696145693 None] Lock "cinder-quobyte-acfbac72-65fd-4691-940b-d7abe3ff645a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:58:00 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0d0fe816-167c-4111-891d-ec06ec2301d3 tempest-VolumesExtendTest-696145693 None] Acquiring lock "cinder-quobyte-69d26456-0ff0-4ecf-91d6-37f639773baa" by "_delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:58:00 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0d0fe816-167c-4111-891d-ec06ec2301d3 tempest-VolumesExtendTest-696145693 None] Lock "cinder-quobyte-69d26456-0ff0-4ecf-91d6-37f639773baa" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:58:00 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-0d0fe816-167c-4111-891d-ec06ec2301d3 tempest-VolumesExtendTest-696145693 None] Deleting offline snapshot 69d26456-0ff0-4ecf-91d6-37f639773baa of volume acfbac72-65fd-4691-940b-d7abe3ff645a {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 11:58:01 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-0d0fe816-167c-4111-891d-ec06ec2301d3 tempest-VolumesExtendTest-696145693 None] snapshot_file for this snap is: volume-acfbac72-65fd-4691-940b-d7abe3ff645a.69d26456-0ff0-4ecf-91d6-37f639773baa {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 11:58:01 devstack sudo[104385]: pam_unix(sudo:session): session closed for user root
Nov 06 11:58:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d8787eb9-4fc9-4f57-9d1f-619d2e28d515 tempest-SnapshotDependencyTests-640174777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.324s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:58:01 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-d8787eb9-4fc9-4f57-9d1f-619d2e28d515 tempest-SnapshotDependencyTests-640174777 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:58:01 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1bc1a5-1b22-4cd0-b780-f979c24db502]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:58:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0d0fe816-167c-4111-891d-ec06ec2301d3 tempest-VolumesExtendTest-696145693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a.69d26456-0ff0-4ecf-91d6-37f639773baa {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:58:01 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-d8787eb9-4fc9-4f57-9d1f-619d2e28d515 tempest-SnapshotDependencyTests-640174777 None] Deleted volume successfully.
Nov 06 11:58:01 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d8787eb9-4fc9-4f57-9d1f-619d2e28d515 tempest-SnapshotDependencyTests-640174777 None] Lock "cinder-d95cfd29-9c7c-43b1-9640-3027e68da945-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:58:01 devstack sudo[104387]: pam_unix(sudo:session): session closed for user root
Nov 06 11:58:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5a421d66-9d14-40e4-9aba-eb30acf93ebf tempest-ProjectReaderTests-810269047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-04ecfffc-2a0d-489e-9230-15eaebca5af5" returned: 0 in 0.336s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:58:01 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5a421d66-9d14-40e4-9aba-eb30acf93ebf tempest-ProjectReaderTests-810269047 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:58:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5a421d66-9d14-40e4-9aba-eb30acf93ebf tempest-ProjectReaderTests-810269047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:58:01 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5a421d66-9d14-40e4-9aba-eb30acf93ebf tempest-ProjectReaderTests-810269047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9f30bcd-bab3-446d-8cce-f94347f22ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04ecfffc-2a0d-489e-9230-15eaebca5af5', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:58:01 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5a421d66-9d14-40e4-9aba-eb30acf93ebf tempest-ProjectReaderTests-810269047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (352987c3-a885-4d23-8538-30af2f9c4eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:58:01 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-5a421d66-9d14-40e4-9aba-eb30acf93ebf tempest-ProjectReaderTests-810269047 None] Volume volume-04ecfffc-2a0d-489e-9230-15eaebca5af5 (04ecfffc-2a0d-489e-9230-15eaebca5af5): created successfully
Nov 06 11:58:01 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5a421d66-9d14-40e4-9aba-eb30acf93ebf tempest-ProjectReaderTests-810269047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (352987c3-a885-4d23-8538-30af2f9c4eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:58:01 devstack sudo[104391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a.69d26456-0ff0-4ecf-91d6-37f639773baa
Nov 06 11:58:01 devstack sudo[104391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:58:01 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5a421d66-9d14-40e4-9aba-eb30acf93ebf tempest-ProjectReaderTests-810269047 None] Flow 'volume_create_manager' (9b1f69bc-9d09-4f52-bd71-8bac707c0df6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:58:01 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-5a421d66-9d14-40e4-9aba-eb30acf93ebf tempest-ProjectReaderTests-810269047 None] Created volume successfully.
Nov 06 11:58:01 devstack sudo[104391]: pam_unix(sudo:session): session closed for user root
Nov 06 11:58:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0d0fe816-167c-4111-891d-ec06ec2301d3 tempest-VolumesExtendTest-696145693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a.69d26456-0ff0-4ecf-91d6-37f639773baa" returned: 0 in 0.432s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:58:01 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-0d0fe816-167c-4111-891d-ec06ec2301d3 tempest-VolumesExtendTest-696145693 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-acfbac72-65fd-4691-940b-d7abe3ff645a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 11:58:01 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f1cce7-b1b2-4c63-a6d2-a10b7833dfcd]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:58:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0d0fe816-167c-4111-891d-ec06ec2301d3 tempest-VolumesExtendTest-696145693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:58:01 devstack sudo[104396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a
Nov 06 11:58:01 devstack sudo[104396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:58:01 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-167be34c-df66-41af-977d-0c48ca7b79b4 tempest-ProjectReaderTests-810269047 None] Acquiring lock "cinder-04ecfffc-2a0d-489e-9230-15eaebca5af5-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:58:01 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-167be34c-df66-41af-977d-0c48ca7b79b4 tempest-ProjectReaderTests-810269047 None] Lock "cinder-04ecfffc-2a0d-489e-9230-15eaebca5af5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:58:01 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-167be34c-df66-41af-977d-0c48ca7b79b4 tempest-ProjectReaderTests-810269047 None] Acquiring lock "cinder-quobyte-04ecfffc-2a0d-489e-9230-15eaebca5af5" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:58:01 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-167be34c-df66-41af-977d-0c48ca7b79b4 tempest-ProjectReaderTests-810269047 None] Lock "cinder-quobyte-04ecfffc-2a0d-489e-9230-15eaebca5af5" acquired by "delete_volume" :: waited 0.031s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:58:01 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7415d3-a26a-4539-8e3c-ca5b728df8db]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:58:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-167be34c-df66-41af-977d-0c48ca7b79b4 tempest-ProjectReaderTests-810269047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-04ecfffc-2a0d-489e-9230-15eaebca5af5 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:58:02 devstack sudo[104396]: pam_unix(sudo:session): session closed for user root
Nov 06 11:58:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0d0fe816-167c-4111-891d-ec06ec2301d3 tempest-VolumesExtendTest-696145693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a" returned: 0 in 0.490s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:58:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0d0fe816-167c-4111-891d-ec06ec2301d3 tempest-VolumesExtendTest-696145693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a.69d26456-0ff0-4ecf-91d6-37f639773baa {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:58:02 devstack sudo[104402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a.69d26456-0ff0-4ecf-91d6-37f639773baa
Nov 06 11:58:02 devstack sudo[104402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:58:02 devstack sudo[104401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-04ecfffc-2a0d-489e-9230-15eaebca5af5
Nov 06 11:58:02 devstack sudo[104401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:58:02 devstack sudo[104401]: pam_unix(sudo:session): session closed for user root
Nov 06 11:58:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-167be34c-df66-41af-977d-0c48ca7b79b4 tempest-ProjectReaderTests-810269047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-04ecfffc-2a0d-489e-9230-15eaebca5af5" returned: 0 in 0.386s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:58:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-167be34c-df66-41af-977d-0c48ca7b79b4 tempest-ProjectReaderTests-810269047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-04ecfffc-2a0d-489e-9230-15eaebca5af5 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:58:02 devstack sudo[104412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-04ecfffc-2a0d-489e-9230-15eaebca5af5
Nov 06 11:58:02 devstack sudo[104412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:58:02 devstack sudo[104402]: pam_unix(sudo:session): session closed for user root
Nov 06 11:58:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0d0fe816-167c-4111-891d-ec06ec2301d3 tempest-VolumesExtendTest-696145693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a.69d26456-0ff0-4ecf-91d6-37f639773baa" returned: 0 in 0.436s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:58:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0d0fe816-167c-4111-891d-ec06ec2301d3 tempest-VolumesExtendTest-696145693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a.69d26456-0ff0-4ecf-91d6-37f639773baa {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:58:02 devstack sudo[104414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a.69d26456-0ff0-4ecf-91d6-37f639773baa
Nov 06 11:58:02 devstack sudo[104414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:58:02 devstack sudo[104412]: pam_unix(sudo:session): session closed for user root
Nov 06 11:58:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-167be34c-df66-41af-977d-0c48ca7b79b4 tempest-ProjectReaderTests-810269047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-04ecfffc-2a0d-489e-9230-15eaebca5af5" returned: 0 in 0.265s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:58:02 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-167be34c-df66-41af-977d-0c48ca7b79b4 tempest-ProjectReaderTests-810269047 None] Lock "cinder-quobyte-04ecfffc-2a0d-489e-9230-15eaebca5af5" released by "delete_volume" :: held 0.709s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:58:02 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-167be34c-df66-41af-977d-0c48ca7b79b4 tempest-ProjectReaderTests-810269047 None] Created reservations ['674a74f0-e570-4c81-9d75-b0f94541911a', '7298fcfa-88e8-45bb-bec8-61b9a8326755', '21259661-1ded-4fc8-94ee-03a619e84ef8', '7a768c9f-2eb5-48e9-baf7-d2d3556ae9ed'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:58:02 devstack sudo[104414]: pam_unix(sudo:session): session closed for user root
Nov 06 11:58:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0d0fe816-167c-4111-891d-ec06ec2301d3 tempest-VolumesExtendTest-696145693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a.69d26456-0ff0-4ecf-91d6-37f639773baa" returned: 0 in 0.282s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:58:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-167be34c-df66-41af-977d-0c48ca7b79b4 tempest-ProjectReaderTests-810269047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:58:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-167be34c-df66-41af-977d-0c48ca7b79b4 tempest-ProjectReaderTests-810269047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:58:02 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-167be34c-df66-41af-977d-0c48ca7b79b4 tempest-ProjectReaderTests-810269047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:58:02 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-167be34c-df66-41af-977d-0c48ca7b79b4 tempest-ProjectReaderTests-810269047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:58:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-167be34c-df66-41af-977d-0c48ca7b79b4 tempest-ProjectReaderTests-810269047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:58:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-167be34c-df66-41af-977d-0c48ca7b79b4 tempest-ProjectReaderTests-810269047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:58:02 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0d0fe816-167c-4111-891d-ec06ec2301d3 tempest-VolumesExtendTest-696145693 None] Lock "cinder-quobyte-69d26456-0ff0-4ecf-91d6-37f639773baa" released by "_delete_snapshot" :: held 1.864s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:58:02 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0d0fe816-167c-4111-891d-ec06ec2301d3 tempest-VolumesExtendTest-696145693 None] Lock "cinder-quobyte-acfbac72-65fd-4691-940b-d7abe3ff645a" released by "delete_snapshot" :: held 1.900s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:58:02 devstack sudo[104419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:58:02 devstack sudo[104419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:58:02 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-0d0fe816-167c-4111-891d-ec06ec2301d3 tempest-VolumesExtendTest-696145693 None] Created reservations ['867fd173-361c-4a20-9662-c0ff38b58944', 'd1781a81-4285-4c56-89ea-6e0f5f8b4e58', 'd0b19ae3-1a6b-45c3-b2b4-5d308810c718', '65896da3-0075-4826-8cb5-5bcdf21d18de'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:58:03 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-0d0fe816-167c-4111-891d-ec06ec2301d3 tempest-VolumesExtendTest-696145693 None] Delete snapshot completed successfully.
Nov 06 11:58:03 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0d0fe816-167c-4111-891d-ec06ec2301d3 tempest-VolumesExtendTest-696145693 None] Lock "cinder-69d26456-0ff0-4ecf-91d6-37f639773baa-delete_snapshot" released by "delete_snapshot" :: held 2.092s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:58:03 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-f37ac5b4-2fd3-40bd-a229-10040f71e65a tempest-VolumesExtendTest-696145693 None] Acquiring lock "cinder-acfbac72-65fd-4691-940b-d7abe3ff645a-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:58:03 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-f37ac5b4-2fd3-40bd-a229-10040f71e65a tempest-VolumesExtendTest-696145693 None] Lock "cinder-acfbac72-65fd-4691-940b-d7abe3ff645a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:58:03 devstack sudo[104419]: pam_unix(sudo:session): session closed for user root
Nov 06 11:58:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-167be34c-df66-41af-977d-0c48ca7b79b4 tempest-ProjectReaderTests-810269047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.390s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:58:03 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-167be34c-df66-41af-977d-0c48ca7b79b4 tempest-ProjectReaderTests-810269047 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:58:03 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-167be34c-df66-41af-977d-0c48ca7b79b4 tempest-ProjectReaderTests-810269047 None] Deleted volume successfully.
Nov 06 11:58:03 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-f37ac5b4-2fd3-40bd-a229-10040f71e65a tempest-VolumesExtendTest-696145693 None] Acquiring lock "cinder-quobyte-acfbac72-65fd-4691-940b-d7abe3ff645a" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:58:03 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-167be34c-df66-41af-977d-0c48ca7b79b4 tempest-ProjectReaderTests-810269047 None] Lock "cinder-04ecfffc-2a0d-489e-9230-15eaebca5af5-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:58:03 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-f37ac5b4-2fd3-40bd-a229-10040f71e65a tempest-VolumesExtendTest-696145693 None] Lock "cinder-quobyte-acfbac72-65fd-4691-940b-d7abe3ff645a" acquired by "delete_volume" :: waited 0.021s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:58:03 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc42b20-398f-4f1c-9740-f79e09289bbc]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:58:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f37ac5b4-2fd3-40bd-a229-10040f71e65a tempest-VolumesExtendTest-696145693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:58:03 devstack sudo[104422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a
Nov 06 11:58:03 devstack sudo[104422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:58:03 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-32e7754e-95a7-4c71-a8af-26cd629c3066 tempest-ProjectReaderTests-810269047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:58:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-32e7754e-95a7-4c71-a8af-26cd629c3066 tempest-ProjectReaderTests-810269047 None] Flow 'volume_create_manager' (be8cdedb-f604-45bb-ace0-12dfba077bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:58:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-32e7754e-95a7-4c71-a8af-26cd629c3066 tempest-ProjectReaderTests-810269047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37fd17a9-c5aa-464a-9b27-bf365ef7bffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:58:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-32e7754e-95a7-4c71-a8af-26cd629c3066 tempest-ProjectReaderTests-810269047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37fd17a9-c5aa-464a-9b27-bf365ef7bffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:58:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-852736496',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee8b5a89-c579-41e7-b909-d7e4e3f229f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca0c313b43344408a79c02b025b7700f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:58:04Z,use_quota=True,user_id='8919b4ff5895438a8ded389048c5e286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:58:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-32e7754e-95a7-4c71-a8af-26cd629c3066 tempest-ProjectReaderTests-810269047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad44d4dc-a0ee-4bc6-99ec-6db1d89313b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:58:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-32e7754e-95a7-4c71-a8af-26cd629c3066 tempest-ProjectReaderTests-810269047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad44d4dc-a0ee-4bc6-99ec-6db1d89313b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:58:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-32e7754e-95a7-4c71-a8af-26cd629c3066 tempest-ProjectReaderTests-810269047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ede4e35-9125-43e3-bef3-873a54f7683f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:58:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-32e7754e-95a7-4c71-a8af-26cd629c3066 tempest-ProjectReaderTests-810269047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ede4e35-9125-43e3-bef3-873a54f7683f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee8b5a89-c579-41e7-b909-d7e4e3f229f1', 'volume_name': 'volume-ee8b5a89-c579-41e7-b909-d7e4e3f229f1', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:58:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-32e7754e-95a7-4c71-a8af-26cd629c3066 tempest-ProjectReaderTests-810269047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37218ac9-15a3-4ad9-8fea-a657dc1259fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:58:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-32e7754e-95a7-4c71-a8af-26cd629c3066 tempest-ProjectReaderTests-810269047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37218ac9-15a3-4ad9-8fea-a657dc1259fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:58:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-32e7754e-95a7-4c71-a8af-26cd629c3066 tempest-ProjectReaderTests-810269047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d49c02a-3327-4f91-a0df-8601f4680dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:58:03 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-32e7754e-95a7-4c71-a8af-26cd629c3066 tempest-ProjectReaderTests-810269047 None] Volume ee8b5a89-c579-41e7-b909-d7e4e3f229f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee8b5a89-c579-41e7-b909-d7e4e3f229f1', 'volume_size': 1}
Nov 06 11:58:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-32e7754e-95a7-4c71-a8af-26cd629c3066 tempest-ProjectReaderTests-810269047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:58:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-32e7754e-95a7-4c71-a8af-26cd629c3066 tempest-ProjectReaderTests-810269047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:58:03 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-32e7754e-95a7-4c71-a8af-26cd629c3066 tempest-ProjectReaderTests-810269047 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:58:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-852736496',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee8b5a89-c579-41e7-b909-d7e4e3f229f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca0c313b43344408a79c02b025b7700f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:58:04Z,use_quota=True,user_id='8919b4ff5895438a8ded389048c5e286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:58:03 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-32e7754e-95a7-4c71-a8af-26cd629c3066 tempest-ProjectReaderTests-810269047 None] Creating volume ee8b5a89-c579-41e7-b909-d7e4e3f229f1 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:58:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-32e7754e-95a7-4c71-a8af-26cd629c3066 tempest-ProjectReaderTests-810269047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:58:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-32e7754e-95a7-4c71-a8af-26cd629c3066 tempest-ProjectReaderTests-810269047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:58:03 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-32e7754e-95a7-4c71-a8af-26cd629c3066 tempest-ProjectReaderTests-810269047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:58:03 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-32e7754e-95a7-4c71-a8af-26cd629c3066 tempest-ProjectReaderTests-810269047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:58:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-32e7754e-95a7-4c71-a8af-26cd629c3066 tempest-ProjectReaderTests-810269047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:58:03 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-32e7754e-95a7-4c71-a8af-26cd629c3066 tempest-ProjectReaderTests-810269047 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:58:03 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-32e7754e-95a7-4c71-a8af-26cd629c3066 tempest-ProjectReaderTests-810269047 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:58:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-32e7754e-95a7-4c71-a8af-26cd629c3066 tempest-ProjectReaderTests-810269047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ee8b5a89-c579-41e7-b909-d7e4e3f229f1 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:58:03 devstack sudo[104427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ee8b5a89-c579-41e7-b909-d7e4e3f229f1 1073741824
Nov 06 11:58:03 devstack sudo[104427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:58:03 devstack sudo[104422]: pam_unix(sudo:session): session closed for user root
Nov 06 11:58:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f37ac5b4-2fd3-40bd-a229-10040f71e65a tempest-VolumesExtendTest-696145693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a" returned: 0 in 0.409s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:58:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f37ac5b4-2fd3-40bd-a229-10040f71e65a tempest-VolumesExtendTest-696145693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:58:03 devstack sudo[104429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a
Nov 06 11:58:03 devstack sudo[104429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:58:04 devstack sudo[104429]: pam_unix(sudo:session): session closed for user root
Nov 06 11:58:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f37ac5b4-2fd3-40bd-a229-10040f71e65a tempest-VolumesExtendTest-696145693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-acfbac72-65fd-4691-940b-d7abe3ff645a" returned: 0 in 0.268s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:58:04 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-f37ac5b4-2fd3-40bd-a229-10040f71e65a tempest-VolumesExtendTest-696145693 None] Lock "cinder-quobyte-acfbac72-65fd-4691-940b-d7abe3ff645a" released by "delete_volume" :: held 0.775s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:58:04 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-f37ac5b4-2fd3-40bd-a229-10040f71e65a tempest-VolumesExtendTest-696145693 None] Created reservations ['f91d1886-baa5-4bdf-96ab-2a835e85e275', 'e377ed34-1e9d-4e9a-bd39-6a6a5722f043', '81c9d205-90e7-4253-9a6e-5443b4d16310', 'b89843f4-091c-4e4e-97b2-c9723c8cf3a8'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:58:04 devstack sudo[104427]: pam_unix(sudo:session): session closed for user root
Nov 06 11:58:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-32e7754e-95a7-4c71-a8af-26cd629c3066 tempest-ProjectReaderTests-810269047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ee8b5a89-c579-41e7-b909-d7e4e3f229f1 1073741824" returned: 0 in 0.526s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:58:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f37ac5b4-2fd3-40bd-a229-10040f71e65a tempest-VolumesExtendTest-696145693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:58:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f37ac5b4-2fd3-40bd-a229-10040f71e65a tempest-VolumesExtendTest-696145693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:58:04 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-f37ac5b4-2fd3-40bd-a229-10040f71e65a tempest-VolumesExtendTest-696145693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:58:04 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-f37ac5b4-2fd3-40bd-a229-10040f71e65a tempest-VolumesExtendTest-696145693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:58:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f37ac5b4-2fd3-40bd-a229-10040f71e65a tempest-VolumesExtendTest-696145693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:58:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f37ac5b4-2fd3-40bd-a229-10040f71e65a tempest-VolumesExtendTest-696145693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:58:04 devstack sudo[104436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:58:04 devstack sudo[104436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:58:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-32e7754e-95a7-4c71-a8af-26cd629c3066 tempest-ProjectReaderTests-810269047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ee8b5a89-c579-41e7-b909-d7e4e3f229f1 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:58:04 devstack sudo[104438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ee8b5a89-c579-41e7-b909-d7e4e3f229f1
Nov 06 11:58:04 devstack sudo[104438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:58:04 devstack sudo[104436]: pam_unix(sudo:session): session closed for user root
Nov 06 11:58:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f37ac5b4-2fd3-40bd-a229-10040f71e65a tempest-VolumesExtendTest-696145693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.293s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:58:04 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-f37ac5b4-2fd3-40bd-a229-10040f71e65a tempest-VolumesExtendTest-696145693 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:58:04 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-f37ac5b4-2fd3-40bd-a229-10040f71e65a tempest-VolumesExtendTest-696145693 None] Deleted volume successfully.
Nov 06 11:58:04 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-f37ac5b4-2fd3-40bd-a229-10040f71e65a tempest-VolumesExtendTest-696145693 None] Lock "cinder-acfbac72-65fd-4691-940b-d7abe3ff645a-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:58:04 devstack sudo[104438]: pam_unix(sudo:session): session closed for user root
Nov 06 11:58:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-32e7754e-95a7-4c71-a8af-26cd629c3066 tempest-ProjectReaderTests-810269047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ee8b5a89-c579-41e7-b909-d7e4e3f229f1" returned: 0 in 0.270s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:58:04 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-32e7754e-95a7-4c71-a8af-26cd629c3066 tempest-ProjectReaderTests-810269047 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:58:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-32e7754e-95a7-4c71-a8af-26cd629c3066 tempest-ProjectReaderTests-810269047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:58:04 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-32e7754e-95a7-4c71-a8af-26cd629c3066 tempest-ProjectReaderTests-810269047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d49c02a-3327-4f91-a0df-8601f4680dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee8b5a89-c579-41e7-b909-d7e4e3f229f1', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:58:04 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-32e7754e-95a7-4c71-a8af-26cd629c3066 tempest-ProjectReaderTests-810269047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6976d92-b6e8-434b-88d5-05a97da01658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:58:04 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-32e7754e-95a7-4c71-a8af-26cd629c3066 tempest-ProjectReaderTests-810269047 None] Volume volume-ee8b5a89-c579-41e7-b909-d7e4e3f229f1 (ee8b5a89-c579-41e7-b909-d7e4e3f229f1): created successfully
Nov 06 11:58:04 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-32e7754e-95a7-4c71-a8af-26cd629c3066 tempest-ProjectReaderTests-810269047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6976d92-b6e8-434b-88d5-05a97da01658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:58:04 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-32e7754e-95a7-4c71-a8af-26cd629c3066 tempest-ProjectReaderTests-810269047 None] Flow 'volume_create_manager' (be8cdedb-f604-45bb-ace0-12dfba077bf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:58:04 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-32e7754e-95a7-4c71-a8af-26cd629c3066 tempest-ProjectReaderTests-810269047 None] Created volume successfully.
Nov 06 11:58:05 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e35e7bf4-a224-46d2-bdcf-698c8f6ab954 tempest-ProjectReaderTests-810269047 None] Acquiring lock "cinder-ee8b5a89-c579-41e7-b909-d7e4e3f229f1-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:58:05 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e35e7bf4-a224-46d2-bdcf-698c8f6ab954 tempest-ProjectReaderTests-810269047 None] Lock "cinder-ee8b5a89-c579-41e7-b909-d7e4e3f229f1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:58:05 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e35e7bf4-a224-46d2-bdcf-698c8f6ab954 tempest-ProjectReaderTests-810269047 None] Acquiring lock "cinder-quobyte-ee8b5a89-c579-41e7-b909-d7e4e3f229f1" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:58:05 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e35e7bf4-a224-46d2-bdcf-698c8f6ab954 tempest-ProjectReaderTests-810269047 None] Lock "cinder-quobyte-ee8b5a89-c579-41e7-b909-d7e4e3f229f1" acquired by "delete_volume" :: waited 0.021s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:58:05 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28d06d9-5f2f-40e0-a113-aad67c099f68]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:58:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e35e7bf4-a224-46d2-bdcf-698c8f6ab954 tempest-ProjectReaderTests-810269047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ee8b5a89-c579-41e7-b909-d7e4e3f229f1 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:58:05 devstack sudo[104443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ee8b5a89-c579-41e7-b909-d7e4e3f229f1
Nov 06 11:58:05 devstack sudo[104443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:58:06 devstack sudo[104443]: pam_unix(sudo:session): session closed for user root
Nov 06 11:58:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e35e7bf4-a224-46d2-bdcf-698c8f6ab954 tempest-ProjectReaderTests-810269047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ee8b5a89-c579-41e7-b909-d7e4e3f229f1" returned: 0 in 0.430s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:58:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e35e7bf4-a224-46d2-bdcf-698c8f6ab954 tempest-ProjectReaderTests-810269047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ee8b5a89-c579-41e7-b909-d7e4e3f229f1 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:58:06 devstack sudo[104448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ee8b5a89-c579-41e7-b909-d7e4e3f229f1
Nov 06 11:58:06 devstack sudo[104448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:58:06 devstack sudo[104448]: pam_unix(sudo:session): session closed for user root
Nov 06 11:58:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e35e7bf4-a224-46d2-bdcf-698c8f6ab954 tempest-ProjectReaderTests-810269047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-ee8b5a89-c579-41e7-b909-d7e4e3f229f1" returned: 0 in 0.322s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:58:06 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e35e7bf4-a224-46d2-bdcf-698c8f6ab954 tempest-ProjectReaderTests-810269047 None] Lock "cinder-quobyte-ee8b5a89-c579-41e7-b909-d7e4e3f229f1" released by "delete_volume" :: held 0.805s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:58:06 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-e35e7bf4-a224-46d2-bdcf-698c8f6ab954 tempest-ProjectReaderTests-810269047 None] Created reservations ['d6f2555d-f4ed-4e5a-8c1f-6c3ecd17ff10', '02a3fb4a-6b74-426e-8516-64cf8cab43ae', '047a27f0-c3a1-4908-868a-b937fc64308d', '7afa64de-91a8-48c2-bf7a-24dd4d173226'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:58:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e35e7bf4-a224-46d2-bdcf-698c8f6ab954 tempest-ProjectReaderTests-810269047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:58:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e35e7bf4-a224-46d2-bdcf-698c8f6ab954 tempest-ProjectReaderTests-810269047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:58:06 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-e35e7bf4-a224-46d2-bdcf-698c8f6ab954 tempest-ProjectReaderTests-810269047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:58:06 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-e35e7bf4-a224-46d2-bdcf-698c8f6ab954 tempest-ProjectReaderTests-810269047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:58:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e35e7bf4-a224-46d2-bdcf-698c8f6ab954 tempest-ProjectReaderTests-810269047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:58:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e35e7bf4-a224-46d2-bdcf-698c8f6ab954 tempest-ProjectReaderTests-810269047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:58:06 devstack sudo[104452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:58:06 devstack sudo[104452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:58:07 devstack sudo[104452]: pam_unix(sudo:session): session closed for user root
Nov 06 11:58:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e35e7bf4-a224-46d2-bdcf-698c8f6ab954 tempest-ProjectReaderTests-810269047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.319s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:58:07 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-e35e7bf4-a224-46d2-bdcf-698c8f6ab954 tempest-ProjectReaderTests-810269047 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:58:07 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-e35e7bf4-a224-46d2-bdcf-698c8f6ab954 tempest-ProjectReaderTests-810269047 None] Deleted volume successfully.
Nov 06 11:58:07 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e35e7bf4-a224-46d2-bdcf-698c8f6ab954 tempest-ProjectReaderTests-810269047 None] Lock "cinder-ee8b5a89-c579-41e7-b909-d7e4e3f229f1-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:58:16 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:INSERT=45,cinder:UPDATE=142,cinder:SELECT=112,cinder:DELETE=13 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 11:58:17 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:SELECT=114,cinder:INSERT=44,cinder:UPDATE=155,cinder:DELETE=12 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 11:58:17 devstack cinder-volume[87165]: DEBUG oslo_service.periodic_task [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 11:58:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:58:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:58:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:58:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:58:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:58:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:58:17 devstack sudo[104501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:58:17 devstack sudo[104501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:58:17 devstack sudo[104501]: pam_unix(sudo:session): session closed for user root
Nov 06 11:58:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.290s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:58:17 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:58:17 devstack cinder-volume[87165]: DEBUG oslo_service.periodic_task [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running periodic task VolumeManager._thread_info {{(pid=87165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 11:58:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] thread count: 29 {{(pid=87165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 11:58:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] thread info: [<_MainThread(MainThread, started 127732956901504)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127732842693056)>, <Thread(Thread-3 (stat_writer), started daemon 127732841891136)>, <Thread(Rabbit-heartbeat, started daemon 127732842515648)>, <Thread(Thread-5 (_runner), started daemon 127732840534464)>, <Thread(Thread-7 (_runner), started daemon 127732840636032)>, <Thread(fd_logger, started daemon 127732838664256)>, <Thread(privsep_reader, started daemon 127732838673408)>, <Thread(tpool_thread_0, started daemon 127732829828800)>, <Thread(tpool_thread_1, started daemon 127732821436096)>, <Thread(tpool_thread_2, started daemon 127732813043392)>, <Thread(tpool_thread_3, started daemon 127732804650688)>, <Thread(tpool_thread_4, started daemon 127732796257984)>, <Thread(tpool_thread_5, started daemon 127732787865280)>, <Thread(tpool_thread_6, started daemon 127732779456192)>, <Thread(tpool_thread_7, started daemon 127732771047104)>, <Thread(tpool_thread_8, started daemon 127732762638016)>, <Thread(tpool_thread_9, started daemon 127732754228928)>, <Thread(tpool_thread_10, started daemon 127732745819840)>, <Thread(tpool_thread_11, started daemon 127732737410752)>, <Thread(tpool_thread_12, started daemon 127732729001664)>, <Thread(tpool_thread_13, started daemon 127732720592576)>, <Thread(tpool_thread_14, started daemon 127732712183488)>, <Thread(tpool_thread_15, started daemon 127732703774400)>, <Thread(tpool_thread_16, started daemon 127732695365312)>, <Thread(tpool_thread_17, started daemon 127732686956224)>, <Thread(tpool_thread_18, started daemon 127732678547136)>, <Thread(tpool_thread_19, started daemon 127732670138048)>, <Thread(Rabbit-heartbeat, started daemon 127732832631296)>] {{(pid=87165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 11:58:30 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fc185a4-19f6-4c8e-bb7e-8516677dda8e tempest-TestInstancesWithCinderVolumes-2065292736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5fc185a4-19f6-4c8e-bb7e-8516677dda8e tempest-TestInstancesWithCinderVolumes-2065292736 None] Flow 'volume_create_manager' (ec078352-d435-44f0-b375-c36c39e24c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5fc185a4-19f6-4c8e-bb7e-8516677dda8e tempest-TestInstancesWithCinderVolumes-2065292736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e67870d-4751-4b65-93e5-7c7244a74a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5fc185a4-19f6-4c8e-bb7e-8516677dda8e tempest-TestInstancesWithCinderVolumes-2065292736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e67870d-4751-4b65-93e5-7c7244a74a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-473845060',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=837bbc9c-1639-47a7-a125-8944e246420e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7692f1590214ea4b5bc262d69086e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:58:31Z,use_quota=True,user_id='1f1ed2d17a204e4d8796d34e000065ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(410d60ee-5377-4757-b09a-5d5e385e4196),volume_type_id=410d60ee-5377-4757-b09a-5d5e385e4196)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5fc185a4-19f6-4c8e-bb7e-8516677dda8e tempest-TestInstancesWithCinderVolumes-2065292736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbfd7a6b-72db-436f-97a5-13e22cfffd85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5fc185a4-19f6-4c8e-bb7e-8516677dda8e tempest-TestInstancesWithCinderVolumes-2065292736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbfd7a6b-72db-436f-97a5-13e22cfffd85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5fc185a4-19f6-4c8e-bb7e-8516677dda8e tempest-TestInstancesWithCinderVolumes-2065292736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c99b8ed1-311e-4d5f-b4ca-ccb9c5bf2e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5fc185a4-19f6-4c8e-bb7e-8516677dda8e tempest-TestInstancesWithCinderVolumes-2065292736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c99b8ed1-311e-4d5f-b4ca-ccb9c5bf2e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '837bbc9c-1639-47a7-a125-8944e246420e', 'volume_name': 'volume-837bbc9c-1639-47a7-a125-8944e246420e', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5fc185a4-19f6-4c8e-bb7e-8516677dda8e tempest-TestInstancesWithCinderVolumes-2065292736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1560bea-cc58-483e-91df-9615e5548d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5fc185a4-19f6-4c8e-bb7e-8516677dda8e tempest-TestInstancesWithCinderVolumes-2065292736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1560bea-cc58-483e-91df-9615e5548d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5fc185a4-19f6-4c8e-bb7e-8516677dda8e tempest-TestInstancesWithCinderVolumes-2065292736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49d64b6a-6895-4c65-aed0-9bb81dcc4d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:58:31 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-5fc185a4-19f6-4c8e-bb7e-8516677dda8e tempest-TestInstancesWithCinderVolumes-2065292736 None] Volume 837bbc9c-1639-47a7-a125-8944e246420e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-837bbc9c-1639-47a7-a125-8944e246420e', 'volume_size': 1}
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5fc185a4-19f6-4c8e-bb7e-8516677dda8e tempest-TestInstancesWithCinderVolumes-2065292736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5fc185a4-19f6-4c8e-bb7e-8516677dda8e tempest-TestInstancesWithCinderVolumes-2065292736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5fc185a4-19f6-4c8e-bb7e-8516677dda8e tempest-TestInstancesWithCinderVolumes-2065292736 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-473845060',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=837bbc9c-1639-47a7-a125-8944e246420e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7692f1590214ea4b5bc262d69086e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:58:31Z,use_quota=True,user_id='1f1ed2d17a204e4d8796d34e000065ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(410d60ee-5377-4757-b09a-5d5e385e4196),volume_type_id=410d60ee-5377-4757-b09a-5d5e385e4196)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-5fc185a4-19f6-4c8e-bb7e-8516677dda8e tempest-TestInstancesWithCinderVolumes-2065292736 None] Creating volume 837bbc9c-1639-47a7-a125-8944e246420e {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5fc185a4-19f6-4c8e-bb7e-8516677dda8e tempest-TestInstancesWithCinderVolumes-2065292736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5fc185a4-19f6-4c8e-bb7e-8516677dda8e tempest-TestInstancesWithCinderVolumes-2065292736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5fc185a4-19f6-4c8e-bb7e-8516677dda8e tempest-TestInstancesWithCinderVolumes-2065292736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5fc185a4-19f6-4c8e-bb7e-8516677dda8e tempest-TestInstancesWithCinderVolumes-2065292736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5fc185a4-19f6-4c8e-bb7e-8516677dda8e tempest-TestInstancesWithCinderVolumes-2065292736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5fc185a4-19f6-4c8e-bb7e-8516677dda8e tempest-TestInstancesWithCinderVolumes-2065292736 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:58:31 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-5fc185a4-19f6-4c8e-bb7e-8516677dda8e tempest-TestInstancesWithCinderVolumes-2065292736 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5fc185a4-19f6-4c8e-bb7e-8516677dda8e tempest-TestInstancesWithCinderVolumes-2065292736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-837bbc9c-1639-47a7-a125-8944e246420e 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:58:31 devstack sudo[104505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-837bbc9c-1639-47a7-a125-8944e246420e 1073741824
Nov 06 11:58:31 devstack sudo[104505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-93d087a8-e427-4be4-8061-fd4099f32c7f tempest-TestInstancesWithCinderVolumes-2065292736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-93d087a8-e427-4be4-8061-fd4099f32c7f tempest-TestInstancesWithCinderVolumes-2065292736 None] Flow 'volume_create_manager' (deb94631-4ac4-41c4-b057-2afeef07b80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-93d087a8-e427-4be4-8061-fd4099f32c7f tempest-TestInstancesWithCinderVolumes-2065292736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ba3257e-edca-48c9-a139-6e75ac3133c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-93d087a8-e427-4be4-8061-fd4099f32c7f tempest-TestInstancesWithCinderVolumes-2065292736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ba3257e-edca-48c9-a139-6e75ac3133c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-596305740',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b54cd6f5-e61c-4f91-843a-05c401a49c67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7692f1590214ea4b5bc262d69086e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:58:31Z,use_quota=True,user_id='1f1ed2d17a204e4d8796d34e000065ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99806055-d224-43b3-9063-a0d36583bc81),volume_type_id=99806055-d224-43b3-9063-a0d36583bc81)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-93d087a8-e427-4be4-8061-fd4099f32c7f tempest-TestInstancesWithCinderVolumes-2065292736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca60a767-fc19-4dce-b31d-44d4b7120f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-93d087a8-e427-4be4-8061-fd4099f32c7f tempest-TestInstancesWithCinderVolumes-2065292736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca60a767-fc19-4dce-b31d-44d4b7120f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-93d087a8-e427-4be4-8061-fd4099f32c7f tempest-TestInstancesWithCinderVolumes-2065292736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f950d48c-4c12-41ac-82ac-655f381c88f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-93d087a8-e427-4be4-8061-fd4099f32c7f tempest-TestInstancesWithCinderVolumes-2065292736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f950d48c-4c12-41ac-82ac-655f381c88f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b54cd6f5-e61c-4f91-843a-05c401a49c67', 'volume_name': 'volume-b54cd6f5-e61c-4f91-843a-05c401a49c67', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-93d087a8-e427-4be4-8061-fd4099f32c7f tempest-TestInstancesWithCinderVolumes-2065292736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9806eadf-390b-4d78-9b33-7575f93134d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-93d087a8-e427-4be4-8061-fd4099f32c7f tempest-TestInstancesWithCinderVolumes-2065292736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9806eadf-390b-4d78-9b33-7575f93134d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-93d087a8-e427-4be4-8061-fd4099f32c7f tempest-TestInstancesWithCinderVolumes-2065292736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc53bc6e-8a9e-4fbf-a1cb-0f8d07edc780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:58:31 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-93d087a8-e427-4be4-8061-fd4099f32c7f tempest-TestInstancesWithCinderVolumes-2065292736 None] Volume b54cd6f5-e61c-4f91-843a-05c401a49c67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b54cd6f5-e61c-4f91-843a-05c401a49c67', 'volume_size': 1}
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-93d087a8-e427-4be4-8061-fd4099f32c7f tempest-TestInstancesWithCinderVolumes-2065292736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:58:31 devstack sudo[104505]: pam_unix(sudo:session): session closed for user root
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5fc185a4-19f6-4c8e-bb7e-8516677dda8e tempest-TestInstancesWithCinderVolumes-2065292736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-837bbc9c-1639-47a7-a125-8944e246420e 1073741824" returned: 0 in 0.483s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5fc185a4-19f6-4c8e-bb7e-8516677dda8e tempest-TestInstancesWithCinderVolumes-2065292736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-837bbc9c-1639-47a7-a125-8944e246420e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:58:31 devstack sudo[104510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-837bbc9c-1639-47a7-a125-8944e246420e
Nov 06 11:58:31 devstack sudo[104510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:58:31 devstack sudo[104510]: pam_unix(sudo:session): session closed for user root
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5fc185a4-19f6-4c8e-bb7e-8516677dda8e tempest-TestInstancesWithCinderVolumes-2065292736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-837bbc9c-1639-47a7-a125-8944e246420e" returned: 0 in 0.266s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5fc185a4-19f6-4c8e-bb7e-8516677dda8e tempest-TestInstancesWithCinderVolumes-2065292736 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5fc185a4-19f6-4c8e-bb7e-8516677dda8e tempest-TestInstancesWithCinderVolumes-2065292736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-93d087a8-e427-4be4-8061-fd4099f32c7f tempest-TestInstancesWithCinderVolumes-2065292736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.425s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-93d087a8-e427-4be4-8061-fd4099f32c7f tempest-TestInstancesWithCinderVolumes-2065292736 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-596305740',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b54cd6f5-e61c-4f91-843a-05c401a49c67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7692f1590214ea4b5bc262d69086e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:58:31Z,use_quota=True,user_id='1f1ed2d17a204e4d8796d34e000065ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99806055-d224-43b3-9063-a0d36583bc81),volume_type_id=99806055-d224-43b3-9063-a0d36583bc81)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-93d087a8-e427-4be4-8061-fd4099f32c7f tempest-TestInstancesWithCinderVolumes-2065292736 None] Creating volume b54cd6f5-e61c-4f91-843a-05c401a49c67 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-93d087a8-e427-4be4-8061-fd4099f32c7f tempest-TestInstancesWithCinderVolumes-2065292736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-93d087a8-e427-4be4-8061-fd4099f32c7f tempest-TestInstancesWithCinderVolumes-2065292736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-93d087a8-e427-4be4-8061-fd4099f32c7f tempest-TestInstancesWithCinderVolumes-2065292736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-93d087a8-e427-4be4-8061-fd4099f32c7f tempest-TestInstancesWithCinderVolumes-2065292736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-93d087a8-e427-4be4-8061-fd4099f32c7f tempest-TestInstancesWithCinderVolumes-2065292736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-93d087a8-e427-4be4-8061-fd4099f32c7f tempest-TestInstancesWithCinderVolumes-2065292736 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:58:31 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-93d087a8-e427-4be4-8061-fd4099f32c7f tempest-TestInstancesWithCinderVolumes-2065292736 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-93d087a8-e427-4be4-8061-fd4099f32c7f tempest-TestInstancesWithCinderVolumes-2065292736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b54cd6f5-e61c-4f91-843a-05c401a49c67 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5fc185a4-19f6-4c8e-bb7e-8516677dda8e tempest-TestInstancesWithCinderVolumes-2065292736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49d64b6a-6895-4c65-aed0-9bb81dcc4d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-837bbc9c-1639-47a7-a125-8944e246420e', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5fc185a4-19f6-4c8e-bb7e-8516677dda8e tempest-TestInstancesWithCinderVolumes-2065292736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b269019-2847-4efd-9fb5-b0336644549b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:58:31 devstack sudo[104513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b54cd6f5-e61c-4f91-843a-05c401a49c67 1073741824
Nov 06 11:58:31 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:58:31 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-5fc185a4-19f6-4c8e-bb7e-8516677dda8e tempest-TestInstancesWithCinderVolumes-2065292736 None] Volume volume-837bbc9c-1639-47a7-a125-8944e246420e (837bbc9c-1639-47a7-a125-8944e246420e): created successfully
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5fc185a4-19f6-4c8e-bb7e-8516677dda8e tempest-TestInstancesWithCinderVolumes-2065292736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b269019-2847-4efd-9fb5-b0336644549b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5fc185a4-19f6-4c8e-bb7e-8516677dda8e tempest-TestInstancesWithCinderVolumes-2065292736 None] Flow 'volume_create_manager' (ec078352-d435-44f0-b375-c36c39e24c27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:58:31 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-5fc185a4-19f6-4c8e-bb7e-8516677dda8e tempest-TestInstancesWithCinderVolumes-2065292736 None] Created volume successfully.
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 11:58:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] Flow 'volume_create_manager' (9f23bba0-de67-4781-b26e-ec709a2c62c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:58:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73f8bc3b-fd0a-4a5c-86ce-ba5896217e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:58:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73f8bc3b-fd0a-4a5c-86ce-ba5896217e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1159787588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0c8a9ba-b3c8-498c-ad36-1fa3d89be915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7692f1590214ea4b5bc262d69086e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:58:32Z,use_quota=True,user_id='1f1ed2d17a204e4d8796d34e000065ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e3cbc94-8e6c-44fd-bc86-5ac875aea82e),volume_type_id=2e3cbc94-8e6c-44fd-bc86-5ac875aea82e)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:58:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (821deb77-eabf-4f6b-8ae8-0eade06c4ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:58:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (821deb77-eabf-4f6b-8ae8-0eade06c4ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:58:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fec718f-fc5b-4eea-a159-276666192c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:58:32 devstack cinder-volume[87165]: DEBUG cinder.image.glance [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] Creating Keystone auth plugin from conf {{(pid=87165) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 06 11:58:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fec718f-fc5b-4eea-a159-276666192c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f0c8a9ba-b3c8-498c-ad36-1fa3d89be915', 'volume_name': 'volume-f0c8a9ba-b3c8-498c-ad36-1fa3d89be915', 'volume_size': 1, 'image_id': '51aaff6b-f494-4ccc-97b7-f5805c8a2a99', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/51aaff6b-f494-4ccc-97b7-f5805c8a2a99', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--885651127', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c7692f1590214ea4b5bc262d69086e9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '51aaff6b-f494-4ccc-97b7-f5805c8a2a99', 'created_at': datetime.datetime(2026, 11, 6, 10, 58, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 10, 58, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/51aaff6b-f494-4ccc-97b7-f5805c8a2a99/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x742c13def380>}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:58:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e03f6c47-9b3d-439d-8087-d92a64cc10c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:58:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e03f6c47-9b3d-439d-8087-d92a64cc10c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:58:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21812869-d4d4-42df-a08c-a8681800d0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:58:32 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] Volume f0c8a9ba-b3c8-498c-ad36-1fa3d89be915: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f0c8a9ba-b3c8-498c-ad36-1fa3d89be915', 'volume_size': 1, 'image_id': '51aaff6b-f494-4ccc-97b7-f5805c8a2a99', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/51aaff6b-f494-4ccc-97b7-f5805c8a2a99', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--885651127', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c7692f1590214ea4b5bc262d69086e9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '51aaff6b-f494-4ccc-97b7-f5805c8a2a99', 'created_at': datetime.datetime(2026, 11, 6, 10, 58, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 10, 58, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/51aaff6b-f494-4ccc-97b7-f5805c8a2a99/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x742c13def380>}
Nov 06 11:58:32 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] Trying to clone f0c8a9ba-b3c8-498c-ad36-1fa3d89be915 from image 51aaff6b-f494-4ccc-97b7-f5805c8a2a99 at location (None, [{'url': 'file:///opt/stack/data/glance/images/51aaff6b-f494-4ccc-97b7-f5805c8a2a99', 'metadata': {}}]). {{(pid=87165) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 06 11:58:32 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root
Nov 06 11:58:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-93d087a8-e427-4be4-8061-fd4099f32c7f tempest-TestInstancesWithCinderVolumes-2065292736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b54cd6f5-e61c-4f91-843a-05c401a49c67 1073741824" returned: 0 in 0.441s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:58:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-93d087a8-e427-4be4-8061-fd4099f32c7f tempest-TestInstancesWithCinderVolumes-2065292736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b54cd6f5-e61c-4f91-843a-05c401a49c67 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:58:32 devstack sudo[104519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b54cd6f5-e61c-4f91-843a-05c401a49c67
Nov 06 11:58:32 devstack sudo[104519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:58:32 devstack sudo[104519]: pam_unix(sudo:session): session closed for user root
Nov 06 11:58:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-93d087a8-e427-4be4-8061-fd4099f32c7f tempest-TestInstancesWithCinderVolumes-2065292736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b54cd6f5-e61c-4f91-843a-05c401a49c67" returned: 0 in 0.261s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:58:32 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-93d087a8-e427-4be4-8061-fd4099f32c7f tempest-TestInstancesWithCinderVolumes-2065292736 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:58:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-93d087a8-e427-4be4-8061-fd4099f32c7f tempest-TestInstancesWithCinderVolumes-2065292736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:58:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-93d087a8-e427-4be4-8061-fd4099f32c7f tempest-TestInstancesWithCinderVolumes-2065292736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc53bc6e-8a9e-4fbf-a1cb-0f8d07edc780) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b54cd6f5-e61c-4f91-843a-05c401a49c67', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:58:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-93d087a8-e427-4be4-8061-fd4099f32c7f tempest-TestInstancesWithCinderVolumes-2065292736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e14881f-6261-441c-9570-49994aebfacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:58:32 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-93d087a8-e427-4be4-8061-fd4099f32c7f tempest-TestInstancesWithCinderVolumes-2065292736 None] Volume volume-b54cd6f5-e61c-4f91-843a-05c401a49c67 (b54cd6f5-e61c-4f91-843a-05c401a49c67): created successfully
Nov 06 11:58:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-93d087a8-e427-4be4-8061-fd4099f32c7f tempest-TestInstancesWithCinderVolumes-2065292736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e14881f-6261-441c-9570-49994aebfacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:58:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-93d087a8-e427-4be4-8061-fd4099f32c7f tempest-TestInstancesWithCinderVolumes-2065292736 None] Flow 'volume_create_manager' (deb94631-4ac4-41c4-b057-2afeef07b80d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:58:32 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-93d087a8-e427-4be4-8061-fd4099f32c7f tempest-TestInstancesWithCinderVolumes-2065292736 None] Created volume successfully.
Nov 06 11:58:35 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_51aaff6b-f494-4ccc-97b7-f5805c8a2a99_c7oxb17kdevstack@QuobyteHD, size 20.69 MB, duration 2.76 sec {{(pid=87165) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 06 11:58:35 devstack cinder-volume[87165]: INFO cinder.image.image_utils [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] Image download 20.69 MB at 7.51 MB/s
Nov 06 11:58:35 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[186b855c-4be6-439f-998a-67b36b272885]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:58:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_51aaff6b-f494-4ccc-97b7-f5805c8a2a99_c7oxb17kdevstack@QuobyteHD {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:58:35 devstack sudo[104523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_51aaff6b-f494-4ccc-97b7-f5805c8a2a99_c7oxb17kdevstack@QuobyteHD
Nov 06 11:58:35 devstack sudo[104523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:58:35 devstack sudo[104523]: pam_unix(sudo:session): session closed for user root
Nov 06 11:58:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_51aaff6b-f494-4ccc-97b7-f5805c8a2a99_c7oxb17kdevstack@QuobyteHD" returned: 0 in 0.323s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:58:35 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] Temporary image 51aaff6b-f494-4ccc-97b7-f5805c8a2a99 is fetched for user 1f1ed2d17a204e4d8796d34e000065ff. {{(pid=87165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 06 11:58:35 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbe1cfc-14bf-4d1e-871b-b1d8b0ff3479]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:58:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_51aaff6b-f494-4ccc-97b7-f5805c8a2a99_c7oxb17kdevstack@QuobyteHD {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:58:35 devstack sudo[104528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_51aaff6b-f494-4ccc-97b7-f5805c8a2a99_c7oxb17kdevstack@QuobyteHD
Nov 06 11:58:35 devstack sudo[104528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:58:35 devstack sudo[104528]: pam_unix(sudo:session): session closed for user root
Nov 06 11:58:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_51aaff6b-f494-4ccc-97b7-f5805c8a2a99_c7oxb17kdevstack@QuobyteHD" returned: 0 in 0.319s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:58:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:58:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:58:35 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T10:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1159787588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0c8a9ba-b3c8-498c-ad36-1fa3d89be915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7692f1590214ea4b5bc262d69086e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:58:32Z,use_quota=True,user_id='1f1ed2d17a204e4d8796d34e000065ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e3cbc94-8e6c-44fd-bc86-5ac875aea82e),volume_type_id=2e3cbc94-8e6c-44fd-bc86-5ac875aea82e)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 11:58:35 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] Creating volume f0c8a9ba-b3c8-498c-ad36-1fa3d89be915 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 11:58:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:58:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:58:35 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:58:35 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:58:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:58:35 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 11:58:35 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 11:58:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f0c8a9ba-b3c8-498c-ad36-1fa3d89be915 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:58:35 devstack sudo[104533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f0c8a9ba-b3c8-498c-ad36-1fa3d89be915 1073741824
Nov 06 11:58:35 devstack sudo[104533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:58:36 devstack sudo[104533]: pam_unix(sudo:session): session closed for user root
Nov 06 11:58:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f0c8a9ba-b3c8-498c-ad36-1fa3d89be915 1073741824" returned: 0 in 0.402s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:58:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f0c8a9ba-b3c8-498c-ad36-1fa3d89be915 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:58:36 devstack sudo[104538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f0c8a9ba-b3c8-498c-ad36-1fa3d89be915
Nov 06 11:58:36 devstack sudo[104538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:58:36 devstack sudo[104538]: pam_unix(sudo:session): session closed for user root
Nov 06 11:58:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f0c8a9ba-b3c8-498c-ad36-1fa3d89be915" returned: 0 in 0.230s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:58:36 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 11:58:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:58:36 devstack cinder-volume[87165]: DEBUG cinder.volume.volume_utils [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] Attempting download of 51aaff6b-f494-4ccc-97b7-f5805c8a2a99 ((None, [{'url': 'file:///opt/stack/data/glance/images/51aaff6b-f494-4ccc-97b7-f5805c8a2a99', 'metadata': {}}])) to volume f0c8a9ba-b3c8-498c-ad36-1fa3d89be915. {{(pid=87165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 06 11:58:36 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c817c9d-92f8-461c-8d56-ac30ac9617e9]: (4, 'raw') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:58:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_51aaff6b-f494-4ccc-97b7-f5805c8a2a99_j5to_447 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:58:36 devstack sudo[104541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_51aaff6b-f494-4ccc-97b7-f5805c8a2a99_j5to_447
Nov 06 11:58:36 devstack sudo[104541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:58:36 devstack sudo[104541]: pam_unix(sudo:session): session closed for user root
Nov 06 11:58:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_51aaff6b-f494-4ccc-97b7-f5805c8a2a99_j5to_447" returned: 0 in 0.311s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:58:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_51aaff6b-f494-4ccc-97b7-f5805c8a2a99_j5to_447 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:58:37 devstack sudo[104545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_51aaff6b-f494-4ccc-97b7-f5805c8a2a99_j5to_447
Nov 06 11:58:37 devstack sudo[104545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:58:37 devstack sudo[104545]: pam_unix(sudo:session): session closed for user root
Nov 06 11:58:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_51aaff6b-f494-4ccc-97b7-f5805c8a2a99_j5to_447" returned: 1 in 0.312s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:58:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_51aaff6b-f494-4ccc-97b7-f5805c8a2a99_j5to_447' failed. Not Retrying. {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 11:58:37 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c002dc-0227-4cc5-96b4-36d789e52960]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:58:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_51aaff6b-f494-4ccc-97b7-f5805c8a2a99_c7oxb17kdevstack@QuobyteHD {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:58:37 devstack sudo[104549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_51aaff6b-f494-4ccc-97b7-f5805c8a2a99_c7oxb17kdevstack@QuobyteHD
Nov 06 11:58:37 devstack sudo[104549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:58:37 devstack sudo[104549]: pam_unix(sudo:session): session closed for user root
Nov 06 11:58:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_51aaff6b-f494-4ccc-97b7-f5805c8a2a99_c7oxb17kdevstack@QuobyteHD" returned: 0 in 0.310s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:58:37 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] 51aaff6b-f494-4ccc-97b7-f5805c8a2a99 was qcow2, converting to qcow2 {{(pid=87165) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 06 11:58:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_51aaff6b-f494-4ccc-97b7-f5805c8a2a99_c7oxb17kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f0c8a9ba-b3c8-498c-ad36-1fa3d89be915 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:58:37 devstack sudo[104554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_51aaff6b-f494-4ccc-97b7-f5805c8a2a99_c7oxb17kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f0c8a9ba-b3c8-498c-ad36-1fa3d89be915
Nov 06 11:58:37 devstack sudo[104554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:58:39 devstack sudo[104554]: pam_unix(sudo:session): session closed for user root
Nov 06 11:58:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_51aaff6b-f494-4ccc-97b7-f5805c8a2a99_c7oxb17kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f0c8a9ba-b3c8-498c-ad36-1fa3d89be915" returned: 0 in 1.729s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:58:39 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_51aaff6b-f494-4ccc-97b7-f5805c8a2a99_c7oxb17kdevstack@QuobyteHD, size 112.00 MB, duration 1.73 sec, destination /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f0c8a9ba-b3c8-498c-ad36-1fa3d89be915 {{(pid=87165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 11:58:39 devstack cinder-volume[87165]: INFO cinder.image.image_utils [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] Converted 112.00 MB image at 64.73 MB/s
Nov 06 11:58:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f0c8a9ba-b3c8-498c-ad36-1fa3d89be915 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:58:39 devstack sudo[104567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f0c8a9ba-b3c8-498c-ad36-1fa3d89be915 1G
Nov 06 11:58:39 devstack sudo[104567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:58:39 devstack sudo[104567]: pam_unix(sudo:session): session closed for user root
Nov 06 11:58:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f0c8a9ba-b3c8-498c-ad36-1fa3d89be915 1G" returned: 0 in 0.309s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:58:39 devstack cinder-volume[87165]: DEBUG cinder.volume.volume_utils [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] Downloaded image 51aaff6b-f494-4ccc-97b7-f5805c8a2a99 ((None, [{'url': 'file:///opt/stack/data/glance/images/51aaff6b-f494-4ccc-97b7-f5805c8a2a99', 'metadata': {}}])) to volume f0c8a9ba-b3c8-498c-ad36-1fa3d89be915 successfully. {{(pid=87165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 06 11:58:39 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] Temporary image 51aaff6b-f494-4ccc-97b7-f5805c8a2a99 for user 1f1ed2d17a204e4d8796d34e000065ff is deleted. {{(pid=87165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 06 11:58:39 devstack cinder-volume[87165]: DEBUG cinder.volume.volume_utils [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] Marking volume f0c8a9ba-b3c8-498c-ad36-1fa3d89be915 as bootable. {{(pid=87165) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 06 11:58:39 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] Copying metadata from image 51aaff6b-f494-4ccc-97b7-f5805c8a2a99 to f0c8a9ba-b3c8-498c-ad36-1fa3d89be915. {{(pid=87165) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 06 11:58:39 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] Creating volume glance metadata for volume f0c8a9ba-b3c8-498c-ad36-1fa3d89be915 backed by image 51aaff6b-f494-4ccc-97b7-f5805c8a2a99 with: {'image_id': '51aaff6b-f494-4ccc-97b7-f5805c8a2a99', 'image_name': 'tempest-scenario-img--885651127', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87165) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 06 11:58:39 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21812869-d4d4-42df-a08c-a8681800d0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0c8a9ba-b3c8-498c-ad36-1fa3d89be915', 'volume_size': 1, 'image_id': '51aaff6b-f494-4ccc-97b7-f5805c8a2a99', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/51aaff6b-f494-4ccc-97b7-f5805c8a2a99', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--885651127', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c7692f1590214ea4b5bc262d69086e9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '51aaff6b-f494-4ccc-97b7-f5805c8a2a99', 'created_at': datetime.datetime(2026, 11, 6, 10, 58, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 10, 58, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/51aaff6b-f494-4ccc-97b7-f5805c8a2a99/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x742c13def380>}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:58:39 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eb75ae7-884c-43f6-b048-73de8274da09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 11:58:39 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] Volume volume-f0c8a9ba-b3c8-498c-ad36-1fa3d89be915 (f0c8a9ba-b3c8-498c-ad36-1fa3d89be915): created successfully
Nov 06 11:58:39 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eb75ae7-884c-43f6-b048-73de8274da09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 11:58:39 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] Flow 'volume_create_manager' (9f23bba0-de67-4781-b26e-ec709a2c62c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 11:58:39 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-a3fdc4dd-f497-41b2-b4bd-415890b70cf3 tempest-TestInstancesWithCinderVolumes-2065292736 None] Created volume successfully.
Nov 06 11:58:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-ae2bd9b1-8683-4672-9aa2-8a239ce55be3 req-57348762-3e64-49e7-baf0-5fdd5a1ffbae tempest-TestInstancesWithCinderVolumes-2065292736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:58:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-ae2bd9b1-8683-4672-9aa2-8a239ce55be3 req-57348762-3e64-49e7-baf0-5fdd5a1ffbae tempest-TestInstancesWithCinderVolumes-2065292736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:58:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-ae2bd9b1-8683-4672-9aa2-8a239ce55be3 req-57348762-3e64-49e7-baf0-5fdd5a1ffbae tempest-TestInstancesWithCinderVolumes-2065292736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:58:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-ae2bd9b1-8683-4672-9aa2-8a239ce55be3 req-57348762-3e64-49e7-baf0-5fdd5a1ffbae tempest-TestInstancesWithCinderVolumes-2065292736 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50', 'name': 'volume-f0c8a9ba-b3c8-498c-ad36-1fa3d89be915', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '42867345-326c-4977-ae8e-b5051ee6420c', 'enforce_multipath': True} {{(pid=87165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 11:58:42 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-ae2bd9b1-8683-4672-9aa2-8a239ce55be3 req-57348762-3e64-49e7-baf0-5fdd5a1ffbae tempest-TestInstancesWithCinderVolumes-2065292736 None] attachment_update completed successfully.
Nov 06 11:58:52 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:SELECT=16,cinder:UPDATE=8,cinder:DELETE=3,cinder:INSERT=6 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 11:58:52 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:UPDATE=16,cinder:SELECT=20,cinder:INSERT=6 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 11:59:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-85a1b434-f091-4a8f-8479-30d0f2b5ffbb req-8955f723-1b55-41fe-8b08-3dead207e73e tempest-TestInstancesWithCinderVolumes-2065292736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:59:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-85a1b434-f091-4a8f-8479-30d0f2b5ffbb req-8955f723-1b55-41fe-8b08-3dead207e73e tempest-TestInstancesWithCinderVolumes-2065292736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:59:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-85a1b434-f091-4a8f-8479-30d0f2b5ffbb req-8955f723-1b55-41fe-8b08-3dead207e73e tempest-TestInstancesWithCinderVolumes-2065292736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:59:14 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-85a1b434-f091-4a8f-8479-30d0f2b5ffbb req-8955f723-1b55-41fe-8b08-3dead207e73e tempest-TestInstancesWithCinderVolumes-2065292736 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50', 'name': 'volume-837bbc9c-1639-47a7-a125-8944e246420e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9a2c8108-2966-4e03-ae40-f32350b6aa1f', 'enforce_multipath': True} {{(pid=87165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 11:59:14 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-85a1b434-f091-4a8f-8479-30d0f2b5ffbb req-8955f723-1b55-41fe-8b08-3dead207e73e tempest-TestInstancesWithCinderVolumes-2065292736 None] attachment_update completed successfully.
Nov 06 11:59:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-1b1d1790-de9c-48b5-8959-1f2c058212fb req-69473884-41e4-4092-9179-9601a20d81b0 tempest-TestInstancesWithCinderVolumes-2065292736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:59:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-1b1d1790-de9c-48b5-8959-1f2c058212fb req-69473884-41e4-4092-9179-9601a20d81b0 tempest-TestInstancesWithCinderVolumes-2065292736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:59:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-1b1d1790-de9c-48b5-8959-1f2c058212fb req-69473884-41e4-4092-9179-9601a20d81b0 tempest-TestInstancesWithCinderVolumes-2065292736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:59:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-1b1d1790-de9c-48b5-8959-1f2c058212fb req-69473884-41e4-4092-9179-9601a20d81b0 tempest-TestInstancesWithCinderVolumes-2065292736 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50', 'name': 'volume-b54cd6f5-e61c-4f91-843a-05c401a49c67', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2740cb71-e706-4020-b273-c63bb2862ad7', 'enforce_multipath': True} {{(pid=87165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 11:59:16 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-1b1d1790-de9c-48b5-8959-1f2c058212fb req-69473884-41e4-4092-9179-9601a20d81b0 tempest-TestInstancesWithCinderVolumes-2065292736 None] attachment_update completed successfully.
Nov 06 11:59:17 devstack cinder-volume[87165]: DEBUG oslo_service.periodic_task [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 11:59:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:59:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:59:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:59:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:59:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:59:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:59:17 devstack sudo[105198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:59:17 devstack sudo[105198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:59:17 devstack sudo[105198]: pam_unix(sudo:session): session closed for user root
Nov 06 11:59:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.239s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:59:17 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:59:17 devstack cinder-volume[87165]: DEBUG oslo_service.periodic_task [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running periodic task VolumeManager._thread_info {{(pid=87165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 11:59:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] thread count: 29 {{(pid=87165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 11:59:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] thread info: [<_MainThread(MainThread, started 127732956901504)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127732842693056)>, <Thread(Thread-3 (stat_writer), started daemon 127732841891136)>, <Thread(Rabbit-heartbeat, started daemon 127732842515648)>, <Thread(Thread-5 (_runner), started daemon 127732840534464)>, <Thread(Thread-7 (_runner), started daemon 127732840636032)>, <Thread(fd_logger, started daemon 127732838664256)>, <Thread(privsep_reader, started daemon 127732838673408)>, <Thread(tpool_thread_0, started daemon 127732829828800)>, <Thread(tpool_thread_1, started daemon 127732821436096)>, <Thread(tpool_thread_2, started daemon 127732813043392)>, <Thread(tpool_thread_3, started daemon 127732804650688)>, <Thread(tpool_thread_4, started daemon 127732796257984)>, <Thread(tpool_thread_5, started daemon 127732787865280)>, <Thread(tpool_thread_6, started daemon 127732779456192)>, <Thread(tpool_thread_7, started daemon 127732771047104)>, <Thread(tpool_thread_8, started daemon 127732762638016)>, <Thread(tpool_thread_9, started daemon 127732754228928)>, <Thread(tpool_thread_10, started daemon 127732745819840)>, <Thread(tpool_thread_11, started daemon 127732737410752)>, <Thread(tpool_thread_12, started daemon 127732729001664)>, <Thread(tpool_thread_13, started daemon 127732720592576)>, <Thread(tpool_thread_14, started daemon 127732712183488)>, <Thread(tpool_thread_15, started daemon 127732703774400)>, <Thread(tpool_thread_16, started daemon 127732695365312)>, <Thread(tpool_thread_17, started daemon 127732686956224)>, <Thread(tpool_thread_18, started daemon 127732678547136)>, <Thread(tpool_thread_19, started daemon 127732670138048)>, <Thread(Rabbit-heartbeat, started daemon 127732832631296)>] {{(pid=87165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 11:59:21 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-7903e586-4d6d-4912-83d9-7fc22a2e6f96 req-b76eaac7-f19c-49cf-89f1-299e3b10cc86 tempest-TestInstancesWithCinderVolumes-2065292736 None] Terminate volume connection completed successfully.
Nov 06 11:59:21 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-7903e586-4d6d-4912-83d9-7fc22a2e6f96 req-b76eaac7-f19c-49cf-89f1-299e3b10cc86 tempest-TestInstancesWithCinderVolumes-2065292736 None] Deleting attachment 9a2c8108-2966-4e03-ae40-f32350b6aa1f. {{(pid=87165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 11:59:22 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-cfe9d476-2d85-47d9-a53e-ae31a31c67fa tempest-TestInstancesWithCinderVolumes-2065292736 None] Acquiring lock "cinder-837bbc9c-1639-47a7-a125-8944e246420e-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:59:22 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-cfe9d476-2d85-47d9-a53e-ae31a31c67fa tempest-TestInstancesWithCinderVolumes-2065292736 None] Lock "cinder-837bbc9c-1639-47a7-a125-8944e246420e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:59:22 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-cfe9d476-2d85-47d9-a53e-ae31a31c67fa tempest-TestInstancesWithCinderVolumes-2065292736 None] Acquiring lock "cinder-quobyte-837bbc9c-1639-47a7-a125-8944e246420e" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:59:22 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-cfe9d476-2d85-47d9-a53e-ae31a31c67fa tempest-TestInstancesWithCinderVolumes-2065292736 None] Lock "cinder-quobyte-837bbc9c-1639-47a7-a125-8944e246420e" acquired by "delete_volume" :: waited 0.017s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:59:22 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[326398fe-8e5c-45bb-b322-e33bd6576ec1]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:59:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cfe9d476-2d85-47d9-a53e-ae31a31c67fa tempest-TestInstancesWithCinderVolumes-2065292736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-837bbc9c-1639-47a7-a125-8944e246420e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:59:22 devstack sudo[105243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-837bbc9c-1639-47a7-a125-8944e246420e
Nov 06 11:59:22 devstack sudo[105243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:59:22 devstack sudo[105243]: pam_unix(sudo:session): session closed for user root
Nov 06 11:59:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cfe9d476-2d85-47d9-a53e-ae31a31c67fa tempest-TestInstancesWithCinderVolumes-2065292736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-837bbc9c-1639-47a7-a125-8944e246420e" returned: 0 in 0.387s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:59:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cfe9d476-2d85-47d9-a53e-ae31a31c67fa tempest-TestInstancesWithCinderVolumes-2065292736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-837bbc9c-1639-47a7-a125-8944e246420e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:59:22 devstack sudo[105248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-837bbc9c-1639-47a7-a125-8944e246420e
Nov 06 11:59:22 devstack sudo[105248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:59:22 devstack sudo[105248]: pam_unix(sudo:session): session closed for user root
Nov 06 11:59:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cfe9d476-2d85-47d9-a53e-ae31a31c67fa tempest-TestInstancesWithCinderVolumes-2065292736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-837bbc9c-1639-47a7-a125-8944e246420e" returned: 0 in 0.305s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:59:22 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-cfe9d476-2d85-47d9-a53e-ae31a31c67fa tempest-TestInstancesWithCinderVolumes-2065292736 None] Lock "cinder-quobyte-837bbc9c-1639-47a7-a125-8944e246420e" released by "delete_volume" :: held 0.745s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:59:22 devstack cinder-volume[87165]: WARNING cinder.quota [None req-cfe9d476-2d85-47d9-a53e-ae31a31c67fa tempest-TestInstancesWithCinderVolumes-2065292736 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1346442411-1804642877 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1346442411-1804642877, it is now deprecated. Please use the default quota class for default quota.
Nov 06 11:59:22 devstack cinder-volume[87165]: WARNING cinder.quota [None req-cfe9d476-2d85-47d9-a53e-ae31a31c67fa tempest-TestInstancesWithCinderVolumes-2065292736 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1346442411-1804642877 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1346442411-1804642877, it is now deprecated. Please use the default quota class for default quota.
Nov 06 11:59:22 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-cfe9d476-2d85-47d9-a53e-ae31a31c67fa tempest-TestInstancesWithCinderVolumes-2065292736 None] Created reservations ['501d81a1-ecaf-4544-baf2-21be33fbc20d', 'a1b591b7-4f3e-4cb8-b3a1-ebf7c025c269', 'b7bf9454-f865-4a54-8ad3-38d8c472f80d', '6dd6ddcb-6354-492d-9610-11db4c4e2909'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:59:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-cfe9d476-2d85-47d9-a53e-ae31a31c67fa tempest-TestInstancesWithCinderVolumes-2065292736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:59:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-cfe9d476-2d85-47d9-a53e-ae31a31c67fa tempest-TestInstancesWithCinderVolumes-2065292736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:59:22 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-cfe9d476-2d85-47d9-a53e-ae31a31c67fa tempest-TestInstancesWithCinderVolumes-2065292736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:59:22 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-cfe9d476-2d85-47d9-a53e-ae31a31c67fa tempest-TestInstancesWithCinderVolumes-2065292736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:59:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-cfe9d476-2d85-47d9-a53e-ae31a31c67fa tempest-TestInstancesWithCinderVolumes-2065292736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:59:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cfe9d476-2d85-47d9-a53e-ae31a31c67fa tempest-TestInstancesWithCinderVolumes-2065292736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:59:23 devstack sudo[105251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:59:23 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:59:23 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root
Nov 06 11:59:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cfe9d476-2d85-47d9-a53e-ae31a31c67fa tempest-TestInstancesWithCinderVolumes-2065292736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.268s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:59:23 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-cfe9d476-2d85-47d9-a53e-ae31a31c67fa tempest-TestInstancesWithCinderVolumes-2065292736 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:59:23 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-cfe9d476-2d85-47d9-a53e-ae31a31c67fa tempest-TestInstancesWithCinderVolumes-2065292736 None] Deleted volume successfully.
Nov 06 11:59:23 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-cfe9d476-2d85-47d9-a53e-ae31a31c67fa tempest-TestInstancesWithCinderVolumes-2065292736 None] Lock "cinder-837bbc9c-1639-47a7-a125-8944e246420e-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:59:25 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-8aa52e38-b457-461a-bc71-040e84e8ad4c req-dcfc2415-78da-42e0-afe9-f8886a1b6e43 tempest-TestInstancesWithCinderVolumes-2065292736 None] Terminate volume connection completed successfully.
Nov 06 11:59:25 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-8aa52e38-b457-461a-bc71-040e84e8ad4c req-dcfc2415-78da-42e0-afe9-f8886a1b6e43 tempest-TestInstancesWithCinderVolumes-2065292736 None] Deleting attachment 2740cb71-e706-4020-b273-c63bb2862ad7. {{(pid=87165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 11:59:26 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c79eff6f-cf6f-4ead-b7d4-40487ef45d46 tempest-TestInstancesWithCinderVolumes-2065292736 None] Acquiring lock "cinder-b54cd6f5-e61c-4f91-843a-05c401a49c67-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:59:26 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c79eff6f-cf6f-4ead-b7d4-40487ef45d46 tempest-TestInstancesWithCinderVolumes-2065292736 None] Lock "cinder-b54cd6f5-e61c-4f91-843a-05c401a49c67-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:59:26 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c79eff6f-cf6f-4ead-b7d4-40487ef45d46 tempest-TestInstancesWithCinderVolumes-2065292736 None] Acquiring lock "cinder-quobyte-b54cd6f5-e61c-4f91-843a-05c401a49c67" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:59:26 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c79eff6f-cf6f-4ead-b7d4-40487ef45d46 tempest-TestInstancesWithCinderVolumes-2065292736 None] Lock "cinder-quobyte-b54cd6f5-e61c-4f91-843a-05c401a49c67" acquired by "delete_volume" :: waited 0.016s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:59:26 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4f37ef-6fba-4812-a78e-43acf5ceca8d]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:59:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c79eff6f-cf6f-4ead-b7d4-40487ef45d46 tempest-TestInstancesWithCinderVolumes-2065292736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b54cd6f5-e61c-4f91-843a-05c401a49c67 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:59:26 devstack sudo[105280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b54cd6f5-e61c-4f91-843a-05c401a49c67
Nov 06 11:59:26 devstack sudo[105280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:59:26 devstack sudo[105280]: pam_unix(sudo:session): session closed for user root
Nov 06 11:59:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c79eff6f-cf6f-4ead-b7d4-40487ef45d46 tempest-TestInstancesWithCinderVolumes-2065292736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b54cd6f5-e61c-4f91-843a-05c401a49c67" returned: 0 in 0.366s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:59:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c79eff6f-cf6f-4ead-b7d4-40487ef45d46 tempest-TestInstancesWithCinderVolumes-2065292736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b54cd6f5-e61c-4f91-843a-05c401a49c67 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:59:26 devstack sudo[105285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b54cd6f5-e61c-4f91-843a-05c401a49c67
Nov 06 11:59:26 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:59:26 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root
Nov 06 11:59:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c79eff6f-cf6f-4ead-b7d4-40487ef45d46 tempest-TestInstancesWithCinderVolumes-2065292736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b54cd6f5-e61c-4f91-843a-05c401a49c67" returned: 0 in 0.250s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:59:26 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c79eff6f-cf6f-4ead-b7d4-40487ef45d46 tempest-TestInstancesWithCinderVolumes-2065292736 None] Lock "cinder-quobyte-b54cd6f5-e61c-4f91-843a-05c401a49c67" released by "delete_volume" :: held 0.664s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:59:26 devstack cinder-volume[87165]: WARNING cinder.quota [None req-c79eff6f-cf6f-4ead-b7d4-40487ef45d46 tempest-TestInstancesWithCinderVolumes-2065292736 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2060684347-1772401488 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2060684347-1772401488, it is now deprecated. Please use the default quota class for default quota.
Nov 06 11:59:26 devstack cinder-volume[87165]: WARNING cinder.quota [None req-c79eff6f-cf6f-4ead-b7d4-40487ef45d46 tempest-TestInstancesWithCinderVolumes-2065292736 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2060684347-1772401488 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2060684347-1772401488, it is now deprecated. Please use the default quota class for default quota.
Nov 06 11:59:27 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-c79eff6f-cf6f-4ead-b7d4-40487ef45d46 tempest-TestInstancesWithCinderVolumes-2065292736 None] Created reservations ['55164ec8-c442-4ca2-9ad1-46371ac9a9eb', '3b293979-b894-4795-8f16-adceb4feb109', '8e695f21-b58d-4fab-af51-3e4d4bb29f8d', 'f350dcd0-2c04-4581-9c09-7062fcb56723'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:59:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c79eff6f-cf6f-4ead-b7d4-40487ef45d46 tempest-TestInstancesWithCinderVolumes-2065292736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:59:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c79eff6f-cf6f-4ead-b7d4-40487ef45d46 tempest-TestInstancesWithCinderVolumes-2065292736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:59:27 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-c79eff6f-cf6f-4ead-b7d4-40487ef45d46 tempest-TestInstancesWithCinderVolumes-2065292736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:59:27 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-c79eff6f-cf6f-4ead-b7d4-40487ef45d46 tempest-TestInstancesWithCinderVolumes-2065292736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:59:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c79eff6f-cf6f-4ead-b7d4-40487ef45d46 tempest-TestInstancesWithCinderVolumes-2065292736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:59:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c79eff6f-cf6f-4ead-b7d4-40487ef45d46 tempest-TestInstancesWithCinderVolumes-2065292736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:59:27 devstack sudo[105288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:59:27 devstack sudo[105288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:59:27 devstack sudo[105288]: pam_unix(sudo:session): session closed for user root
Nov 06 11:59:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c79eff6f-cf6f-4ead-b7d4-40487ef45d46 tempest-TestInstancesWithCinderVolumes-2065292736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.250s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:59:27 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-c79eff6f-cf6f-4ead-b7d4-40487ef45d46 tempest-TestInstancesWithCinderVolumes-2065292736 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:59:27 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-c79eff6f-cf6f-4ead-b7d4-40487ef45d46 tempest-TestInstancesWithCinderVolumes-2065292736 None] Deleted volume successfully.
Nov 06 11:59:27 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c79eff6f-cf6f-4ead-b7d4-40487ef45d46 tempest-TestInstancesWithCinderVolumes-2065292736 None] Lock "cinder-b54cd6f5-e61c-4f91-843a-05c401a49c67-delete_volume" released by "delete_volume" :: held 1.121s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:59:29 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-d15a2f47-a0b2-4c38-8a56-50445afac0a7 req-c6b0b9b6-43aa-4004-9e01-4f2c559b43f9 tempest-TestInstancesWithCinderVolumes-2065292736 None] Terminate volume connection completed successfully.
Nov 06 11:59:29 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-d15a2f47-a0b2-4c38-8a56-50445afac0a7 req-c6b0b9b6-43aa-4004-9e01-4f2c559b43f9 tempest-TestInstancesWithCinderVolumes-2065292736 None] Deleting attachment 42867345-326c-4977-ae8e-b5051ee6420c. {{(pid=87165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 11:59:31 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-22f10ab9-f6b4-4916-bf2c-bb24d7d5a6a1 tempest-TestInstancesWithCinderVolumes-2065292736 None] Acquiring lock "cinder-f0c8a9ba-b3c8-498c-ad36-1fa3d89be915-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:59:31 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-22f10ab9-f6b4-4916-bf2c-bb24d7d5a6a1 tempest-TestInstancesWithCinderVolumes-2065292736 None] Lock "cinder-f0c8a9ba-b3c8-498c-ad36-1fa3d89be915-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:59:31 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-22f10ab9-f6b4-4916-bf2c-bb24d7d5a6a1 tempest-TestInstancesWithCinderVolumes-2065292736 None] Acquiring lock "cinder-quobyte-f0c8a9ba-b3c8-498c-ad36-1fa3d89be915" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 11:59:31 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-22f10ab9-f6b4-4916-bf2c-bb24d7d5a6a1 tempest-TestInstancesWithCinderVolumes-2065292736 None] Lock "cinder-quobyte-f0c8a9ba-b3c8-498c-ad36-1fa3d89be915" acquired by "delete_volume" :: waited 0.020s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 11:59:31 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23e7d38-1b21-49b4-87d1-f32bd7a5abb4]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 11:59:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-22f10ab9-f6b4-4916-bf2c-bb24d7d5a6a1 tempest-TestInstancesWithCinderVolumes-2065292736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f0c8a9ba-b3c8-498c-ad36-1fa3d89be915 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:59:31 devstack sudo[105322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f0c8a9ba-b3c8-498c-ad36-1fa3d89be915
Nov 06 11:59:31 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:59:31 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root
Nov 06 11:59:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-22f10ab9-f6b4-4916-bf2c-bb24d7d5a6a1 tempest-TestInstancesWithCinderVolumes-2065292736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f0c8a9ba-b3c8-498c-ad36-1fa3d89be915" returned: 0 in 0.346s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:59:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-22f10ab9-f6b4-4916-bf2c-bb24d7d5a6a1 tempest-TestInstancesWithCinderVolumes-2065292736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f0c8a9ba-b3c8-498c-ad36-1fa3d89be915 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:59:31 devstack sudo[105327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f0c8a9ba-b3c8-498c-ad36-1fa3d89be915
Nov 06 11:59:31 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:59:31 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root
Nov 06 11:59:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-22f10ab9-f6b4-4916-bf2c-bb24d7d5a6a1 tempest-TestInstancesWithCinderVolumes-2065292736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f0c8a9ba-b3c8-498c-ad36-1fa3d89be915" returned: 0 in 0.244s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:59:31 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-22f10ab9-f6b4-4916-bf2c-bb24d7d5a6a1 tempest-TestInstancesWithCinderVolumes-2065292736 None] Lock "cinder-quobyte-f0c8a9ba-b3c8-498c-ad36-1fa3d89be915" released by "delete_volume" :: held 0.635s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:59:31 devstack cinder-volume[87165]: WARNING cinder.quota [None req-22f10ab9-f6b4-4916-bf2c-bb24d7d5a6a1 tempest-TestInstancesWithCinderVolumes-2065292736 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2031562242-1248991410 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2031562242-1248991410, it is now deprecated. Please use the default quota class for default quota.
Nov 06 11:59:31 devstack cinder-volume[87165]: WARNING cinder.quota [None req-22f10ab9-f6b4-4916-bf2c-bb24d7d5a6a1 tempest-TestInstancesWithCinderVolumes-2065292736 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2031562242-1248991410 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2031562242-1248991410, it is now deprecated. Please use the default quota class for default quota.
Nov 06 11:59:31 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-22f10ab9-f6b4-4916-bf2c-bb24d7d5a6a1 tempest-TestInstancesWithCinderVolumes-2065292736 None] Created reservations ['cd23dd72-f522-4742-bd2b-d3432d420eda', '89bc1734-9add-4d6d-9f52-683d527a961a', 'bbb021ed-958b-460c-8c10-51123e5e14da', '03b69a59-4cfa-4f8d-81cc-3999913b0304'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 11:59:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-22f10ab9-f6b4-4916-bf2c-bb24d7d5a6a1 tempest-TestInstancesWithCinderVolumes-2065292736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 11:59:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-22f10ab9-f6b4-4916-bf2c-bb24d7d5a6a1 tempest-TestInstancesWithCinderVolumes-2065292736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 11:59:31 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-22f10ab9-f6b4-4916-bf2c-bb24d7d5a6a1 tempest-TestInstancesWithCinderVolumes-2065292736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 11:59:31 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-22f10ab9-f6b4-4916-bf2c-bb24d7d5a6a1 tempest-TestInstancesWithCinderVolumes-2065292736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 11:59:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-22f10ab9-f6b4-4916-bf2c-bb24d7d5a6a1 tempest-TestInstancesWithCinderVolumes-2065292736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 11:59:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-22f10ab9-f6b4-4916-bf2c-bb24d7d5a6a1 tempest-TestInstancesWithCinderVolumes-2065292736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 11:59:31 devstack sudo[105330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 11:59:31 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 11:59:32 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root
Nov 06 11:59:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-22f10ab9-f6b4-4916-bf2c-bb24d7d5a6a1 tempest-TestInstancesWithCinderVolumes-2065292736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.248s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 11:59:32 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-22f10ab9-f6b4-4916-bf2c-bb24d7d5a6a1 tempest-TestInstancesWithCinderVolumes-2065292736 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 11:59:32 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-22f10ab9-f6b4-4916-bf2c-bb24d7d5a6a1 tempest-TestInstancesWithCinderVolumes-2065292736 None] Deleted volume successfully.
Nov 06 11:59:32 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-22f10ab9-f6b4-4916-bf2c-bb24d7d5a6a1 tempest-TestInstancesWithCinderVolumes-2065292736 None] Lock "cinder-f0c8a9ba-b3c8-498c-ad36-1fa3d89be915-delete_volume" released by "delete_volume" :: held 1.102s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 11:59:41 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:SELECT=33,cinder:UPDATE=24,cinder:INSERT=5 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 11:59:42 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:SELECT=29,cinder:UPDATE=30,cinder:INSERT=7,cinder:DELETE=3 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 11:59:56 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 12:00:17 devstack cinder-volume[87165]: DEBUG oslo_service.periodic_task [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 12:00:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:00:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:00:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:00:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:00:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:00:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:00:17 devstack sudo[105485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:00:17 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:00:17 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root
Nov 06 12:00:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.238s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:00:17 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:00:17 devstack cinder-volume[87165]: DEBUG oslo_service.periodic_task [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running periodic task VolumeManager._thread_info {{(pid=87165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 12:00:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] thread count: 29 {{(pid=87165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 12:00:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] thread info: [<_MainThread(MainThread, started 127732956901504)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127732842693056)>, <Thread(Thread-3 (stat_writer), started daemon 127732841891136)>, <Thread(Rabbit-heartbeat, started daemon 127732842515648)>, <Thread(Thread-5 (_runner), started daemon 127732840534464)>, <Thread(Thread-7 (_runner), started daemon 127732840636032)>, <Thread(fd_logger, started daemon 127732838664256)>, <Thread(privsep_reader, started daemon 127732838673408)>, <Thread(tpool_thread_0, started daemon 127732829828800)>, <Thread(tpool_thread_1, started daemon 127732821436096)>, <Thread(tpool_thread_2, started daemon 127732813043392)>, <Thread(tpool_thread_3, started daemon 127732804650688)>, <Thread(tpool_thread_4, started daemon 127732796257984)>, <Thread(tpool_thread_5, started daemon 127732787865280)>, <Thread(tpool_thread_6, started daemon 127732779456192)>, <Thread(tpool_thread_7, started daemon 127732771047104)>, <Thread(tpool_thread_8, started daemon 127732762638016)>, <Thread(tpool_thread_9, started daemon 127732754228928)>, <Thread(tpool_thread_10, started daemon 127732745819840)>, <Thread(tpool_thread_11, started daemon 127732737410752)>, <Thread(tpool_thread_12, started daemon 127732729001664)>, <Thread(tpool_thread_13, started daemon 127732720592576)>, <Thread(tpool_thread_14, started daemon 127732712183488)>, <Thread(tpool_thread_15, started daemon 127732703774400)>, <Thread(tpool_thread_16, started daemon 127732695365312)>, <Thread(tpool_thread_17, started daemon 127732686956224)>, <Thread(tpool_thread_18, started daemon 127732678547136)>, <Thread(tpool_thread_19, started daemon 127732670138048)>, <Thread(Rabbit-heartbeat, started daemon 127732832631296)>] {{(pid=87165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 12:00:32 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-18e8927f-b69d-4b42-a4aa-5a893c8bc65a tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:00:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-18e8927f-b69d-4b42-a4aa-5a893c8bc65a tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Flow 'volume_create_manager' (6bc01f35-f138-4283-ac4b-4bf30efacc46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:00:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-18e8927f-b69d-4b42-a4aa-5a893c8bc65a tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e116eb7-06a0-4a36-b24c-1a1bff49614c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:00:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-18e8927f-b69d-4b42-a4aa-5a893c8bc65a tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e116eb7-06a0-4a36-b24c-1a1bff49614c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1694370846',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76715325-8fbc-451f-bcdb-b4af6fd34960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3835f7e5f214c46aab14a510c73962b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:00:33Z,use_quota=True,user_id='e9a351eb29cb4bf6a04862eb8a88ce29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:00:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-18e8927f-b69d-4b42-a4aa-5a893c8bc65a tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (060c5366-abc5-46c4-9b28-c0178f37ad82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:00:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-18e8927f-b69d-4b42-a4aa-5a893c8bc65a tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (060c5366-abc5-46c4-9b28-c0178f37ad82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:00:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-18e8927f-b69d-4b42-a4aa-5a893c8bc65a tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2c2e2e5-c672-4cdb-afcc-5dd9eb4bdfbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:00:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-18e8927f-b69d-4b42-a4aa-5a893c8bc65a tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2c2e2e5-c672-4cdb-afcc-5dd9eb4bdfbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76715325-8fbc-451f-bcdb-b4af6fd34960', 'volume_name': 'volume-76715325-8fbc-451f-bcdb-b4af6fd34960', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:00:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-18e8927f-b69d-4b42-a4aa-5a893c8bc65a tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (473fb8b4-5183-49d0-af58-46b1fa7863ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:00:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-18e8927f-b69d-4b42-a4aa-5a893c8bc65a tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (473fb8b4-5183-49d0-af58-46b1fa7863ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:00:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-18e8927f-b69d-4b42-a4aa-5a893c8bc65a tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bc57a54-6f11-4189-8c72-33e02dca28b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:00:32 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-18e8927f-b69d-4b42-a4aa-5a893c8bc65a tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Volume 76715325-8fbc-451f-bcdb-b4af6fd34960: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76715325-8fbc-451f-bcdb-b4af6fd34960', 'volume_size': 1}
Nov 06 12:00:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-18e8927f-b69d-4b42-a4aa-5a893c8bc65a tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:00:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-18e8927f-b69d-4b42-a4aa-5a893c8bc65a tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:00:32 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-18e8927f-b69d-4b42-a4aa-5a893c8bc65a tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1694370846',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76715325-8fbc-451f-bcdb-b4af6fd34960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3835f7e5f214c46aab14a510c73962b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:00:33Z,use_quota=True,user_id='e9a351eb29cb4bf6a04862eb8a88ce29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:00:32 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-18e8927f-b69d-4b42-a4aa-5a893c8bc65a tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Creating volume 76715325-8fbc-451f-bcdb-b4af6fd34960 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:00:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-18e8927f-b69d-4b42-a4aa-5a893c8bc65a tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:00:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-18e8927f-b69d-4b42-a4aa-5a893c8bc65a tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:00:32 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-18e8927f-b69d-4b42-a4aa-5a893c8bc65a tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:00:32 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-18e8927f-b69d-4b42-a4aa-5a893c8bc65a tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:00:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-18e8927f-b69d-4b42-a4aa-5a893c8bc65a tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:00:32 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-18e8927f-b69d-4b42-a4aa-5a893c8bc65a tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:00:32 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-18e8927f-b69d-4b42-a4aa-5a893c8bc65a tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:00:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-18e8927f-b69d-4b42-a4aa-5a893c8bc65a tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76715325-8fbc-451f-bcdb-b4af6fd34960 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:00:32 devstack sudo[105508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76715325-8fbc-451f-bcdb-b4af6fd34960 1073741824
Nov 06 12:00:32 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:00:33 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root
Nov 06 12:00:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-18e8927f-b69d-4b42-a4aa-5a893c8bc65a tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76715325-8fbc-451f-bcdb-b4af6fd34960 1073741824" returned: 0 in 0.391s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:00:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-18e8927f-b69d-4b42-a4aa-5a893c8bc65a tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76715325-8fbc-451f-bcdb-b4af6fd34960 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:00:33 devstack sudo[105513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76715325-8fbc-451f-bcdb-b4af6fd34960
Nov 06 12:00:33 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:00:33 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root
Nov 06 12:00:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-18e8927f-b69d-4b42-a4aa-5a893c8bc65a tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76715325-8fbc-451f-bcdb-b4af6fd34960" returned: 0 in 0.232s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:00:33 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-18e8927f-b69d-4b42-a4aa-5a893c8bc65a tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] <== create_volume: return (663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:00:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-18e8927f-b69d-4b42-a4aa-5a893c8bc65a tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.665s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:00:33 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-18e8927f-b69d-4b42-a4aa-5a893c8bc65a tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bc57a54-6f11-4189-8c72-33e02dca28b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76715325-8fbc-451f-bcdb-b4af6fd34960', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:00:33 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-18e8927f-b69d-4b42-a4aa-5a893c8bc65a tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a602c75-03de-4ff6-be85-5321c9e7d216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:00:33 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-18e8927f-b69d-4b42-a4aa-5a893c8bc65a tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Volume volume-76715325-8fbc-451f-bcdb-b4af6fd34960 (76715325-8fbc-451f-bcdb-b4af6fd34960): created successfully
Nov 06 12:00:33 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-18e8927f-b69d-4b42-a4aa-5a893c8bc65a tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a602c75-03de-4ff6-be85-5321c9e7d216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:00:33 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-18e8927f-b69d-4b42-a4aa-5a893c8bc65a tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Flow 'volume_create_manager' (6bc01f35-f138-4283-ac4b-4bf30efacc46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:00:33 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-18e8927f-b69d-4b42-a4aa-5a893c8bc65a tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Created volume successfully.
Nov 06 12:00:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-c588dab7-cdab-4172-b801-777857fdd253 req-1cc5f2a2-b3a0-4a42-b3b9-6c03e5c408ad tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:00:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-c588dab7-cdab-4172-b801-777857fdd253 req-1cc5f2a2-b3a0-4a42-b3b9-6c03e5c408ad tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:00:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-c588dab7-cdab-4172-b801-777857fdd253 req-1cc5f2a2-b3a0-4a42-b3b9-6c03e5c408ad tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:00:34 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-c588dab7-cdab-4172-b801-777857fdd253 req-1cc5f2a2-b3a0-4a42-b3b9-6c03e5c408ad tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50', 'name': 'volume-76715325-8fbc-451f-bcdb-b4af6fd34960', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5b5497a1-95a4-4a50-88bb-6781124ccce5', 'enforce_multipath': True} {{(pid=87165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 12:00:34 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-c588dab7-cdab-4172-b801-777857fdd253 req-1cc5f2a2-b3a0-4a42-b3b9-6c03e5c408ad tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] attachment_update completed successfully.
Nov 06 12:00:36 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-3a53c0a8-ab60-4a56-b512-1008b1cd4e40 req-252f74ef-6922-402a-bced-28dd85289822 tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Terminate volume connection completed successfully.
Nov 06 12:00:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-3a53c0a8-ab60-4a56-b512-1008b1cd4e40 req-252f74ef-6922-402a-bced-28dd85289822 tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Deleting attachment 5b5497a1-95a4-4a50-88bb-6781124ccce5. {{(pid=87165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 12:00:37 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b4f61c2b-136b-4ac7-a609-90718266be9b tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Acquiring lock "cinder-76715325-8fbc-451f-bcdb-b4af6fd34960-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:00:37 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b4f61c2b-136b-4ac7-a609-90718266be9b tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Lock "cinder-76715325-8fbc-451f-bcdb-b4af6fd34960-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:00:37 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b4f61c2b-136b-4ac7-a609-90718266be9b tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Acquiring lock "cinder-quobyte-76715325-8fbc-451f-bcdb-b4af6fd34960" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:00:37 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b4f61c2b-136b-4ac7-a609-90718266be9b tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Lock "cinder-quobyte-76715325-8fbc-451f-bcdb-b4af6fd34960" acquired by "delete_volume" :: waited 0.013s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:00:37 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb415b1-398c-439f-b79b-71be1548e4b9]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:00:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b4f61c2b-136b-4ac7-a609-90718266be9b tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76715325-8fbc-451f-bcdb-b4af6fd34960 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:00:37 devstack sudo[105969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76715325-8fbc-451f-bcdb-b4af6fd34960
Nov 06 12:00:37 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:00:37 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root
Nov 06 12:00:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b4f61c2b-136b-4ac7-a609-90718266be9b tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76715325-8fbc-451f-bcdb-b4af6fd34960" returned: 0 in 0.361s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:00:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b4f61c2b-136b-4ac7-a609-90718266be9b tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76715325-8fbc-451f-bcdb-b4af6fd34960 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:00:37 devstack sudo[105975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76715325-8fbc-451f-bcdb-b4af6fd34960
Nov 06 12:00:37 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:00:38 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root
Nov 06 12:00:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b4f61c2b-136b-4ac7-a609-90718266be9b tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76715325-8fbc-451f-bcdb-b4af6fd34960" returned: 0 in 0.252s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:00:38 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b4f61c2b-136b-4ac7-a609-90718266be9b tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Lock "cinder-quobyte-76715325-8fbc-451f-bcdb-b4af6fd34960" released by "delete_volume" :: held 0.652s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:00:38 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-b4f61c2b-136b-4ac7-a609-90718266be9b tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Created reservations ['497e8f21-569c-4883-8f1c-2ba55f9bacd6', '6a098f66-8004-455e-9a61-b42cb15b48d0', 'd7584d60-a0ac-4768-ab22-948336421944', '3385ccef-32c2-4497-bac6-a4d07ebf2525'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:00:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b4f61c2b-136b-4ac7-a609-90718266be9b tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:00:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b4f61c2b-136b-4ac7-a609-90718266be9b tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:00:38 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b4f61c2b-136b-4ac7-a609-90718266be9b tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:00:38 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b4f61c2b-136b-4ac7-a609-90718266be9b tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:00:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b4f61c2b-136b-4ac7-a609-90718266be9b tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:00:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b4f61c2b-136b-4ac7-a609-90718266be9b tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:00:38 devstack sudo[105978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:00:38 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:00:38 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root
Nov 06 12:00:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b4f61c2b-136b-4ac7-a609-90718266be9b tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.233s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:00:38 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-b4f61c2b-136b-4ac7-a609-90718266be9b tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:00:38 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-b4f61c2b-136b-4ac7-a609-90718266be9b tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Deleted volume successfully.
Nov 06 12:00:38 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b4f61c2b-136b-4ac7-a609-90718266be9b tempest-TestServerVolumeAttachScenarioOldVersion-1461168813 None] Lock "cinder-76715325-8fbc-451f-bcdb-b4af6fd34960-delete_volume" released by "delete_volume" :: held 1.080s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:00:48 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:SELECT=15,cinder:UPDATE=10,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 12:00:48 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:UPDATE=15,cinder:SELECT=14,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 12:01:13 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:01:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] Flow 'volume_create_manager' (3b0ba5af-c9dd-4595-b79a-ad0f48117d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:01:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a175e22e-5e8f-47ff-9900-eb875e1c4c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:01:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a175e22e-5e8f-47ff-9900-eb875e1c4c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:01:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-527555657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb4e297f-d84b-4e34-aeb0-135545328e7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29478c3ca1af497eb9c8800128ea0266',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:01:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:01:13Z,use_quota=True,user_id='47d539a9a22c480994f5eb35415d7f5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:01:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10630e96-92e4-48d8-8212-ff9ae25dd050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:01:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10630e96-92e4-48d8-8212-ff9ae25dd050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:01:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13fecbc0-21de-4170-b59f-afa46b1fb25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:01:13 devstack cinder-volume[87165]: DEBUG cinder.image.glance [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] Creating Keystone auth plugin from conf {{(pid=87165) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 06 12:01:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13fecbc0-21de-4170-b59f-afa46b1fb25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cb4e297f-d84b-4e34-aeb0-135545328e7b', 'volume_name': 'volume-cb4e297f-d84b-4e34-aeb0-135545328e7b', 'volume_size': 1, 'image_id': 'c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '28942f14a9e2424ca7367c6efa5fb47a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'created_at': datetime.datetime(2026, 11, 6, 10, 37, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 10, 37, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c315441d-48d2-43fb-b56a-c983b5a6f9cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x742c13e53e60>}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:01:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87a6c8c2-a0aa-46d4-a53a-a36fdf3cafa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:01:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87a6c8c2-a0aa-46d4-a53a-a36fdf3cafa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:01:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dadc440-ca83-477f-9dce-cefe32e0b546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:01:13 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] Volume cb4e297f-d84b-4e34-aeb0-135545328e7b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cb4e297f-d84b-4e34-aeb0-135545328e7b', 'volume_size': 1, 'image_id': 'c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '28942f14a9e2424ca7367c6efa5fb47a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'created_at': datetime.datetime(2026, 11, 6, 10, 37, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 10, 37, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c315441d-48d2-43fb-b56a-c983b5a6f9cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x742c13e53e60>}
Nov 06 12:01:13 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] Trying to clone cb4e297f-d84b-4e34-aeb0-135545328e7b from image c315441d-48d2-43fb-b56a-c983b5a6f9cd at location (None, [{'url': 'file:///opt/stack/data/glance/images/c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'metadata': {}}]). {{(pid=87165) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 06 12:01:13 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_zfkktgabdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87165) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 06 12:01:13 devstack cinder-volume[87165]: INFO cinder.image.image_utils [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] Image download 20.69 MB at 20.69 MB/s
Nov 06 12:01:13 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3809f59-77e9-4709-8989-2cba4b7d39ea]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:01:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_zfkktgabdevstack@QuobyteHD {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:01:13 devstack sudo[106062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_zfkktgabdevstack@QuobyteHD
Nov 06 12:01:13 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:01:14 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root
Nov 06 12:01:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_zfkktgabdevstack@QuobyteHD" returned: 0 in 0.324s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:01:14 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] Temporary image c315441d-48d2-43fb-b56a-c983b5a6f9cd is fetched for user 47d539a9a22c480994f5eb35415d7f5a. {{(pid=87165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 06 12:01:14 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b45185-e572-4ebe-94b1-176d2bf59c84]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:01:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_zfkktgabdevstack@QuobyteHD {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:01:14 devstack sudo[106067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_zfkktgabdevstack@QuobyteHD
Nov 06 12:01:14 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:01:14 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root
Nov 06 12:01:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_zfkktgabdevstack@QuobyteHD" returned: 0 in 0.312s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:01:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:01:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:01:14 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:01:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-527555657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb4e297f-d84b-4e34-aeb0-135545328e7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29478c3ca1af497eb9c8800128ea0266',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:01:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:01:13Z,use_quota=True,user_id='47d539a9a22c480994f5eb35415d7f5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:01:14 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] Creating volume cb4e297f-d84b-4e34-aeb0-135545328e7b {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:01:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:01:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:01:14 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:01:14 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:01:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:01:14 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:01:14 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:01:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-cb4e297f-d84b-4e34-aeb0-135545328e7b 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:01:14 devstack sudo[106072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-cb4e297f-d84b-4e34-aeb0-135545328e7b 1073741824
Nov 06 12:01:14 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:01:14 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root
Nov 06 12:01:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-cb4e297f-d84b-4e34-aeb0-135545328e7b 1073741824" returned: 0 in 0.399s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:01:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-cb4e297f-d84b-4e34-aeb0-135545328e7b {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:01:15 devstack sudo[106078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-cb4e297f-d84b-4e34-aeb0-135545328e7b
Nov 06 12:01:15 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:01:15 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root
Nov 06 12:01:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-cb4e297f-d84b-4e34-aeb0-135545328e7b" returned: 0 in 0.254s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:01:15 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:01:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:01:15 devstack cinder-volume[87165]: DEBUG cinder.volume.volume_utils [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] Attempting download of c315441d-48d2-43fb-b56a-c983b5a6f9cd ((None, [{'url': 'file:///opt/stack/data/glance/images/c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'metadata': {}}])) to volume cb4e297f-d84b-4e34-aeb0-135545328e7b. {{(pid=87165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 06 12:01:15 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ccc146-8bfc-4c87-ae6a-e4b4221d1467]: (4, 'raw') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:01:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c315441d-48d2-43fb-b56a-c983b5a6f9cd_if0r1udy {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:01:15 devstack sudo[106081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c315441d-48d2-43fb-b56a-c983b5a6f9cd_if0r1udy
Nov 06 12:01:15 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:01:15 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root
Nov 06 12:01:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c315441d-48d2-43fb-b56a-c983b5a6f9cd_if0r1udy" returned: 0 in 0.305s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:01:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c315441d-48d2-43fb-b56a-c983b5a6f9cd_if0r1udy {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:01:15 devstack sudo[106085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c315441d-48d2-43fb-b56a-c983b5a6f9cd_if0r1udy
Nov 06 12:01:15 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:01:15 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root
Nov 06 12:01:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c315441d-48d2-43fb-b56a-c983b5a6f9cd_if0r1udy" returned: 1 in 0.309s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:01:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c315441d-48d2-43fb-b56a-c983b5a6f9cd_if0r1udy' failed. Not Retrying. {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 12:01:15 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[57cad57f-63d1-482e-91bc-cd1e72f68c72]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:01:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_zfkktgabdevstack@QuobyteHD {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:01:16 devstack sudo[106089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_zfkktgabdevstack@QuobyteHD
Nov 06 12:01:16 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:01:16 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root
Nov 06 12:01:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_zfkktgabdevstack@QuobyteHD" returned: 0 in 0.317s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:01:16 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] c315441d-48d2-43fb-b56a-c983b5a6f9cd was qcow2, converting to qcow2 {{(pid=87165) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 06 12:01:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_zfkktgabdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-cb4e297f-d84b-4e34-aeb0-135545328e7b {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:01:16 devstack sudo[106094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_zfkktgabdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-cb4e297f-d84b-4e34-aeb0-135545328e7b
Nov 06 12:01:16 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:01:17 devstack cinder-volume[87165]: DEBUG oslo_service.periodic_task [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 12:01:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:01:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:01:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:01:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:01:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:01:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:01:17 devstack sudo[106100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:01:17 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:01:17 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root
Nov 06 12:01:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.284s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:01:17 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:01:17 devstack cinder-volume[87165]: DEBUG oslo_service.periodic_task [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running periodic task VolumeManager._thread_info {{(pid=87165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 12:01:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] thread count: 29 {{(pid=87165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 12:01:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] thread info: [<_MainThread(MainThread, started 127732956901504)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127732842693056)>, <Thread(Thread-3 (stat_writer), started daemon 127732841891136)>, <Thread(Rabbit-heartbeat, started daemon 127732842515648)>, <Thread(Thread-5 (_runner), started daemon 127732840534464)>, <Thread(Thread-7 (_runner), started daemon 127732840636032)>, <Thread(fd_logger, started daemon 127732838664256)>, <Thread(privsep_reader, started daemon 127732838673408)>, <Thread(tpool_thread_0, started daemon 127732829828800)>, <Thread(tpool_thread_1, started daemon 127732821436096)>, <Thread(tpool_thread_2, started daemon 127732813043392)>, <Thread(tpool_thread_3, started daemon 127732804650688)>, <Thread(tpool_thread_4, started daemon 127732796257984)>, <Thread(tpool_thread_5, started daemon 127732787865280)>, <Thread(tpool_thread_6, started daemon 127732779456192)>, <Thread(tpool_thread_7, started daemon 127732771047104)>, <Thread(tpool_thread_8, started daemon 127732762638016)>, <Thread(tpool_thread_9, started daemon 127732754228928)>, <Thread(tpool_thread_10, started daemon 127732745819840)>, <Thread(tpool_thread_11, started daemon 127732737410752)>, <Thread(tpool_thread_12, started daemon 127732729001664)>, <Thread(tpool_thread_13, started daemon 127732720592576)>, <Thread(tpool_thread_14, started daemon 127732712183488)>, <Thread(tpool_thread_15, started daemon 127732703774400)>, <Thread(tpool_thread_16, started daemon 127732695365312)>, <Thread(tpool_thread_17, started daemon 127732686956224)>, <Thread(tpool_thread_18, started daemon 127732678547136)>, <Thread(tpool_thread_19, started daemon 127732670138048)>, <Thread(Rabbit-heartbeat, started daemon 127732832631296)>] {{(pid=87165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 12:01:17 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root
Nov 06 12:01:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_zfkktgabdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-cb4e297f-d84b-4e34-aeb0-135545328e7b" returned: 0 in 1.702s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:01:17 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c315441d-48d2-43fb-b56a-c983b5a6f9cd_zfkktgabdevstack@QuobyteHD, size 112.00 MB, duration 1.70 sec, destination /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-cb4e297f-d84b-4e34-aeb0-135545328e7b {{(pid=87165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 12:01:17 devstack cinder-volume[87165]: INFO cinder.image.image_utils [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] Converted 112.00 MB image at 65.76 MB/s
Nov 06 12:01:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-cb4e297f-d84b-4e34-aeb0-135545328e7b 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:01:17 devstack sudo[106106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-cb4e297f-d84b-4e34-aeb0-135545328e7b 1G
Nov 06 12:01:17 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:01:18 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root
Nov 06 12:01:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-cb4e297f-d84b-4e34-aeb0-135545328e7b 1G" returned: 0 in 0.310s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:01:18 devstack cinder-volume[87165]: DEBUG cinder.volume.volume_utils [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] Downloaded image c315441d-48d2-43fb-b56a-c983b5a6f9cd ((None, [{'url': 'file:///opt/stack/data/glance/images/c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'metadata': {}}])) to volume cb4e297f-d84b-4e34-aeb0-135545328e7b successfully. {{(pid=87165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 06 12:01:18 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] Temporary image c315441d-48d2-43fb-b56a-c983b5a6f9cd for user 47d539a9a22c480994f5eb35415d7f5a is deleted. {{(pid=87165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 06 12:01:18 devstack cinder-volume[87165]: DEBUG cinder.volume.volume_utils [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] Marking volume cb4e297f-d84b-4e34-aeb0-135545328e7b as bootable. {{(pid=87165) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 06 12:01:18 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] Copying metadata from image c315441d-48d2-43fb-b56a-c983b5a6f9cd to cb4e297f-d84b-4e34-aeb0-135545328e7b. {{(pid=87165) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 06 12:01:18 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] Creating volume glance metadata for volume cb4e297f-d84b-4e34-aeb0-135545328e7b backed by image c315441d-48d2-43fb-b56a-c983b5a6f9cd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87165) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 06 12:01:18 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dadc440-ca83-477f-9dce-cefe32e0b546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb4e297f-d84b-4e34-aeb0-135545328e7b', 'volume_size': 1, 'image_id': 'c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '28942f14a9e2424ca7367c6efa5fb47a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c315441d-48d2-43fb-b56a-c983b5a6f9cd', 'created_at': datetime.datetime(2026, 11, 6, 10, 37, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 10, 37, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c315441d-48d2-43fb-b56a-c983b5a6f9cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x742c13e53e60>}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:01:18 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b6cffd9-fb29-4526-8da7-5462b1cca996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:01:18 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] Volume volume-cb4e297f-d84b-4e34-aeb0-135545328e7b (cb4e297f-d84b-4e34-aeb0-135545328e7b): created successfully
Nov 06 12:01:18 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b6cffd9-fb29-4526-8da7-5462b1cca996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:01:18 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] Flow 'volume_create_manager' (3b0ba5af-c9dd-4595-b79a-ad0f48117d35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:01:18 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-884d3f82-bb44-414f-a32d-12242b089eec tempest-TestShelveInstance-1504930581 None] Created volume successfully.
Nov 06 12:01:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-7d789943-2b1f-407e-9bbc-aed3c02d35d5 req-2dfca07c-a936-4d70-aad3-3f194bf8d024 tempest-TestShelveInstance-1504930581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:01:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-7d789943-2b1f-407e-9bbc-aed3c02d35d5 req-2dfca07c-a936-4d70-aad3-3f194bf8d024 tempest-TestShelveInstance-1504930581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:01:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-7d789943-2b1f-407e-9bbc-aed3c02d35d5 req-2dfca07c-a936-4d70-aad3-3f194bf8d024 tempest-TestShelveInstance-1504930581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:01:21 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-7d789943-2b1f-407e-9bbc-aed3c02d35d5 req-2dfca07c-a936-4d70-aad3-3f194bf8d024 tempest-TestShelveInstance-1504930581 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50', 'name': 'volume-cb4e297f-d84b-4e34-aeb0-135545328e7b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'db4266bc-6b9b-4268-8b9f-ec7d470f0186', 'enforce_multipath': True} {{(pid=87165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 12:01:22 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-7d789943-2b1f-407e-9bbc-aed3c02d35d5 req-2dfca07c-a936-4d70-aad3-3f194bf8d024 tempest-TestShelveInstance-1504930581 None] attachment_update completed successfully.
Nov 06 12:01:32 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:UPDATE=7,cinder:SELECT=19,cinder:INSERT=5 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 12:01:32 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:SELECT=13,cinder:INSERT=9,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 12:01:52 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-0698a167-db9c-4dbc-8779-fcf9ca68adbe req-7a45161a-8481-4541-b03f-776fbca9daa8 tempest-TestShelveInstance-1504930581 None] Terminate volume connection completed successfully.
Nov 06 12:01:52 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-0698a167-db9c-4dbc-8779-fcf9ca68adbe req-7a45161a-8481-4541-b03f-776fbca9daa8 tempest-TestShelveInstance-1504930581 None] Deleting attachment db4266bc-6b9b-4268-8b9f-ec7d470f0186. {{(pid=87165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 12:01:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-32cbf35f-4219-4396-a73d-33dabc444f0e req-77ed048c-4cc2-4779-b981-04825636bb84 tempest-TestShelveInstance-1504930581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:01:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-32cbf35f-4219-4396-a73d-33dabc444f0e req-77ed048c-4cc2-4779-b981-04825636bb84 tempest-TestShelveInstance-1504930581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:01:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-32cbf35f-4219-4396-a73d-33dabc444f0e req-77ed048c-4cc2-4779-b981-04825636bb84 tempest-TestShelveInstance-1504930581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:01:54 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-32cbf35f-4219-4396-a73d-33dabc444f0e req-77ed048c-4cc2-4779-b981-04825636bb84 tempest-TestShelveInstance-1504930581 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50', 'name': 'volume-cb4e297f-d84b-4e34-aeb0-135545328e7b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3a27ace7-7f88-4d65-8a47-e8d95ee2fd52', 'enforce_multipath': True} {{(pid=87165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 06 12:01:54 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-32cbf35f-4219-4396-a73d-33dabc444f0e req-77ed048c-4cc2-4779-b981-04825636bb84 tempest-TestShelveInstance-1504930581 None] attachment_update completed successfully.
Nov 06 12:02:04 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 12:02:04 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 12:02:17 devstack cinder-volume[87165]: DEBUG oslo_service.periodic_task [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 12:02:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:02:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:02:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:02:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:02:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:02:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:02:17 devstack sudo[107254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:02:17 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:02:17 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root
Nov 06 12:02:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.233s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:02:17 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:02:17 devstack cinder-volume[87165]: DEBUG oslo_service.periodic_task [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running periodic task VolumeManager._thread_info {{(pid=87165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 12:02:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] thread count: 29 {{(pid=87165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 12:02:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] thread info: [<_MainThread(MainThread, started 127732956901504)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127732842693056)>, <Thread(Thread-3 (stat_writer), started daemon 127732841891136)>, <Thread(Rabbit-heartbeat, started daemon 127732842515648)>, <Thread(Thread-5 (_runner), started daemon 127732840534464)>, <Thread(Thread-7 (_runner), started daemon 127732840636032)>, <Thread(fd_logger, started daemon 127732838664256)>, <Thread(privsep_reader, started daemon 127732838673408)>, <Thread(tpool_thread_0, started daemon 127732829828800)>, <Thread(tpool_thread_1, started daemon 127732821436096)>, <Thread(tpool_thread_2, started daemon 127732813043392)>, <Thread(tpool_thread_3, started daemon 127732804650688)>, <Thread(tpool_thread_4, started daemon 127732796257984)>, <Thread(tpool_thread_5, started daemon 127732787865280)>, <Thread(tpool_thread_6, started daemon 127732779456192)>, <Thread(tpool_thread_7, started daemon 127732771047104)>, <Thread(tpool_thread_8, started daemon 127732762638016)>, <Thread(tpool_thread_9, started daemon 127732754228928)>, <Thread(tpool_thread_10, started daemon 127732745819840)>, <Thread(tpool_thread_11, started daemon 127732737410752)>, <Thread(tpool_thread_12, started daemon 127732729001664)>, <Thread(tpool_thread_13, started daemon 127732720592576)>, <Thread(tpool_thread_14, started daemon 127732712183488)>, <Thread(tpool_thread_15, started daemon 127732703774400)>, <Thread(tpool_thread_16, started daemon 127732695365312)>, <Thread(tpool_thread_17, started daemon 127732686956224)>, <Thread(tpool_thread_18, started daemon 127732678547136)>, <Thread(tpool_thread_19, started daemon 127732670138048)>, <Thread(Rabbit-heartbeat, started daemon 127732832631296)>] {{(pid=87165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 12:02:24 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-413062d0-f219-4c6c-9417-31836790fbd3 req-3c3c4e52-fed9-42a3-a71f-afdf72677ace tempest-TestShelveInstance-1504930581 None] Terminate volume connection completed successfully.
Nov 06 12:02:24 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [req-413062d0-f219-4c6c-9417-31836790fbd3 req-3c3c4e52-fed9-42a3-a71f-afdf72677ace tempest-TestShelveInstance-1504930581 None] Deleting attachment 3a27ace7-7f88-4d65-8a47-e8d95ee2fd52. {{(pid=87165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 06 12:02:24 devstack cinder-volume[87165]: DEBUG cinder.coordination [req-413062d0-f219-4c6c-9417-31836790fbd3 req-976903a2-7642-4b0b-b605-c998d68c2e2d tempest-TestShelveInstance-1504930581 None] Acquiring lock "cinder-cb4e297f-d84b-4e34-aeb0-135545328e7b-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:02:24 devstack cinder-volume[87165]: DEBUG cinder.coordination [req-413062d0-f219-4c6c-9417-31836790fbd3 req-976903a2-7642-4b0b-b605-c998d68c2e2d tempest-TestShelveInstance-1504930581 None] Lock "cinder-cb4e297f-d84b-4e34-aeb0-135545328e7b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:02:24 devstack cinder-volume[87165]: DEBUG cinder.coordination [req-413062d0-f219-4c6c-9417-31836790fbd3 req-976903a2-7642-4b0b-b605-c998d68c2e2d tempest-TestShelveInstance-1504930581 None] Acquiring lock "cinder-quobyte-cb4e297f-d84b-4e34-aeb0-135545328e7b" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:02:24 devstack cinder-volume[87165]: DEBUG cinder.coordination [req-413062d0-f219-4c6c-9417-31836790fbd3 req-976903a2-7642-4b0b-b605-c998d68c2e2d tempest-TestShelveInstance-1504930581 None] Lock "cinder-quobyte-cb4e297f-d84b-4e34-aeb0-135545328e7b" acquired by "delete_volume" :: waited 0.018s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:02:24 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[257ee88b-0cef-4df6-a42c-604eb9b9a769]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:02:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-413062d0-f219-4c6c-9417-31836790fbd3 req-976903a2-7642-4b0b-b605-c998d68c2e2d tempest-TestShelveInstance-1504930581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-cb4e297f-d84b-4e34-aeb0-135545328e7b {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:02:24 devstack sudo[107286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-cb4e297f-d84b-4e34-aeb0-135545328e7b
Nov 06 12:02:24 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:02:25 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root
Nov 06 12:02:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-413062d0-f219-4c6c-9417-31836790fbd3 req-976903a2-7642-4b0b-b605-c998d68c2e2d tempest-TestShelveInstance-1504930581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-cb4e297f-d84b-4e34-aeb0-135545328e7b" returned: 0 in 0.383s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:02:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-413062d0-f219-4c6c-9417-31836790fbd3 req-976903a2-7642-4b0b-b605-c998d68c2e2d tempest-TestShelveInstance-1504930581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-cb4e297f-d84b-4e34-aeb0-135545328e7b {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:02:25 devstack sudo[107292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-cb4e297f-d84b-4e34-aeb0-135545328e7b
Nov 06 12:02:25 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:02:25 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root
Nov 06 12:02:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-413062d0-f219-4c6c-9417-31836790fbd3 req-976903a2-7642-4b0b-b605-c998d68c2e2d tempest-TestShelveInstance-1504930581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-cb4e297f-d84b-4e34-aeb0-135545328e7b" returned: 0 in 0.245s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:02:25 devstack cinder-volume[87165]: DEBUG cinder.coordination [req-413062d0-f219-4c6c-9417-31836790fbd3 req-976903a2-7642-4b0b-b605-c998d68c2e2d tempest-TestShelveInstance-1504930581 None] Lock "cinder-quobyte-cb4e297f-d84b-4e34-aeb0-135545328e7b" released by "delete_volume" :: held 0.674s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:02:25 devstack cinder-volume[87165]: DEBUG cinder.quota [req-413062d0-f219-4c6c-9417-31836790fbd3 req-976903a2-7642-4b0b-b605-c998d68c2e2d tempest-TestShelveInstance-1504930581 None] Created reservations ['815c0ec7-d983-4c26-a247-32b9b83489c7', 'a86b1c0a-846e-448c-85f4-2856a2e70428', 'b7fed1c1-4f4f-415e-828e-3997b9109757', '1036414e-4881-48ea-a196-c7f1e15e7b1e'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:02:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-413062d0-f219-4c6c-9417-31836790fbd3 req-976903a2-7642-4b0b-b605-c998d68c2e2d tempest-TestShelveInstance-1504930581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:02:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-413062d0-f219-4c6c-9417-31836790fbd3 req-976903a2-7642-4b0b-b605-c998d68c2e2d tempest-TestShelveInstance-1504930581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:02:25 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [req-413062d0-f219-4c6c-9417-31836790fbd3 req-976903a2-7642-4b0b-b605-c998d68c2e2d tempest-TestShelveInstance-1504930581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:02:25 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [req-413062d0-f219-4c6c-9417-31836790fbd3 req-976903a2-7642-4b0b-b605-c998d68c2e2d tempest-TestShelveInstance-1504930581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:02:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [req-413062d0-f219-4c6c-9417-31836790fbd3 req-976903a2-7642-4b0b-b605-c998d68c2e2d tempest-TestShelveInstance-1504930581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:02:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-413062d0-f219-4c6c-9417-31836790fbd3 req-976903a2-7642-4b0b-b605-c998d68c2e2d tempest-TestShelveInstance-1504930581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:02:25 devstack sudo[107295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:02:25 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:02:25 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root
Nov 06 12:02:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [req-413062d0-f219-4c6c-9417-31836790fbd3 req-976903a2-7642-4b0b-b605-c998d68c2e2d tempest-TestShelveInstance-1504930581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.264s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:02:25 devstack cinder-volume[87165]: DEBUG cinder.manager [req-413062d0-f219-4c6c-9417-31836790fbd3 req-976903a2-7642-4b0b-b605-c998d68c2e2d tempest-TestShelveInstance-1504930581 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:02:25 devstack cinder-volume[87165]: INFO cinder.volume.manager [req-413062d0-f219-4c6c-9417-31836790fbd3 req-976903a2-7642-4b0b-b605-c998d68c2e2d tempest-TestShelveInstance-1504930581 None] Deleted volume successfully.
Nov 06 12:02:25 devstack cinder-volume[87165]: DEBUG cinder.coordination [req-413062d0-f219-4c6c-9417-31836790fbd3 req-976903a2-7642-4b0b-b605-c998d68c2e2d tempest-TestShelveInstance-1504930581 None] Lock "cinder-cb4e297f-d84b-4e34-aeb0-135545328e7b-delete_volume" released by "delete_volume" :: held 1.138s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:02:35 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:SELECT=4,cinder:UPDATE=11,cinder:INSERT=2 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 12:02:35 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 12:02:37 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a9c920d-ab1a-4ed4-9abe-d7cb19e4a222 tempest-CreateVolumesFromSnapshotTest-232579978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:02:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6a9c920d-ab1a-4ed4-9abe-d7cb19e4a222 tempest-CreateVolumesFromSnapshotTest-232579978 None] Flow 'volume_create_manager' (489cf9f6-996a-40f2-be72-085a0919990c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:02:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6a9c920d-ab1a-4ed4-9abe-d7cb19e4a222 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf4e4a41-e7c8-452a-aa2d-63368aee6aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:02:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6a9c920d-ab1a-4ed4-9abe-d7cb19e4a222 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf4e4a41-e7c8-452a-aa2d-63368aee6aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:02:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-290384118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a510f37c-17f0-4035-ba2e-65c3fa8a504d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34a2826eaaca4fb4895ad8dfae953d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:02:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:02:38Z,use_quota=True,user_id='4a171727261c4bf88fa316b74c3a31d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:02:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6a9c920d-ab1a-4ed4-9abe-d7cb19e4a222 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2623cbdb-ba85-4a10-a989-01ef1d2db2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:02:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6a9c920d-ab1a-4ed4-9abe-d7cb19e4a222 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2623cbdb-ba85-4a10-a989-01ef1d2db2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:02:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6a9c920d-ab1a-4ed4-9abe-d7cb19e4a222 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38727cd8-19a3-4bda-98e1-f0615148c349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:02:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6a9c920d-ab1a-4ed4-9abe-d7cb19e4a222 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38727cd8-19a3-4bda-98e1-f0615148c349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a510f37c-17f0-4035-ba2e-65c3fa8a504d', 'volume_name': 'volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:02:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6a9c920d-ab1a-4ed4-9abe-d7cb19e4a222 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1157bad1-f08a-466a-b973-263735966335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:02:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6a9c920d-ab1a-4ed4-9abe-d7cb19e4a222 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1157bad1-f08a-466a-b973-263735966335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:02:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6a9c920d-ab1a-4ed4-9abe-d7cb19e4a222 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efeca358-7e04-47a2-a917-6c14d4088b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:02:37 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-6a9c920d-ab1a-4ed4-9abe-d7cb19e4a222 tempest-CreateVolumesFromSnapshotTest-232579978 None] Volume a510f37c-17f0-4035-ba2e-65c3fa8a504d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d', 'volume_size': 1}
Nov 06 12:02:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6a9c920d-ab1a-4ed4-9abe-d7cb19e4a222 tempest-CreateVolumesFromSnapshotTest-232579978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:02:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6a9c920d-ab1a-4ed4-9abe-d7cb19e4a222 tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:02:37 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-6a9c920d-ab1a-4ed4-9abe-d7cb19e4a222 tempest-CreateVolumesFromSnapshotTest-232579978 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:02:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-290384118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a510f37c-17f0-4035-ba2e-65c3fa8a504d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34a2826eaaca4fb4895ad8dfae953d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:02:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:02:38Z,use_quota=True,user_id='4a171727261c4bf88fa316b74c3a31d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:02:37 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-6a9c920d-ab1a-4ed4-9abe-d7cb19e4a222 tempest-CreateVolumesFromSnapshotTest-232579978 None] Creating volume a510f37c-17f0-4035-ba2e-65c3fa8a504d {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:02:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6a9c920d-ab1a-4ed4-9abe-d7cb19e4a222 tempest-CreateVolumesFromSnapshotTest-232579978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:02:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6a9c920d-ab1a-4ed4-9abe-d7cb19e4a222 tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:02:37 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-6a9c920d-ab1a-4ed4-9abe-d7cb19e4a222 tempest-CreateVolumesFromSnapshotTest-232579978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:02:37 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-6a9c920d-ab1a-4ed4-9abe-d7cb19e4a222 tempest-CreateVolumesFromSnapshotTest-232579978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:02:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6a9c920d-ab1a-4ed4-9abe-d7cb19e4a222 tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:02:37 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-6a9c920d-ab1a-4ed4-9abe-d7cb19e4a222 tempest-CreateVolumesFromSnapshotTest-232579978 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:02:37 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-6a9c920d-ab1a-4ed4-9abe-d7cb19e4a222 tempest-CreateVolumesFromSnapshotTest-232579978 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:02:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6a9c920d-ab1a-4ed4-9abe-d7cb19e4a222 tempest-CreateVolumesFromSnapshotTest-232579978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:02:37 devstack sudo[107303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d 1073741824
Nov 06 12:02:37 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:02:38 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root
Nov 06 12:02:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6a9c920d-ab1a-4ed4-9abe-d7cb19e4a222 tempest-CreateVolumesFromSnapshotTest-232579978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d 1073741824" returned: 0 in 0.387s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:02:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6a9c920d-ab1a-4ed4-9abe-d7cb19e4a222 tempest-CreateVolumesFromSnapshotTest-232579978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:02:38 devstack sudo[107308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d
Nov 06 12:02:38 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:02:38 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root
Nov 06 12:02:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6a9c920d-ab1a-4ed4-9abe-d7cb19e4a222 tempest-CreateVolumesFromSnapshotTest-232579978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d" returned: 0 in 0.244s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:02:38 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-6a9c920d-ab1a-4ed4-9abe-d7cb19e4a222 tempest-CreateVolumesFromSnapshotTest-232579978 None] <== create_volume: return (667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:02:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6a9c920d-ab1a-4ed4-9abe-d7cb19e4a222 tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.669s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:02:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6a9c920d-ab1a-4ed4-9abe-d7cb19e4a222 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efeca358-7e04-47a2-a917-6c14d4088b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:02:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6a9c920d-ab1a-4ed4-9abe-d7cb19e4a222 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfa6ae33-e5a9-4490-863a-e6cb46feebb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:02:38 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-6a9c920d-ab1a-4ed4-9abe-d7cb19e4a222 tempest-CreateVolumesFromSnapshotTest-232579978 None] Volume volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d (a510f37c-17f0-4035-ba2e-65c3fa8a504d): created successfully
Nov 06 12:02:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6a9c920d-ab1a-4ed4-9abe-d7cb19e4a222 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfa6ae33-e5a9-4490-863a-e6cb46feebb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:02:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6a9c920d-ab1a-4ed4-9abe-d7cb19e4a222 tempest-CreateVolumesFromSnapshotTest-232579978 None] Flow 'volume_create_manager' (489cf9f6-996a-40f2-be72-085a0919990c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:02:38 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-6a9c920d-ab1a-4ed4-9abe-d7cb19e4a222 tempest-CreateVolumesFromSnapshotTest-232579978 None] Created volume successfully.
Nov 06 12:02:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-0063609a-6651-43e3-86af-7502a38e1e43 tempest-CreateVolumesFromSnapshotTest-232579978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:02:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-0063609a-6651-43e3-86af-7502a38e1e43 tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:02:38 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-0063609a-6651-43e3-86af-7502a38e1e43 tempest-CreateVolumesFromSnapshotTest-232579978 None] Creating offline snapshot 0b635971-d23f-4b1f-9b03-9d0cdf330dcb of volume a510f37c-17f0-4035-ba2e-65c3fa8a504d {{(pid=87165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 12:02:38 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29c3c04-44dc-4678-9b60-53ba0c4ed456]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:02:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0063609a-6651-43e3-86af-7502a38e1e43 tempest-CreateVolumesFromSnapshotTest-232579978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:02:38 devstack sudo[107311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d
Nov 06 12:02:38 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:02:39 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root
Nov 06 12:02:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0063609a-6651-43e3-86af-7502a38e1e43 tempest-CreateVolumesFromSnapshotTest-232579978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d" returned: 0 in 0.370s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:02:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0063609a-6651-43e3-86af-7502a38e1e43 tempest-CreateVolumesFromSnapshotTest-232579978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d.0b635971-d23f-4b1f-9b03-9d0cdf330dcb 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:02:39 devstack sudo[107318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d.0b635971-d23f-4b1f-9b03-9d0cdf330dcb 1G
Nov 06 12:02:39 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:02:39 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root
Nov 06 12:02:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0063609a-6651-43e3-86af-7502a38e1e43 tempest-CreateVolumesFromSnapshotTest-232579978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d.0b635971-d23f-4b1f-9b03-9d0cdf330dcb 1G" returned: 0 in 0.373s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:02:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0063609a-6651-43e3-86af-7502a38e1e43 tempest-CreateVolumesFromSnapshotTest-232579978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d.0b635971-d23f-4b1f-9b03-9d0cdf330dcb {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:02:39 devstack sudo[107323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d.0b635971-d23f-4b1f-9b03-9d0cdf330dcb
Nov 06 12:02:39 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:02:39 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root
Nov 06 12:02:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0063609a-6651-43e3-86af-7502a38e1e43 tempest-CreateVolumesFromSnapshotTest-232579978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d.0b635971-d23f-4b1f-9b03-9d0cdf330dcb" returned: 0 in 0.299s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:02:39 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-0063609a-6651-43e3-86af-7502a38e1e43 tempest-CreateVolumesFromSnapshotTest-232579978 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d.0b635971-d23f-4b1f-9b03-9d0cdf330dcb is being set with open permissions: ugo+rw
Nov 06 12:02:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0063609a-6651-43e3-86af-7502a38e1e43 tempest-CreateVolumesFromSnapshotTest-232579978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d.0b635971-d23f-4b1f-9b03-9d0cdf330dcb {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:02:39 devstack sudo[107328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d.0b635971-d23f-4b1f-9b03-9d0cdf330dcb
Nov 06 12:02:39 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:02:40 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root
Nov 06 12:02:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0063609a-6651-43e3-86af-7502a38e1e43 tempest-CreateVolumesFromSnapshotTest-232579978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d.0b635971-d23f-4b1f-9b03-9d0cdf330dcb" returned: 0 in 0.242s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:02:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0063609a-6651-43e3-86af-7502a38e1e43 tempest-CreateVolumesFromSnapshotTest-232579978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:02:40 devstack sudo[107331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d.info
Nov 06 12:02:40 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:02:40 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root
Nov 06 12:02:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0063609a-6651-43e3-86af-7502a38e1e43 tempest-CreateVolumesFromSnapshotTest-232579978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d.info" returned: 0 in 0.236s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:02:40 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-0063609a-6651-43e3-86af-7502a38e1e43 tempest-CreateVolumesFromSnapshotTest-232579978 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d.info is being set with open permissions: ugo+rw
Nov 06 12:02:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0063609a-6651-43e3-86af-7502a38e1e43 tempest-CreateVolumesFromSnapshotTest-232579978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:02:40 devstack sudo[107334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d.info
Nov 06 12:02:40 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:02:40 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root
Nov 06 12:02:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0063609a-6651-43e3-86af-7502a38e1e43 tempest-CreateVolumesFromSnapshotTest-232579978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d.info" returned: 0 in 0.231s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:02:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-0063609a-6651-43e3-86af-7502a38e1e43 tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.837s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:02:40 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-0063609a-6651-43e3-86af-7502a38e1e43 tempest-CreateVolumesFromSnapshotTest-232579978 None] Create snapshot completed successfully
Nov 06 12:02:41 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-d963c1dc-34c3-4d2b-bd2f-e9faa642b1d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:02:41 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d963c1dc-34c3-4d2b-bd2f-e9faa642b1d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] Flow 'volume_create_manager' (3bae667d-056e-46c5-bf06-a6f726033c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:02:41 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d963c1dc-34c3-4d2b-bd2f-e9faa642b1d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33a8b674-3b48-40a3-8b4d-1510c9ee1db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:02:41 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d963c1dc-34c3-4d2b-bd2f-e9faa642b1d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33a8b674-3b48-40a3-8b4d-1510c9ee1db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-140212807',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3607284c-ce07-4268-99de-21d5df580e59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34a2826eaaca4fb4895ad8dfae953d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:02:41Z,use_quota=True,user_id='4a171727261c4bf88fa316b74c3a31d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:02:41 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d963c1dc-34c3-4d2b-bd2f-e9faa642b1d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc535f8d-bdce-4fad-94ae-397e4a45b9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:02:41 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d963c1dc-34c3-4d2b-bd2f-e9faa642b1d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc535f8d-bdce-4fad-94ae-397e4a45b9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:02:41 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d963c1dc-34c3-4d2b-bd2f-e9faa642b1d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c94590b-b4f1-41e8-8bb6-891abdf072f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:02:41 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d963c1dc-34c3-4d2b-bd2f-e9faa642b1d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c94590b-b4f1-41e8-8bb6-891abdf072f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3607284c-ce07-4268-99de-21d5df580e59', 'volume_name': 'volume-3607284c-ce07-4268-99de-21d5df580e59', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:02:41 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d963c1dc-34c3-4d2b-bd2f-e9faa642b1d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94a004c4-45d3-4861-859b-d768a52276b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:02:41 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d963c1dc-34c3-4d2b-bd2f-e9faa642b1d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94a004c4-45d3-4861-859b-d768a52276b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:02:41 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d963c1dc-34c3-4d2b-bd2f-e9faa642b1d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ed5c375-cd7a-40ca-9368-66815212a6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:02:41 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-d963c1dc-34c3-4d2b-bd2f-e9faa642b1d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] Volume 3607284c-ce07-4268-99de-21d5df580e59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3607284c-ce07-4268-99de-21d5df580e59', 'volume_size': 1}
Nov 06 12:02:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d963c1dc-34c3-4d2b-bd2f-e9faa642b1d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:02:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d963c1dc-34c3-4d2b-bd2f-e9faa642b1d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:02:41 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-d963c1dc-34c3-4d2b-bd2f-e9faa642b1d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-140212807',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3607284c-ce07-4268-99de-21d5df580e59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34a2826eaaca4fb4895ad8dfae953d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:02:41Z,use_quota=True,user_id='4a171727261c4bf88fa316b74c3a31d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:02:41 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-d963c1dc-34c3-4d2b-bd2f-e9faa642b1d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] Creating volume 3607284c-ce07-4268-99de-21d5df580e59 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:02:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d963c1dc-34c3-4d2b-bd2f-e9faa642b1d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:02:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d963c1dc-34c3-4d2b-bd2f-e9faa642b1d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:02:41 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-d963c1dc-34c3-4d2b-bd2f-e9faa642b1d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:02:41 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-d963c1dc-34c3-4d2b-bd2f-e9faa642b1d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:02:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d963c1dc-34c3-4d2b-bd2f-e9faa642b1d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:02:41 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-d963c1dc-34c3-4d2b-bd2f-e9faa642b1d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:02:41 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-d963c1dc-34c3-4d2b-bd2f-e9faa642b1d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:02:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d963c1dc-34c3-4d2b-bd2f-e9faa642b1d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3607284c-ce07-4268-99de-21d5df580e59 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:02:41 devstack sudo[107337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3607284c-ce07-4268-99de-21d5df580e59 1073741824
Nov 06 12:02:41 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:02:41 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-23b4ce35-d423-44e0-bf4f-72f3ed7ed549 tempest-CreateVolumesFromSnapshotTest-232579978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:02:41 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-23b4ce35-d423-44e0-bf4f-72f3ed7ed549 tempest-CreateVolumesFromSnapshotTest-232579978 None] Flow 'volume_create_manager' (b7cb2c56-6d75-43df-9f33-ee1483aa771c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:02:41 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-23b4ce35-d423-44e0-bf4f-72f3ed7ed549 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05db1d1d-8ddc-4d19-b9d0-f536f9e3d7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:02:41 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-23b4ce35-d423-44e0-bf4f-72f3ed7ed549 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05db1d1d-8ddc-4d19-b9d0-f536f9e3d7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-474278295',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14ef51a1-ab1a-4ac7-a2d0-24ca516ea898,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34a2826eaaca4fb4895ad8dfae953d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:02:42Z,use_quota=True,user_id='4a171727261c4bf88fa316b74c3a31d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:02:41 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-23b4ce35-d423-44e0-bf4f-72f3ed7ed549 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b55b609c-29e2-405f-a4be-415da14ddcbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:02:41 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-23b4ce35-d423-44e0-bf4f-72f3ed7ed549 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b55b609c-29e2-405f-a4be-415da14ddcbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:02:41 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-23b4ce35-d423-44e0-bf4f-72f3ed7ed549 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (249951db-c530-4f7c-9e8c-fd046bb079f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:02:41 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-23b4ce35-d423-44e0-bf4f-72f3ed7ed549 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (249951db-c530-4f7c-9e8c-fd046bb079f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14ef51a1-ab1a-4ac7-a2d0-24ca516ea898', 'volume_name': 'volume-14ef51a1-ab1a-4ac7-a2d0-24ca516ea898', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:02:41 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-23b4ce35-d423-44e0-bf4f-72f3ed7ed549 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0426555b-7900-4f1e-952f-ee500a76a2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:02:41 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-23b4ce35-d423-44e0-bf4f-72f3ed7ed549 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0426555b-7900-4f1e-952f-ee500a76a2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:02:41 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-23b4ce35-d423-44e0-bf4f-72f3ed7ed549 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77ee1b1d-1e5c-474a-94da-ae324805ad31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:02:41 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-23b4ce35-d423-44e0-bf4f-72f3ed7ed549 tempest-CreateVolumesFromSnapshotTest-232579978 None] Volume 14ef51a1-ab1a-4ac7-a2d0-24ca516ea898: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14ef51a1-ab1a-4ac7-a2d0-24ca516ea898', 'volume_size': 1}
Nov 06 12:02:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-23b4ce35-d423-44e0-bf4f-72f3ed7ed549 tempest-CreateVolumesFromSnapshotTest-232579978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:02:41 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root
Nov 06 12:02:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d963c1dc-34c3-4d2b-bd2f-e9faa642b1d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3607284c-ce07-4268-99de-21d5df580e59 1073741824" returned: 0 in 0.488s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:02:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d963c1dc-34c3-4d2b-bd2f-e9faa642b1d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3607284c-ce07-4268-99de-21d5df580e59 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:02:41 devstack sudo[107343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3607284c-ce07-4268-99de-21d5df580e59
Nov 06 12:02:41 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-03dcfedd-d638-460a-b754-e021a83aca53 tempest-CreateVolumesFromSnapshotTest-232579978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-03dcfedd-d638-460a-b754-e021a83aca53 tempest-CreateVolumesFromSnapshotTest-232579978 None] Flow 'volume_create_manager' (435ccff3-c677-4eb7-b0c0-f185adf861ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-03dcfedd-d638-460a-b754-e021a83aca53 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d75b9dd-7cad-4cb6-b4b4-5c99e37d7313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-03dcfedd-d638-460a-b754-e021a83aca53 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d75b9dd-7cad-4cb6-b4b4-5c99e37d7313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1976290137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=274d5183-1b29-41db-bbdc-d173e0f64071,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34a2826eaaca4fb4895ad8dfae953d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:02:42Z,use_quota=True,user_id='4a171727261c4bf88fa316b74c3a31d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-03dcfedd-d638-460a-b754-e021a83aca53 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d07ffbb-bc10-4842-9cdf-c574845abfea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-03dcfedd-d638-460a-b754-e021a83aca53 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d07ffbb-bc10-4842-9cdf-c574845abfea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-03dcfedd-d638-460a-b754-e021a83aca53 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ead7ac6f-c90b-44f6-b81b-4f43fec16715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-03dcfedd-d638-460a-b754-e021a83aca53 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ead7ac6f-c90b-44f6-b81b-4f43fec16715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '274d5183-1b29-41db-bbdc-d173e0f64071', 'volume_name': 'volume-274d5183-1b29-41db-bbdc-d173e0f64071', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-03dcfedd-d638-460a-b754-e021a83aca53 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c23e34ad-f733-4e42-b815-0e51fe588dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-03dcfedd-d638-460a-b754-e021a83aca53 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c23e34ad-f733-4e42-b815-0e51fe588dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-03dcfedd-d638-460a-b754-e021a83aca53 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8bf14a6-6f07-497d-9a1a-1460fe2c0acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:02:42 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-03dcfedd-d638-460a-b754-e021a83aca53 tempest-CreateVolumesFromSnapshotTest-232579978 None] Volume 274d5183-1b29-41db-bbdc-d173e0f64071: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-274d5183-1b29-41db-bbdc-d173e0f64071', 'volume_size': 1}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-03dcfedd-d638-460a-b754-e021a83aca53 tempest-CreateVolumesFromSnapshotTest-232579978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:02:42 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d963c1dc-34c3-4d2b-bd2f-e9faa642b1d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3607284c-ce07-4268-99de-21d5df580e59" returned: 0 in 0.267s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-d963c1dc-34c3-4d2b-bd2f-e9faa642b1d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d963c1dc-34c3-4d2b-bd2f-e9faa642b1d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-23b4ce35-d423-44e0-bf4f-72f3ed7ed549 tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.437s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-23b4ce35-d423-44e0-bf4f-72f3ed7ed549 tempest-CreateVolumesFromSnapshotTest-232579978 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-474278295',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14ef51a1-ab1a-4ac7-a2d0-24ca516ea898,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34a2826eaaca4fb4895ad8dfae953d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:02:42Z,use_quota=True,user_id='4a171727261c4bf88fa316b74c3a31d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-23b4ce35-d423-44e0-bf4f-72f3ed7ed549 tempest-CreateVolumesFromSnapshotTest-232579978 None] Creating volume 14ef51a1-ab1a-4ac7-a2d0-24ca516ea898 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-23b4ce35-d423-44e0-bf4f-72f3ed7ed549 tempest-CreateVolumesFromSnapshotTest-232579978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-23b4ce35-d423-44e0-bf4f-72f3ed7ed549 tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-23b4ce35-d423-44e0-bf4f-72f3ed7ed549 tempest-CreateVolumesFromSnapshotTest-232579978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-23b4ce35-d423-44e0-bf4f-72f3ed7ed549 tempest-CreateVolumesFromSnapshotTest-232579978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-23b4ce35-d423-44e0-bf4f-72f3ed7ed549 tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-23b4ce35-d423-44e0-bf4f-72f3ed7ed549 tempest-CreateVolumesFromSnapshotTest-232579978 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:02:42 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-23b4ce35-d423-44e0-bf4f-72f3ed7ed549 tempest-CreateVolumesFromSnapshotTest-232579978 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-23b4ce35-d423-44e0-bf4f-72f3ed7ed549 tempest-CreateVolumesFromSnapshotTest-232579978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-14ef51a1-ab1a-4ac7-a2d0-24ca516ea898 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d963c1dc-34c3-4d2b-bd2f-e9faa642b1d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ed5c375-cd7a-40ca-9368-66815212a6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3607284c-ce07-4268-99de-21d5df580e59', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d963c1dc-34c3-4d2b-bd2f-e9faa642b1d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2452179-2d78-413f-8ea0-ed9b13b38506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:02:42 devstack sudo[107346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-14ef51a1-ab1a-4ac7-a2d0-24ca516ea898 1073741824
Nov 06 12:02:42 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:02:42 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-d963c1dc-34c3-4d2b-bd2f-e9faa642b1d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] Volume volume-3607284c-ce07-4268-99de-21d5df580e59 (3607284c-ce07-4268-99de-21d5df580e59): created successfully
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d963c1dc-34c3-4d2b-bd2f-e9faa642b1d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2452179-2d78-413f-8ea0-ed9b13b38506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-d963c1dc-34c3-4d2b-bd2f-e9faa642b1d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] Flow 'volume_create_manager' (3bae667d-056e-46c5-bf06-a6f726033c7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:02:42 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-d963c1dc-34c3-4d2b-bd2f-e9faa642b1d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] Created volume successfully.
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c78edd3-9b88-43d8-a403-9825da07004d tempest-CreateVolumesFromSnapshotTest-232579978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9c78edd3-9b88-43d8-a403-9825da07004d tempest-CreateVolumesFromSnapshotTest-232579978 None] Flow 'volume_create_manager' (f20d80b9-3444-41ee-afa5-e7943b2dc03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9c78edd3-9b88-43d8-a403-9825da07004d tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbb8852b-3e06-4e4c-bd57-f83e7a363b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9c78edd3-9b88-43d8-a403-9825da07004d tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbb8852b-3e06-4e4c-bd57-f83e7a363b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-606977069',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0ff0e62-5549-4f5d-973c-42123423e1ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34a2826eaaca4fb4895ad8dfae953d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:02:42Z,use_quota=True,user_id='4a171727261c4bf88fa316b74c3a31d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9c78edd3-9b88-43d8-a403-9825da07004d tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (497109db-4f10-49fa-a02e-ed2b5a719b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9c78edd3-9b88-43d8-a403-9825da07004d tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (497109db-4f10-49fa-a02e-ed2b5a719b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9c78edd3-9b88-43d8-a403-9825da07004d tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c02b8f50-1d4a-4f4e-b5bb-86ce1f3e247d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9c78edd3-9b88-43d8-a403-9825da07004d tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c02b8f50-1d4a-4f4e-b5bb-86ce1f3e247d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0ff0e62-5549-4f5d-973c-42123423e1ec', 'volume_name': 'volume-c0ff0e62-5549-4f5d-973c-42123423e1ec', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9c78edd3-9b88-43d8-a403-9825da07004d tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bdbb1d7-6c08-4723-b540-300f11a467c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9c78edd3-9b88-43d8-a403-9825da07004d tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bdbb1d7-6c08-4723-b540-300f11a467c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9c78edd3-9b88-43d8-a403-9825da07004d tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82d8390a-cdd4-4147-b8a4-81a0334c09b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:02:42 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-9c78edd3-9b88-43d8-a403-9825da07004d tempest-CreateVolumesFromSnapshotTest-232579978 None] Volume c0ff0e62-5549-4f5d-973c-42123423e1ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0ff0e62-5549-4f5d-973c-42123423e1ec', 'volume_size': 1}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9c78edd3-9b88-43d8-a403-9825da07004d tempest-CreateVolumesFromSnapshotTest-232579978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:02:42 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-23b4ce35-d423-44e0-bf4f-72f3ed7ed549 tempest-CreateVolumesFromSnapshotTest-232579978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-14ef51a1-ab1a-4ac7-a2d0-24ca516ea898 1073741824" returned: 0 in 0.531s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-23b4ce35-d423-44e0-bf4f-72f3ed7ed549 tempest-CreateVolumesFromSnapshotTest-232579978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-14ef51a1-ab1a-4ac7-a2d0-24ca516ea898 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:02:42 devstack sudo[107353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-14ef51a1-ab1a-4ac7-a2d0-24ca516ea898
Nov 06 12:02:42 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-0748869f-174b-47bb-b219-52e0a9ec0772 tempest-CreateVolumesFromSnapshotTest-232579978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-0748869f-174b-47bb-b219-52e0a9ec0772 tempest-CreateVolumesFromSnapshotTest-232579978 None] Flow 'volume_create_manager' (252a9e99-149e-4460-adde-7e5baa4bf613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-0748869f-174b-47bb-b219-52e0a9ec0772 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de145767-db80-48d4-aba2-125c4cbf96d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-0748869f-174b-47bb-b219-52e0a9ec0772 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de145767-db80-48d4-aba2-125c4cbf96d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-375923199',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d594b3f-08be-4a5d-ab60-f9af050b4669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34a2826eaaca4fb4895ad8dfae953d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:02:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:02:43Z,use_quota=True,user_id='4a171727261c4bf88fa316b74c3a31d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-0748869f-174b-47bb-b219-52e0a9ec0772 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b516378e-8dc1-4525-b8db-83aab7d8a305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-0748869f-174b-47bb-b219-52e0a9ec0772 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b516378e-8dc1-4525-b8db-83aab7d8a305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-0748869f-174b-47bb-b219-52e0a9ec0772 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19919cba-ca22-40de-8594-03719b17752b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-0748869f-174b-47bb-b219-52e0a9ec0772 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19919cba-ca22-40de-8594-03719b17752b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d594b3f-08be-4a5d-ab60-f9af050b4669', 'volume_name': 'volume-0d594b3f-08be-4a5d-ab60-f9af050b4669', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-0748869f-174b-47bb-b219-52e0a9ec0772 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3099d26d-e958-418e-b204-fc8d79b3a203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-0748869f-174b-47bb-b219-52e0a9ec0772 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3099d26d-e958-418e-b204-fc8d79b3a203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-0748869f-174b-47bb-b219-52e0a9ec0772 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c17841e2-5e16-4727-a08d-2194fa8b5af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:02:42 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-0748869f-174b-47bb-b219-52e0a9ec0772 tempest-CreateVolumesFromSnapshotTest-232579978 None] Volume 0d594b3f-08be-4a5d-ab60-f9af050b4669: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d594b3f-08be-4a5d-ab60-f9af050b4669', 'volume_size': 1}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-0748869f-174b-47bb-b219-52e0a9ec0772 tempest-CreateVolumesFromSnapshotTest-232579978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:02:42 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-23b4ce35-d423-44e0-bf4f-72f3ed7ed549 tempest-CreateVolumesFromSnapshotTest-232579978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-14ef51a1-ab1a-4ac7-a2d0-24ca516ea898" returned: 0 in 0.236s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-23b4ce35-d423-44e0-bf4f-72f3ed7ed549 tempest-CreateVolumesFromSnapshotTest-232579978 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-23b4ce35-d423-44e0-bf4f-72f3ed7ed549 tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-03dcfedd-d638-460a-b754-e021a83aca53 tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.873s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:02:42 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-03dcfedd-d638-460a-b754-e021a83aca53 tempest-CreateVolumesFromSnapshotTest-232579978 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1976290137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=274d5183-1b29-41db-bbdc-d173e0f64071,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34a2826eaaca4fb4895ad8dfae953d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:02:42Z,use_quota=True,user_id='4a171727261c4bf88fa316b74c3a31d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:02:43 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-03dcfedd-d638-460a-b754-e021a83aca53 tempest-CreateVolumesFromSnapshotTest-232579978 None] Creating volume 274d5183-1b29-41db-bbdc-d173e0f64071 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:02:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-03dcfedd-d638-460a-b754-e021a83aca53 tempest-CreateVolumesFromSnapshotTest-232579978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:02:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-03dcfedd-d638-460a-b754-e021a83aca53 tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:02:43 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-03dcfedd-d638-460a-b754-e021a83aca53 tempest-CreateVolumesFromSnapshotTest-232579978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:02:43 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-03dcfedd-d638-460a-b754-e021a83aca53 tempest-CreateVolumesFromSnapshotTest-232579978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:02:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-03dcfedd-d638-460a-b754-e021a83aca53 tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:02:43 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-03dcfedd-d638-460a-b754-e021a83aca53 tempest-CreateVolumesFromSnapshotTest-232579978 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:02:43 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-03dcfedd-d638-460a-b754-e021a83aca53 tempest-CreateVolumesFromSnapshotTest-232579978 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:02:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-03dcfedd-d638-460a-b754-e021a83aca53 tempest-CreateVolumesFromSnapshotTest-232579978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-274d5183-1b29-41db-bbdc-d173e0f64071 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:02:43 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-23b4ce35-d423-44e0-bf4f-72f3ed7ed549 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77ee1b1d-1e5c-474a-94da-ae324805ad31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14ef51a1-ab1a-4ac7-a2d0-24ca516ea898', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:02:43 devstack sudo[107356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-274d5183-1b29-41db-bbdc-d173e0f64071 1073741824
Nov 06 12:02:43 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-23b4ce35-d423-44e0-bf4f-72f3ed7ed549 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab40442b-e581-4534-b14f-d95ccd3ba3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:02:43 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:02:43 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-23b4ce35-d423-44e0-bf4f-72f3ed7ed549 tempest-CreateVolumesFromSnapshotTest-232579978 None] Volume volume-14ef51a1-ab1a-4ac7-a2d0-24ca516ea898 (14ef51a1-ab1a-4ac7-a2d0-24ca516ea898): created successfully
Nov 06 12:02:43 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-23b4ce35-d423-44e0-bf4f-72f3ed7ed549 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab40442b-e581-4534-b14f-d95ccd3ba3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:02:43 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-23b4ce35-d423-44e0-bf4f-72f3ed7ed549 tempest-CreateVolumesFromSnapshotTest-232579978 None] Flow 'volume_create_manager' (b7cb2c56-6d75-43df-9f33-ee1483aa771c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:02:43 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-23b4ce35-d423-44e0-bf4f-72f3ed7ed549 tempest-CreateVolumesFromSnapshotTest-232579978 None] Created volume successfully.
Nov 06 12:02:43 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root
Nov 06 12:02:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-03dcfedd-d638-460a-b754-e021a83aca53 tempest-CreateVolumesFromSnapshotTest-232579978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-274d5183-1b29-41db-bbdc-d173e0f64071 1073741824" returned: 0 in 0.399s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:02:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-03dcfedd-d638-460a-b754-e021a83aca53 tempest-CreateVolumesFromSnapshotTest-232579978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-274d5183-1b29-41db-bbdc-d173e0f64071 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:02:43 devstack sudo[107362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-274d5183-1b29-41db-bbdc-d173e0f64071
Nov 06 12:02:43 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:02:43 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root
Nov 06 12:02:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-03dcfedd-d638-460a-b754-e021a83aca53 tempest-CreateVolumesFromSnapshotTest-232579978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-274d5183-1b29-41db-bbdc-d173e0f64071" returned: 0 in 0.271s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:02:43 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-03dcfedd-d638-460a-b754-e021a83aca53 tempest-CreateVolumesFromSnapshotTest-232579978 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:02:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-03dcfedd-d638-460a-b754-e021a83aca53 tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:02:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9c78edd3-9b88-43d8-a403-9825da07004d tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.186s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:02:43 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-9c78edd3-9b88-43d8-a403-9825da07004d tempest-CreateVolumesFromSnapshotTest-232579978 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-606977069',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0ff0e62-5549-4f5d-973c-42123423e1ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34a2826eaaca4fb4895ad8dfae953d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:02:42Z,use_quota=True,user_id='4a171727261c4bf88fa316b74c3a31d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:02:43 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-9c78edd3-9b88-43d8-a403-9825da07004d tempest-CreateVolumesFromSnapshotTest-232579978 None] Creating volume c0ff0e62-5549-4f5d-973c-42123423e1ec {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:02:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9c78edd3-9b88-43d8-a403-9825da07004d tempest-CreateVolumesFromSnapshotTest-232579978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:02:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9c78edd3-9b88-43d8-a403-9825da07004d tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:02:43 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-9c78edd3-9b88-43d8-a403-9825da07004d tempest-CreateVolumesFromSnapshotTest-232579978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:02:43 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-9c78edd3-9b88-43d8-a403-9825da07004d tempest-CreateVolumesFromSnapshotTest-232579978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:02:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9c78edd3-9b88-43d8-a403-9825da07004d tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:02:43 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-9c78edd3-9b88-43d8-a403-9825da07004d tempest-CreateVolumesFromSnapshotTest-232579978 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:02:43 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-9c78edd3-9b88-43d8-a403-9825da07004d tempest-CreateVolumesFromSnapshotTest-232579978 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:02:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9c78edd3-9b88-43d8-a403-9825da07004d tempest-CreateVolumesFromSnapshotTest-232579978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c0ff0e62-5549-4f5d-973c-42123423e1ec 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:02:43 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-03dcfedd-d638-460a-b754-e021a83aca53 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8bf14a6-6f07-497d-9a1a-1460fe2c0acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-274d5183-1b29-41db-bbdc-d173e0f64071', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:02:43 devstack sudo[107365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c0ff0e62-5549-4f5d-973c-42123423e1ec 1073741824
Nov 06 12:02:43 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:02:43 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-03dcfedd-d638-460a-b754-e021a83aca53 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c2ace48-7868-4f58-acf8-23746f8a3bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:02:43 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-03dcfedd-d638-460a-b754-e021a83aca53 tempest-CreateVolumesFromSnapshotTest-232579978 None] Volume volume-274d5183-1b29-41db-bbdc-d173e0f64071 (274d5183-1b29-41db-bbdc-d173e0f64071): created successfully
Nov 06 12:02:43 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-03dcfedd-d638-460a-b754-e021a83aca53 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c2ace48-7868-4f58-acf8-23746f8a3bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:02:43 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-03dcfedd-d638-460a-b754-e021a83aca53 tempest-CreateVolumesFromSnapshotTest-232579978 None] Flow 'volume_create_manager' (435ccff3-c677-4eb7-b0c0-f185adf861ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:02:43 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-03dcfedd-d638-460a-b754-e021a83aca53 tempest-CreateVolumesFromSnapshotTest-232579978 None] Created volume successfully.
Nov 06 12:02:44 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root
Nov 06 12:02:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9c78edd3-9b88-43d8-a403-9825da07004d tempest-CreateVolumesFromSnapshotTest-232579978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c0ff0e62-5549-4f5d-973c-42123423e1ec 1073741824" returned: 0 in 0.433s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:02:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9c78edd3-9b88-43d8-a403-9825da07004d tempest-CreateVolumesFromSnapshotTest-232579978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c0ff0e62-5549-4f5d-973c-42123423e1ec {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:02:44 devstack sudo[107371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c0ff0e62-5549-4f5d-973c-42123423e1ec
Nov 06 12:02:44 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:02:44 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root
Nov 06 12:02:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9c78edd3-9b88-43d8-a403-9825da07004d tempest-CreateVolumesFromSnapshotTest-232579978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c0ff0e62-5549-4f5d-973c-42123423e1ec" returned: 0 in 0.225s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:02:44 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-9c78edd3-9b88-43d8-a403-9825da07004d tempest-CreateVolumesFromSnapshotTest-232579978 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:02:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9c78edd3-9b88-43d8-a403-9825da07004d tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:02:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-0748869f-174b-47bb-b219-52e0a9ec0772 tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.531s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:02:44 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-0748869f-174b-47bb-b219-52e0a9ec0772 tempest-CreateVolumesFromSnapshotTest-232579978 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-375923199',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d594b3f-08be-4a5d-ab60-f9af050b4669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34a2826eaaca4fb4895ad8dfae953d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:02:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:02:43Z,use_quota=True,user_id='4a171727261c4bf88fa316b74c3a31d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:02:44 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-0748869f-174b-47bb-b219-52e0a9ec0772 tempest-CreateVolumesFromSnapshotTest-232579978 None] Creating volume 0d594b3f-08be-4a5d-ab60-f9af050b4669 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:02:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-0748869f-174b-47bb-b219-52e0a9ec0772 tempest-CreateVolumesFromSnapshotTest-232579978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:02:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-0748869f-174b-47bb-b219-52e0a9ec0772 tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:02:44 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-0748869f-174b-47bb-b219-52e0a9ec0772 tempest-CreateVolumesFromSnapshotTest-232579978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:02:44 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-0748869f-174b-47bb-b219-52e0a9ec0772 tempest-CreateVolumesFromSnapshotTest-232579978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:02:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-0748869f-174b-47bb-b219-52e0a9ec0772 tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:02:44 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-0748869f-174b-47bb-b219-52e0a9ec0772 tempest-CreateVolumesFromSnapshotTest-232579978 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:02:44 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-0748869f-174b-47bb-b219-52e0a9ec0772 tempest-CreateVolumesFromSnapshotTest-232579978 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:02:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0748869f-174b-47bb-b219-52e0a9ec0772 tempest-CreateVolumesFromSnapshotTest-232579978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0d594b3f-08be-4a5d-ab60-f9af050b4669 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:02:44 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9c78edd3-9b88-43d8-a403-9825da07004d tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82d8390a-cdd4-4147-b8a4-81a0334c09b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0ff0e62-5549-4f5d-973c-42123423e1ec', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:02:44 devstack sudo[107374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0d594b3f-08be-4a5d-ab60-f9af050b4669 1073741824
Nov 06 12:02:44 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:02:44 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9c78edd3-9b88-43d8-a403-9825da07004d tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91c4ee7c-3507-415f-ad66-cf862cf04d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:02:44 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-9c78edd3-9b88-43d8-a403-9825da07004d tempest-CreateVolumesFromSnapshotTest-232579978 None] Volume volume-c0ff0e62-5549-4f5d-973c-42123423e1ec (c0ff0e62-5549-4f5d-973c-42123423e1ec): created successfully
Nov 06 12:02:44 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9c78edd3-9b88-43d8-a403-9825da07004d tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91c4ee7c-3507-415f-ad66-cf862cf04d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:02:44 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9c78edd3-9b88-43d8-a403-9825da07004d tempest-CreateVolumesFromSnapshotTest-232579978 None] Flow 'volume_create_manager' (f20d80b9-3444-41ee-afa5-e7943b2dc03d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:02:44 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-9c78edd3-9b88-43d8-a403-9825da07004d tempest-CreateVolumesFromSnapshotTest-232579978 None] Created volume successfully.
Nov 06 12:02:44 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root
Nov 06 12:02:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0748869f-174b-47bb-b219-52e0a9ec0772 tempest-CreateVolumesFromSnapshotTest-232579978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0d594b3f-08be-4a5d-ab60-f9af050b4669 1073741824" returned: 0 in 0.387s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:02:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0748869f-174b-47bb-b219-52e0a9ec0772 tempest-CreateVolumesFromSnapshotTest-232579978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0d594b3f-08be-4a5d-ab60-f9af050b4669 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:02:44 devstack sudo[107380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0d594b3f-08be-4a5d-ab60-f9af050b4669
Nov 06 12:02:44 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:02:45 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root
Nov 06 12:02:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0748869f-174b-47bb-b219-52e0a9ec0772 tempest-CreateVolumesFromSnapshotTest-232579978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0d594b3f-08be-4a5d-ab60-f9af050b4669" returned: 0 in 0.235s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:02:45 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-0748869f-174b-47bb-b219-52e0a9ec0772 tempest-CreateVolumesFromSnapshotTest-232579978 None] <== create_volume: return (658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:02:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-0748869f-174b-47bb-b219-52e0a9ec0772 tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.662s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:02:45 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-0748869f-174b-47bb-b219-52e0a9ec0772 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c17841e2-5e16-4727-a08d-2194fa8b5af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d594b3f-08be-4a5d-ab60-f9af050b4669', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:02:45 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-0748869f-174b-47bb-b219-52e0a9ec0772 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b9a6376-15d2-4ef1-a3f3-5536f3cf0155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:02:45 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-0748869f-174b-47bb-b219-52e0a9ec0772 tempest-CreateVolumesFromSnapshotTest-232579978 None] Volume volume-0d594b3f-08be-4a5d-ab60-f9af050b4669 (0d594b3f-08be-4a5d-ab60-f9af050b4669): created successfully
Nov 06 12:02:45 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-0748869f-174b-47bb-b219-52e0a9ec0772 tempest-CreateVolumesFromSnapshotTest-232579978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b9a6376-15d2-4ef1-a3f3-5536f3cf0155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:02:45 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-0748869f-174b-47bb-b219-52e0a9ec0772 tempest-CreateVolumesFromSnapshotTest-232579978 None] Flow 'volume_create_manager' (252a9e99-149e-4460-adde-7e5baa4bf613) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:02:45 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-0748869f-174b-47bb-b219-52e0a9ec0772 tempest-CreateVolumesFromSnapshotTest-232579978 None] Created volume successfully.
Nov 06 12:02:46 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-1e4d2850-d335-4710-902e-292e6559f37c tempest-CreateVolumesFromSnapshotTest-232579978 None] Acquiring lock "cinder-0d594b3f-08be-4a5d-ab60-f9af050b4669-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:02:46 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-1e4d2850-d335-4710-902e-292e6559f37c tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "cinder-0d594b3f-08be-4a5d-ab60-f9af050b4669-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:02:46 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-1e4d2850-d335-4710-902e-292e6559f37c tempest-CreateVolumesFromSnapshotTest-232579978 None] Acquiring lock "cinder-quobyte-0d594b3f-08be-4a5d-ab60-f9af050b4669" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:02:46 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-1e4d2850-d335-4710-902e-292e6559f37c tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "cinder-quobyte-0d594b3f-08be-4a5d-ab60-f9af050b4669" acquired by "delete_volume" :: waited 0.015s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:02:46 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5944d252-f108-4303-a818-3172b4f2087d]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:02:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1e4d2850-d335-4710-902e-292e6559f37c tempest-CreateVolumesFromSnapshotTest-232579978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0d594b3f-08be-4a5d-ab60-f9af050b4669 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:02:46 devstack sudo[107386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0d594b3f-08be-4a5d-ab60-f9af050b4669
Nov 06 12:02:46 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:02:46 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root
Nov 06 12:02:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1e4d2850-d335-4710-902e-292e6559f37c tempest-CreateVolumesFromSnapshotTest-232579978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0d594b3f-08be-4a5d-ab60-f9af050b4669" returned: 0 in 0.345s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:02:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1e4d2850-d335-4710-902e-292e6559f37c tempest-CreateVolumesFromSnapshotTest-232579978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0d594b3f-08be-4a5d-ab60-f9af050b4669 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:02:46 devstack sudo[107391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0d594b3f-08be-4a5d-ab60-f9af050b4669
Nov 06 12:02:46 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:02:46 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root
Nov 06 12:02:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1e4d2850-d335-4710-902e-292e6559f37c tempest-CreateVolumesFromSnapshotTest-232579978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0d594b3f-08be-4a5d-ab60-f9af050b4669" returned: 0 in 0.231s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:02:46 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-1e4d2850-d335-4710-902e-292e6559f37c tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "cinder-quobyte-0d594b3f-08be-4a5d-ab60-f9af050b4669" released by "delete_volume" :: held 0.618s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:02:46 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-1e4d2850-d335-4710-902e-292e6559f37c tempest-CreateVolumesFromSnapshotTest-232579978 None] Created reservations ['01947e62-9e7c-47b9-a21c-9f8289878a72', '01b39d41-b6b6-41f6-b1d8-5a8f8807e2a2', 'e5383a50-2cfd-44ef-b624-cdbc6f366977', '1efe4e7d-9dbc-42e6-9adb-d4f686736e8a'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:02:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-1e4d2850-d335-4710-902e-292e6559f37c tempest-CreateVolumesFromSnapshotTest-232579978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:02:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-1e4d2850-d335-4710-902e-292e6559f37c tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:02:46 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-1e4d2850-d335-4710-902e-292e6559f37c tempest-CreateVolumesFromSnapshotTest-232579978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:02:46 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-1e4d2850-d335-4710-902e-292e6559f37c tempest-CreateVolumesFromSnapshotTest-232579978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:02:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-1e4d2850-d335-4710-902e-292e6559f37c tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:02:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1e4d2850-d335-4710-902e-292e6559f37c tempest-CreateVolumesFromSnapshotTest-232579978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:02:46 devstack sudo[107394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:02:46 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:02:47 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root
Nov 06 12:02:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-1e4d2850-d335-4710-902e-292e6559f37c tempest-CreateVolumesFromSnapshotTest-232579978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.235s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:02:47 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-1e4d2850-d335-4710-902e-292e6559f37c tempest-CreateVolumesFromSnapshotTest-232579978 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:02:47 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-1e4d2850-d335-4710-902e-292e6559f37c tempest-CreateVolumesFromSnapshotTest-232579978 None] Deleted volume successfully.
Nov 06 12:02:47 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-1e4d2850-d335-4710-902e-292e6559f37c tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "cinder-0d594b3f-08be-4a5d-ab60-f9af050b4669-delete_volume" released by "delete_volume" :: held 1.048s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:02:47 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-8715f9f4-969a-4ed0-8835-ac4559364948 tempest-CreateVolumesFromSnapshotTest-232579978 None] Acquiring lock "cinder-c0ff0e62-5549-4f5d-973c-42123423e1ec-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:02:47 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-8715f9f4-969a-4ed0-8835-ac4559364948 tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "cinder-c0ff0e62-5549-4f5d-973c-42123423e1ec-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:02:47 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-8715f9f4-969a-4ed0-8835-ac4559364948 tempest-CreateVolumesFromSnapshotTest-232579978 None] Acquiring lock "cinder-quobyte-c0ff0e62-5549-4f5d-973c-42123423e1ec" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:02:47 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-8715f9f4-969a-4ed0-8835-ac4559364948 tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "cinder-quobyte-c0ff0e62-5549-4f5d-973c-42123423e1ec" acquired by "delete_volume" :: waited 0.014s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:02:47 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[54599768-2087-48d6-9123-7be65c5dbcea]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:02:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-8715f9f4-969a-4ed0-8835-ac4559364948 tempest-CreateVolumesFromSnapshotTest-232579978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c0ff0e62-5549-4f5d-973c-42123423e1ec {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:02:47 devstack sudo[107397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c0ff0e62-5549-4f5d-973c-42123423e1ec
Nov 06 12:02:47 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:02:47 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root
Nov 06 12:02:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-8715f9f4-969a-4ed0-8835-ac4559364948 tempest-CreateVolumesFromSnapshotTest-232579978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c0ff0e62-5549-4f5d-973c-42123423e1ec" returned: 0 in 0.363s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:02:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-8715f9f4-969a-4ed0-8835-ac4559364948 tempest-CreateVolumesFromSnapshotTest-232579978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c0ff0e62-5549-4f5d-973c-42123423e1ec {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:02:47 devstack sudo[107402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c0ff0e62-5549-4f5d-973c-42123423e1ec
Nov 06 12:02:47 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:02:48 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root
Nov 06 12:02:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-8715f9f4-969a-4ed0-8835-ac4559364948 tempest-CreateVolumesFromSnapshotTest-232579978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c0ff0e62-5549-4f5d-973c-42123423e1ec" returned: 0 in 0.270s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:02:48 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-8715f9f4-969a-4ed0-8835-ac4559364948 tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "cinder-quobyte-c0ff0e62-5549-4f5d-973c-42123423e1ec" released by "delete_volume" :: held 0.671s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:02:48 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-8715f9f4-969a-4ed0-8835-ac4559364948 tempest-CreateVolumesFromSnapshotTest-232579978 None] Created reservations ['6dd406ce-98c9-4e90-9524-e4ef786885aa', '086714d3-d384-492e-be25-f2d9dd38b502', 'd155ed8f-96cc-46b3-a52f-2405f6baa86e', '3b35fc30-0268-4c23-bbba-7e10222cf78f'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:02:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-8715f9f4-969a-4ed0-8835-ac4559364948 tempest-CreateVolumesFromSnapshotTest-232579978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:02:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-8715f9f4-969a-4ed0-8835-ac4559364948 tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:02:48 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-8715f9f4-969a-4ed0-8835-ac4559364948 tempest-CreateVolumesFromSnapshotTest-232579978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:02:48 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-8715f9f4-969a-4ed0-8835-ac4559364948 tempest-CreateVolumesFromSnapshotTest-232579978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:02:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-8715f9f4-969a-4ed0-8835-ac4559364948 tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:02:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-8715f9f4-969a-4ed0-8835-ac4559364948 tempest-CreateVolumesFromSnapshotTest-232579978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:02:48 devstack sudo[107405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:02:48 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:02:48 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root
Nov 06 12:02:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-8715f9f4-969a-4ed0-8835-ac4559364948 tempest-CreateVolumesFromSnapshotTest-232579978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.232s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:02:48 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-8715f9f4-969a-4ed0-8835-ac4559364948 tempest-CreateVolumesFromSnapshotTest-232579978 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:02:48 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-8715f9f4-969a-4ed0-8835-ac4559364948 tempest-CreateVolumesFromSnapshotTest-232579978 None] Deleted volume successfully.
Nov 06 12:02:48 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-8715f9f4-969a-4ed0-8835-ac4559364948 tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "cinder-c0ff0e62-5549-4f5d-973c-42123423e1ec-delete_volume" released by "delete_volume" :: held 1.085s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:02:48 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-180ed232-118c-4b3b-9edf-f7ad630557d1 tempest-CreateVolumesFromSnapshotTest-232579978 None] Acquiring lock "cinder-274d5183-1b29-41db-bbdc-d173e0f64071-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:02:48 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-180ed232-118c-4b3b-9edf-f7ad630557d1 tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "cinder-274d5183-1b29-41db-bbdc-d173e0f64071-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:02:48 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-180ed232-118c-4b3b-9edf-f7ad630557d1 tempest-CreateVolumesFromSnapshotTest-232579978 None] Acquiring lock "cinder-quobyte-274d5183-1b29-41db-bbdc-d173e0f64071" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:02:48 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-180ed232-118c-4b3b-9edf-f7ad630557d1 tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "cinder-quobyte-274d5183-1b29-41db-bbdc-d173e0f64071" acquired by "delete_volume" :: waited 0.016s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:02:48 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[623c7101-9773-499c-8a08-08149e2d1af4]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:02:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-180ed232-118c-4b3b-9edf-f7ad630557d1 tempest-CreateVolumesFromSnapshotTest-232579978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-274d5183-1b29-41db-bbdc-d173e0f64071 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:02:48 devstack sudo[107408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-274d5183-1b29-41db-bbdc-d173e0f64071
Nov 06 12:02:48 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:02:48 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root
Nov 06 12:02:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-180ed232-118c-4b3b-9edf-f7ad630557d1 tempest-CreateVolumesFromSnapshotTest-232579978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-274d5183-1b29-41db-bbdc-d173e0f64071" returned: 0 in 0.384s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:02:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-180ed232-118c-4b3b-9edf-f7ad630557d1 tempest-CreateVolumesFromSnapshotTest-232579978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-274d5183-1b29-41db-bbdc-d173e0f64071 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:02:48 devstack sudo[107413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-274d5183-1b29-41db-bbdc-d173e0f64071
Nov 06 12:02:48 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:02:49 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root
Nov 06 12:02:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-180ed232-118c-4b3b-9edf-f7ad630557d1 tempest-CreateVolumesFromSnapshotTest-232579978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-274d5183-1b29-41db-bbdc-d173e0f64071" returned: 0 in 0.239s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:02:49 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-180ed232-118c-4b3b-9edf-f7ad630557d1 tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "cinder-quobyte-274d5183-1b29-41db-bbdc-d173e0f64071" released by "delete_volume" :: held 0.663s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:02:49 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-180ed232-118c-4b3b-9edf-f7ad630557d1 tempest-CreateVolumesFromSnapshotTest-232579978 None] Created reservations ['c17a30c6-15d8-4463-83e7-75bc3e3f2607', '44449452-84bd-4dae-81b5-5ba8c94dc473', 'e7dd6c5d-36c4-4da4-a89d-e9895cf8e9c2', '5a7a31f5-9636-4e8a-afcf-02f6586cdbc3'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:02:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-180ed232-118c-4b3b-9edf-f7ad630557d1 tempest-CreateVolumesFromSnapshotTest-232579978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:02:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-180ed232-118c-4b3b-9edf-f7ad630557d1 tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:02:49 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-180ed232-118c-4b3b-9edf-f7ad630557d1 tempest-CreateVolumesFromSnapshotTest-232579978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:02:49 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-180ed232-118c-4b3b-9edf-f7ad630557d1 tempest-CreateVolumesFromSnapshotTest-232579978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:02:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-180ed232-118c-4b3b-9edf-f7ad630557d1 tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:02:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-180ed232-118c-4b3b-9edf-f7ad630557d1 tempest-CreateVolumesFromSnapshotTest-232579978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:02:49 devstack sudo[107416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:02:49 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:02:49 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root
Nov 06 12:02:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-180ed232-118c-4b3b-9edf-f7ad630557d1 tempest-CreateVolumesFromSnapshotTest-232579978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.246s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:02:49 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-180ed232-118c-4b3b-9edf-f7ad630557d1 tempest-CreateVolumesFromSnapshotTest-232579978 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:02:49 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-180ed232-118c-4b3b-9edf-f7ad630557d1 tempest-CreateVolumesFromSnapshotTest-232579978 None] Deleted volume successfully.
Nov 06 12:02:49 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-44d588cf-4ce6-40a4-9b9d-f35eff22b46e tempest-CreateVolumesFromSnapshotTest-232579978 None] Acquiring lock "cinder-14ef51a1-ab1a-4ac7-a2d0-24ca516ea898-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:02:49 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-180ed232-118c-4b3b-9edf-f7ad630557d1 tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "cinder-274d5183-1b29-41db-bbdc-d173e0f64071-delete_volume" released by "delete_volume" :: held 1.154s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:02:49 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-44d588cf-4ce6-40a4-9b9d-f35eff22b46e tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "cinder-14ef51a1-ab1a-4ac7-a2d0-24ca516ea898-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:02:49 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-44d588cf-4ce6-40a4-9b9d-f35eff22b46e tempest-CreateVolumesFromSnapshotTest-232579978 None] Acquiring lock "cinder-quobyte-14ef51a1-ab1a-4ac7-a2d0-24ca516ea898" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:02:49 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-44d588cf-4ce6-40a4-9b9d-f35eff22b46e tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "cinder-quobyte-14ef51a1-ab1a-4ac7-a2d0-24ca516ea898" acquired by "delete_volume" :: waited 0.019s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:02:49 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf193a1-19c1-4cd4-a750-198666376790]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:02:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-44d588cf-4ce6-40a4-9b9d-f35eff22b46e tempest-CreateVolumesFromSnapshotTest-232579978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-14ef51a1-ab1a-4ac7-a2d0-24ca516ea898 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:02:49 devstack sudo[107419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-14ef51a1-ab1a-4ac7-a2d0-24ca516ea898
Nov 06 12:02:49 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:02:50 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root
Nov 06 12:02:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-44d588cf-4ce6-40a4-9b9d-f35eff22b46e tempest-CreateVolumesFromSnapshotTest-232579978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-14ef51a1-ab1a-4ac7-a2d0-24ca516ea898" returned: 0 in 0.350s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:02:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-44d588cf-4ce6-40a4-9b9d-f35eff22b46e tempest-CreateVolumesFromSnapshotTest-232579978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-14ef51a1-ab1a-4ac7-a2d0-24ca516ea898 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:02:50 devstack sudo[107424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-14ef51a1-ab1a-4ac7-a2d0-24ca516ea898
Nov 06 12:02:50 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:02:50 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root
Nov 06 12:02:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-44d588cf-4ce6-40a4-9b9d-f35eff22b46e tempest-CreateVolumesFromSnapshotTest-232579978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-14ef51a1-ab1a-4ac7-a2d0-24ca516ea898" returned: 0 in 0.230s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:02:50 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-44d588cf-4ce6-40a4-9b9d-f35eff22b46e tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "cinder-quobyte-14ef51a1-ab1a-4ac7-a2d0-24ca516ea898" released by "delete_volume" :: held 0.621s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:02:50 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-44d588cf-4ce6-40a4-9b9d-f35eff22b46e tempest-CreateVolumesFromSnapshotTest-232579978 None] Created reservations ['246f41de-ba3e-4011-b122-af16be70df9b', '087d8c93-d9dc-4a5c-96f1-cb5c3d441385', 'e162c8dc-6871-433f-b615-93d16ca12a3c', '87bd9f87-709b-4db4-a0a6-01421d019266'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:02:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-44d588cf-4ce6-40a4-9b9d-f35eff22b46e tempest-CreateVolumesFromSnapshotTest-232579978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:02:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-44d588cf-4ce6-40a4-9b9d-f35eff22b46e tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:02:50 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-44d588cf-4ce6-40a4-9b9d-f35eff22b46e tempest-CreateVolumesFromSnapshotTest-232579978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:02:50 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-44d588cf-4ce6-40a4-9b9d-f35eff22b46e tempest-CreateVolumesFromSnapshotTest-232579978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:02:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-44d588cf-4ce6-40a4-9b9d-f35eff22b46e tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:02:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-44d588cf-4ce6-40a4-9b9d-f35eff22b46e tempest-CreateVolumesFromSnapshotTest-232579978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:02:50 devstack sudo[107427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:02:50 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:02:50 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root
Nov 06 12:02:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-44d588cf-4ce6-40a4-9b9d-f35eff22b46e tempest-CreateVolumesFromSnapshotTest-232579978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.235s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:02:50 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-44d588cf-4ce6-40a4-9b9d-f35eff22b46e tempest-CreateVolumesFromSnapshotTest-232579978 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:02:50 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-44d588cf-4ce6-40a4-9b9d-f35eff22b46e tempest-CreateVolumesFromSnapshotTest-232579978 None] Deleted volume successfully.
Nov 06 12:02:50 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-44d588cf-4ce6-40a4-9b9d-f35eff22b46e tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "cinder-14ef51a1-ab1a-4ac7-a2d0-24ca516ea898-delete_volume" released by "delete_volume" :: held 1.042s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:02:50 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-4deb919b-2408-4b69-af93-fb009ec486fd tempest-CreateVolumesFromSnapshotTest-232579978 None] Acquiring lock "cinder-3607284c-ce07-4268-99de-21d5df580e59-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:02:50 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-4deb919b-2408-4b69-af93-fb009ec486fd tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "cinder-3607284c-ce07-4268-99de-21d5df580e59-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:02:50 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-4deb919b-2408-4b69-af93-fb009ec486fd tempest-CreateVolumesFromSnapshotTest-232579978 None] Acquiring lock "cinder-quobyte-3607284c-ce07-4268-99de-21d5df580e59" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:02:50 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-4deb919b-2408-4b69-af93-fb009ec486fd tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "cinder-quobyte-3607284c-ce07-4268-99de-21d5df580e59" acquired by "delete_volume" :: waited 0.016s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:02:50 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[762d0719-54b1-4850-bb81-276c720549d5]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:02:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4deb919b-2408-4b69-af93-fb009ec486fd tempest-CreateVolumesFromSnapshotTest-232579978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3607284c-ce07-4268-99de-21d5df580e59 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:02:50 devstack sudo[107430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3607284c-ce07-4268-99de-21d5df580e59
Nov 06 12:02:50 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:02:51 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root
Nov 06 12:02:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4deb919b-2408-4b69-af93-fb009ec486fd tempest-CreateVolumesFromSnapshotTest-232579978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3607284c-ce07-4268-99de-21d5df580e59" returned: 0 in 0.353s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:02:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4deb919b-2408-4b69-af93-fb009ec486fd tempest-CreateVolumesFromSnapshotTest-232579978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3607284c-ce07-4268-99de-21d5df580e59 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:02:51 devstack sudo[107435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3607284c-ce07-4268-99de-21d5df580e59
Nov 06 12:02:51 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:02:51 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root
Nov 06 12:02:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4deb919b-2408-4b69-af93-fb009ec486fd tempest-CreateVolumesFromSnapshotTest-232579978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3607284c-ce07-4268-99de-21d5df580e59" returned: 0 in 0.230s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:02:51 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-4deb919b-2408-4b69-af93-fb009ec486fd tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "cinder-quobyte-3607284c-ce07-4268-99de-21d5df580e59" released by "delete_volume" :: held 0.621s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:02:51 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-4deb919b-2408-4b69-af93-fb009ec486fd tempest-CreateVolumesFromSnapshotTest-232579978 None] Created reservations ['f53295ba-b690-4090-b97e-40bda9710d0f', 'a9bf604a-65dc-4b37-bf9a-5d63b0f2ae55', '12d4dbee-2e16-4833-8132-c1a276824fe2', '882df311-05d7-4883-b739-d2c345083ed0'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:02:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4deb919b-2408-4b69-af93-fb009ec486fd tempest-CreateVolumesFromSnapshotTest-232579978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:02:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4deb919b-2408-4b69-af93-fb009ec486fd tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:02:51 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-4deb919b-2408-4b69-af93-fb009ec486fd tempest-CreateVolumesFromSnapshotTest-232579978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:02:51 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-4deb919b-2408-4b69-af93-fb009ec486fd tempest-CreateVolumesFromSnapshotTest-232579978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:02:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4deb919b-2408-4b69-af93-fb009ec486fd tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:02:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4deb919b-2408-4b69-af93-fb009ec486fd tempest-CreateVolumesFromSnapshotTest-232579978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:02:51 devstack sudo[107438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:02:51 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:02:51 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root
Nov 06 12:02:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4deb919b-2408-4b69-af93-fb009ec486fd tempest-CreateVolumesFromSnapshotTest-232579978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.235s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:02:51 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-4deb919b-2408-4b69-af93-fb009ec486fd tempest-CreateVolumesFromSnapshotTest-232579978 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:02:51 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-4deb919b-2408-4b69-af93-fb009ec486fd tempest-CreateVolumesFromSnapshotTest-232579978 None] Deleted volume successfully.
Nov 06 12:02:51 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-4deb919b-2408-4b69-af93-fb009ec486fd tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "cinder-3607284c-ce07-4268-99de-21d5df580e59-delete_volume" released by "delete_volume" :: held 1.044s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:02:51 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e82a616b-643b-40d2-a19c-e5ecde8094d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] Acquiring lock "cinder-0b635971-d23f-4b1f-9b03-9d0cdf330dcb-delete_snapshot" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:02:51 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e82a616b-643b-40d2-a19c-e5ecde8094d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "cinder-0b635971-d23f-4b1f-9b03-9d0cdf330dcb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:02:51 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e82a616b-643b-40d2-a19c-e5ecde8094d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] Acquiring lock "cinder-quobyte-a510f37c-17f0-4035-ba2e-65c3fa8a504d" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:02:51 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e82a616b-643b-40d2-a19c-e5ecde8094d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "cinder-quobyte-a510f37c-17f0-4035-ba2e-65c3fa8a504d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:02:51 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e82a616b-643b-40d2-a19c-e5ecde8094d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] Acquiring lock "cinder-quobyte-0b635971-d23f-4b1f-9b03-9d0cdf330dcb" by "_delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:02:51 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e82a616b-643b-40d2-a19c-e5ecde8094d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "cinder-quobyte-0b635971-d23f-4b1f-9b03-9d0cdf330dcb" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:02:51 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-e82a616b-643b-40d2-a19c-e5ecde8094d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] Deleting offline snapshot 0b635971-d23f-4b1f-9b03-9d0cdf330dcb of volume a510f37c-17f0-4035-ba2e-65c3fa8a504d {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 12:02:51 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-e82a616b-643b-40d2-a19c-e5ecde8094d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] snapshot_file for this snap is: volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d.0b635971-d23f-4b1f-9b03-9d0cdf330dcb {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 12:02:51 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[56372a96-9a78-43f3-a75a-ce03e0f09f72]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:02:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e82a616b-643b-40d2-a19c-e5ecde8094d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d.0b635971-d23f-4b1f-9b03-9d0cdf330dcb {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:02:52 devstack sudo[107441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d.0b635971-d23f-4b1f-9b03-9d0cdf330dcb
Nov 06 12:02:52 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:02:52 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root
Nov 06 12:02:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e82a616b-643b-40d2-a19c-e5ecde8094d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d.0b635971-d23f-4b1f-9b03-9d0cdf330dcb" returned: 0 in 0.348s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:02:52 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-e82a616b-643b-40d2-a19c-e5ecde8094d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 12:02:52 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbb0166-b9c5-4520-8ca3-eff453149d27]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:02:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e82a616b-643b-40d2-a19c-e5ecde8094d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:02:52 devstack sudo[107446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d
Nov 06 12:02:52 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:02:52 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root
Nov 06 12:02:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e82a616b-643b-40d2-a19c-e5ecde8094d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d" returned: 0 in 0.371s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:02:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e82a616b-643b-40d2-a19c-e5ecde8094d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d.0b635971-d23f-4b1f-9b03-9d0cdf330dcb {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:02:52 devstack sudo[107451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d.0b635971-d23f-4b1f-9b03-9d0cdf330dcb
Nov 06 12:02:52 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:02:53 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root
Nov 06 12:02:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e82a616b-643b-40d2-a19c-e5ecde8094d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d.0b635971-d23f-4b1f-9b03-9d0cdf330dcb" returned: 0 in 0.339s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:02:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e82a616b-643b-40d2-a19c-e5ecde8094d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d.0b635971-d23f-4b1f-9b03-9d0cdf330dcb {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:02:53 devstack sudo[107456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d.0b635971-d23f-4b1f-9b03-9d0cdf330dcb
Nov 06 12:02:53 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:02:53 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root
Nov 06 12:02:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e82a616b-643b-40d2-a19c-e5ecde8094d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d.0b635971-d23f-4b1f-9b03-9d0cdf330dcb" returned: 0 in 0.253s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:02:53 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e82a616b-643b-40d2-a19c-e5ecde8094d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "cinder-quobyte-0b635971-d23f-4b1f-9b03-9d0cdf330dcb" released by "_delete_snapshot" :: held 1.412s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:02:53 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e82a616b-643b-40d2-a19c-e5ecde8094d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "cinder-quobyte-a510f37c-17f0-4035-ba2e-65c3fa8a504d" released by "delete_snapshot" :: held 1.433s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:02:53 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-e82a616b-643b-40d2-a19c-e5ecde8094d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] Created reservations ['d532498a-4f59-480c-9256-8257bd2c126f', 'ef6b14b3-c56c-478c-9899-fe6b0f5e2836', 'bd995574-4ebe-47e4-a953-77e16610bfeb', 'cad1b61c-9ae4-4549-956c-d9fb0a8225a5'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:02:53 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-e82a616b-643b-40d2-a19c-e5ecde8094d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] Delete snapshot completed successfully.
Nov 06 12:02:53 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e82a616b-643b-40d2-a19c-e5ecde8094d8 tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "cinder-0b635971-d23f-4b1f-9b03-9d0cdf330dcb-delete_snapshot" released by "delete_snapshot" :: held 1.574s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:02:54 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-4192a6d6-4202-46c9-82a6-e1f246e1668e tempest-CreateVolumesFromSnapshotTest-232579978 None] Acquiring lock "cinder-a510f37c-17f0-4035-ba2e-65c3fa8a504d-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:02:54 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-4192a6d6-4202-46c9-82a6-e1f246e1668e tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "cinder-a510f37c-17f0-4035-ba2e-65c3fa8a504d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:02:54 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-4192a6d6-4202-46c9-82a6-e1f246e1668e tempest-CreateVolumesFromSnapshotTest-232579978 None] Acquiring lock "cinder-quobyte-a510f37c-17f0-4035-ba2e-65c3fa8a504d" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:02:54 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-4192a6d6-4202-46c9-82a6-e1f246e1668e tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "cinder-quobyte-a510f37c-17f0-4035-ba2e-65c3fa8a504d" acquired by "delete_volume" :: waited 0.014s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:02:54 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff641bc-351c-49dd-9f7f-2b027c3605df]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:02:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4192a6d6-4202-46c9-82a6-e1f246e1668e tempest-CreateVolumesFromSnapshotTest-232579978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:02:54 devstack sudo[107459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d
Nov 06 12:02:54 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:02:54 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root
Nov 06 12:02:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4192a6d6-4202-46c9-82a6-e1f246e1668e tempest-CreateVolumesFromSnapshotTest-232579978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d" returned: 0 in 0.368s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:02:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4192a6d6-4202-46c9-82a6-e1f246e1668e tempest-CreateVolumesFromSnapshotTest-232579978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:02:54 devstack sudo[107464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d
Nov 06 12:02:54 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:02:54 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root
Nov 06 12:02:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4192a6d6-4202-46c9-82a6-e1f246e1668e tempest-CreateVolumesFromSnapshotTest-232579978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a510f37c-17f0-4035-ba2e-65c3fa8a504d" returned: 0 in 0.273s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:02:54 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-4192a6d6-4202-46c9-82a6-e1f246e1668e tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "cinder-quobyte-a510f37c-17f0-4035-ba2e-65c3fa8a504d" released by "delete_volume" :: held 0.707s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:02:54 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-4192a6d6-4202-46c9-82a6-e1f246e1668e tempest-CreateVolumesFromSnapshotTest-232579978 None] Created reservations ['cc7669a6-3d9e-44a4-8c7d-e7e67c840e07', 'a10976f7-b2f5-412b-af15-182679e9354c', '43e99ba6-22d3-4a64-b629-be6b90ef62d8', '5165d873-821e-4865-a0b3-1175f5a6f74c'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:02:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4192a6d6-4202-46c9-82a6-e1f246e1668e tempest-CreateVolumesFromSnapshotTest-232579978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:02:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4192a6d6-4202-46c9-82a6-e1f246e1668e tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:02:54 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-4192a6d6-4202-46c9-82a6-e1f246e1668e tempest-CreateVolumesFromSnapshotTest-232579978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:02:54 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-4192a6d6-4202-46c9-82a6-e1f246e1668e tempest-CreateVolumesFromSnapshotTest-232579978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:02:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4192a6d6-4202-46c9-82a6-e1f246e1668e tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:02:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4192a6d6-4202-46c9-82a6-e1f246e1668e tempest-CreateVolumesFromSnapshotTest-232579978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:02:54 devstack sudo[107468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:02:54 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:02:55 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root
Nov 06 12:02:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4192a6d6-4202-46c9-82a6-e1f246e1668e tempest-CreateVolumesFromSnapshotTest-232579978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.234s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:02:55 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-4192a6d6-4202-46c9-82a6-e1f246e1668e tempest-CreateVolumesFromSnapshotTest-232579978 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:02:55 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-4192a6d6-4202-46c9-82a6-e1f246e1668e tempest-CreateVolumesFromSnapshotTest-232579978 None] Deleted volume successfully.
Nov 06 12:02:55 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-4192a6d6-4202-46c9-82a6-e1f246e1668e tempest-CreateVolumesFromSnapshotTest-232579978 None] Lock "cinder-a510f37c-17f0-4035-ba2e-65c3fa8a504d-delete_volume" released by "delete_volume" :: held 1.143s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:04 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:SELECT=43,cinder:INSERT=20,cinder:UPDATE=67,cinder:DELETE=5 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 12:03:05 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:SELECT=59,cinder:UPDATE=79,cinder:DELETE=8,cinder:INSERT=15 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 12:03:07 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd281f83-9571-433f-a0c5-18ad01ba3d81 tempest-CreateVolumesFromImageTest-1023581998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:03:07 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-dd281f83-9571-433f-a0c5-18ad01ba3d81 tempest-CreateVolumesFromImageTest-1023581998 None] Flow 'volume_create_manager' (73ea33af-6af5-41bd-be0e-09eb1769527f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:03:07 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-dd281f83-9571-433f-a0c5-18ad01ba3d81 tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (909d723d-21eb-429c-ba06-c9f86b8fd8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:07 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-dd281f83-9571-433f-a0c5-18ad01ba3d81 tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (909d723d-21eb-429c-ba06-c9f86b8fd8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-214937990',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ce06884-03a1-45f2-abd8-a22849e9b2a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3293eae76e264b01ac95b051f857eebb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:07Z,use_quota=True,user_id='c4e20de00df843faa8fc53c38885ea25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:07 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-dd281f83-9571-433f-a0c5-18ad01ba3d81 tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc1a4426-cbb2-483d-86de-f6fde0a31958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:07 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-dd281f83-9571-433f-a0c5-18ad01ba3d81 tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc1a4426-cbb2-483d-86de-f6fde0a31958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:07 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-dd281f83-9571-433f-a0c5-18ad01ba3d81 tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29bb3700-6da3-4e7b-a603-77c567db3c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:07 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-dd281f83-9571-433f-a0c5-18ad01ba3d81 tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29bb3700-6da3-4e7b-a603-77c567db3c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ce06884-03a1-45f2-abd8-a22849e9b2a3', 'volume_name': 'volume-6ce06884-03a1-45f2-abd8-a22849e9b2a3', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:07 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-dd281f83-9571-433f-a0c5-18ad01ba3d81 tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33f261dc-8cbe-47fa-b5d9-2055a7e894a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:07 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-dd281f83-9571-433f-a0c5-18ad01ba3d81 tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33f261dc-8cbe-47fa-b5d9-2055a7e894a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:07 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-dd281f83-9571-433f-a0c5-18ad01ba3d81 tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ae9619-28c0-4726-94b5-df0f3efb04ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:07 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-dd281f83-9571-433f-a0c5-18ad01ba3d81 tempest-CreateVolumesFromImageTest-1023581998 None] Volume 6ce06884-03a1-45f2-abd8-a22849e9b2a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ce06884-03a1-45f2-abd8-a22849e9b2a3', 'volume_size': 1}
Nov 06 12:03:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-dd281f83-9571-433f-a0c5-18ad01ba3d81 tempest-CreateVolumesFromImageTest-1023581998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-dd281f83-9571-433f-a0c5-18ad01ba3d81 tempest-CreateVolumesFromImageTest-1023581998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:07 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-dd281f83-9571-433f-a0c5-18ad01ba3d81 tempest-CreateVolumesFromImageTest-1023581998 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-214937990',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ce06884-03a1-45f2-abd8-a22849e9b2a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3293eae76e264b01ac95b051f857eebb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:07Z,use_quota=True,user_id='c4e20de00df843faa8fc53c38885ea25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:03:07 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-dd281f83-9571-433f-a0c5-18ad01ba3d81 tempest-CreateVolumesFromImageTest-1023581998 None] Creating volume 6ce06884-03a1-45f2-abd8-a22849e9b2a3 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:03:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-dd281f83-9571-433f-a0c5-18ad01ba3d81 tempest-CreateVolumesFromImageTest-1023581998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-dd281f83-9571-433f-a0c5-18ad01ba3d81 tempest-CreateVolumesFromImageTest-1023581998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:07 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-dd281f83-9571-433f-a0c5-18ad01ba3d81 tempest-CreateVolumesFromImageTest-1023581998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:07 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-dd281f83-9571-433f-a0c5-18ad01ba3d81 tempest-CreateVolumesFromImageTest-1023581998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-dd281f83-9571-433f-a0c5-18ad01ba3d81 tempest-CreateVolumesFromImageTest-1023581998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:07 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-dd281f83-9571-433f-a0c5-18ad01ba3d81 tempest-CreateVolumesFromImageTest-1023581998 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:03:07 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-dd281f83-9571-433f-a0c5-18ad01ba3d81 tempest-CreateVolumesFromImageTest-1023581998 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:03:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-dd281f83-9571-433f-a0c5-18ad01ba3d81 tempest-CreateVolumesFromImageTest-1023581998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6ce06884-03a1-45f2-abd8-a22849e9b2a3 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:07 devstack sudo[107511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6ce06884-03a1-45f2-abd8-a22849e9b2a3 1073741824
Nov 06 12:03:07 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:07 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd3fa004-f8ed-49a9-b45f-a632c8ed9950 tempest-CreateVolumesFromImageTest-1023581998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:03:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-cd3fa004-f8ed-49a9-b45f-a632c8ed9950 tempest-CreateVolumesFromImageTest-1023581998 None] Flow 'volume_create_manager' (936f644d-edf5-4ea5-8571-328fab4ce59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:03:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-cd3fa004-f8ed-49a9-b45f-a632c8ed9950 tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bac0418-30fe-48c8-ad08-1a41d7f6336c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-cd3fa004-f8ed-49a9-b45f-a632c8ed9950 tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bac0418-30fe-48c8-ad08-1a41d7f6336c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1375569827',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6a1d7ce-eeee-4f83-88e3-8156e8638e9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3293eae76e264b01ac95b051f857eebb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:08Z,use_quota=True,user_id='c4e20de00df843faa8fc53c38885ea25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-cd3fa004-f8ed-49a9-b45f-a632c8ed9950 tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (887e388d-b301-4479-aa9b-2e60258ebd81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-cd3fa004-f8ed-49a9-b45f-a632c8ed9950 tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (887e388d-b301-4479-aa9b-2e60258ebd81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-cd3fa004-f8ed-49a9-b45f-a632c8ed9950 tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6885dfd-07c3-48cc-bf89-8f46eff47da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-cd3fa004-f8ed-49a9-b45f-a632c8ed9950 tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6885dfd-07c3-48cc-bf89-8f46eff47da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6a1d7ce-eeee-4f83-88e3-8156e8638e9f', 'volume_name': 'volume-b6a1d7ce-eeee-4f83-88e3-8156e8638e9f', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-cd3fa004-f8ed-49a9-b45f-a632c8ed9950 tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb173f96-9d5b-4338-b786-49a28660c6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-cd3fa004-f8ed-49a9-b45f-a632c8ed9950 tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb173f96-9d5b-4338-b786-49a28660c6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-cd3fa004-f8ed-49a9-b45f-a632c8ed9950 tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24fec2e2-6d08-4da1-88b9-5d53101c194e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:08 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-cd3fa004-f8ed-49a9-b45f-a632c8ed9950 tempest-CreateVolumesFromImageTest-1023581998 None] Volume b6a1d7ce-eeee-4f83-88e3-8156e8638e9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6a1d7ce-eeee-4f83-88e3-8156e8638e9f', 'volume_size': 1}
Nov 06 12:03:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-cd3fa004-f8ed-49a9-b45f-a632c8ed9950 tempest-CreateVolumesFromImageTest-1023581998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:08 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-dd281f83-9571-433f-a0c5-18ad01ba3d81 tempest-CreateVolumesFromImageTest-1023581998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6ce06884-03a1-45f2-abd8-a22849e9b2a3 1073741824" returned: 0 in 0.709s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-dd281f83-9571-433f-a0c5-18ad01ba3d81 tempest-CreateVolumesFromImageTest-1023581998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6ce06884-03a1-45f2-abd8-a22849e9b2a3 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:08 devstack sudo[107523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6ce06884-03a1-45f2-abd8-a22849e9b2a3
Nov 06 12:03:08 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:08 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-dd281f83-9571-433f-a0c5-18ad01ba3d81 tempest-CreateVolumesFromImageTest-1023581998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6ce06884-03a1-45f2-abd8-a22849e9b2a3" returned: 0 in 0.312s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:08 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-dd281f83-9571-433f-a0c5-18ad01ba3d81 tempest-CreateVolumesFromImageTest-1023581998 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:03:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-dd281f83-9571-433f-a0c5-18ad01ba3d81 tempest-CreateVolumesFromImageTest-1023581998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-cd3fa004-f8ed-49a9-b45f-a632c8ed9950 tempest-CreateVolumesFromImageTest-1023581998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.589s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:08 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-cd3fa004-f8ed-49a9-b45f-a632c8ed9950 tempest-CreateVolumesFromImageTest-1023581998 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1375569827',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6a1d7ce-eeee-4f83-88e3-8156e8638e9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3293eae76e264b01ac95b051f857eebb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:08Z,use_quota=True,user_id='c4e20de00df843faa8fc53c38885ea25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:03:08 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-cd3fa004-f8ed-49a9-b45f-a632c8ed9950 tempest-CreateVolumesFromImageTest-1023581998 None] Creating volume b6a1d7ce-eeee-4f83-88e3-8156e8638e9f {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:03:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-cd3fa004-f8ed-49a9-b45f-a632c8ed9950 tempest-CreateVolumesFromImageTest-1023581998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-cd3fa004-f8ed-49a9-b45f-a632c8ed9950 tempest-CreateVolumesFromImageTest-1023581998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:08 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-cd3fa004-f8ed-49a9-b45f-a632c8ed9950 tempest-CreateVolumesFromImageTest-1023581998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:08 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-cd3fa004-f8ed-49a9-b45f-a632c8ed9950 tempest-CreateVolumesFromImageTest-1023581998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-cd3fa004-f8ed-49a9-b45f-a632c8ed9950 tempest-CreateVolumesFromImageTest-1023581998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:08 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-cd3fa004-f8ed-49a9-b45f-a632c8ed9950 tempest-CreateVolumesFromImageTest-1023581998 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:03:08 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-cd3fa004-f8ed-49a9-b45f-a632c8ed9950 tempest-CreateVolumesFromImageTest-1023581998 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:03:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cd3fa004-f8ed-49a9-b45f-a632c8ed9950 tempest-CreateVolumesFromImageTest-1023581998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b6a1d7ce-eeee-4f83-88e3-8156e8638e9f 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:08 devstack sudo[107526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b6a1d7ce-eeee-4f83-88e3-8156e8638e9f 1073741824
Nov 06 12:03:08 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-dd281f83-9571-433f-a0c5-18ad01ba3d81 tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ae9619-28c0-4726-94b5-df0f3efb04ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ce06884-03a1-45f2-abd8-a22849e9b2a3', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-dd281f83-9571-433f-a0c5-18ad01ba3d81 tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (531485a5-cb29-4cf2-ad49-157ee4beb76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:08 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba191585-fbc1-471f-b5e6-ac78394388d5 tempest-CreateVolumesFromImageTest-1023581998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:03:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ba191585-fbc1-471f-b5e6-ac78394388d5 tempest-CreateVolumesFromImageTest-1023581998 None] Flow 'volume_create_manager' (ea8c8faf-86a5-4acb-94db-46a01fb0d407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:03:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ba191585-fbc1-471f-b5e6-ac78394388d5 tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c5043c3-22af-4508-8c13-760a01b5fb16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:08 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-dd281f83-9571-433f-a0c5-18ad01ba3d81 tempest-CreateVolumesFromImageTest-1023581998 None] Volume volume-6ce06884-03a1-45f2-abd8-a22849e9b2a3 (6ce06884-03a1-45f2-abd8-a22849e9b2a3): created successfully
Nov 06 12:03:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-dd281f83-9571-433f-a0c5-18ad01ba3d81 tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (531485a5-cb29-4cf2-ad49-157ee4beb76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-dd281f83-9571-433f-a0c5-18ad01ba3d81 tempest-CreateVolumesFromImageTest-1023581998 None] Flow 'volume_create_manager' (73ea33af-6af5-41bd-be0e-09eb1769527f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:03:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ba191585-fbc1-471f-b5e6-ac78394388d5 tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c5043c3-22af-4508-8c13-760a01b5fb16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1910175685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1442518f-9b53-4b6d-9983-9e2eac6e4e69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3293eae76e264b01ac95b051f857eebb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:09Z,use_quota=True,user_id='c4e20de00df843faa8fc53c38885ea25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ba191585-fbc1-471f-b5e6-ac78394388d5 tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfff0298-36bb-4fe3-9321-e3d60154067a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:09 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ba191585-fbc1-471f-b5e6-ac78394388d5 tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfff0298-36bb-4fe3-9321-e3d60154067a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:09 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ba191585-fbc1-471f-b5e6-ac78394388d5 tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7876fd6-6d2d-48f8-bbb4-e0fab873a18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:09 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ba191585-fbc1-471f-b5e6-ac78394388d5 tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7876fd6-6d2d-48f8-bbb4-e0fab873a18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1442518f-9b53-4b6d-9983-9e2eac6e4e69', 'volume_name': 'volume-1442518f-9b53-4b6d-9983-9e2eac6e4e69', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:09 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ba191585-fbc1-471f-b5e6-ac78394388d5 tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ee40748-0f10-430d-b6a9-54fe2682774a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:09 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ba191585-fbc1-471f-b5e6-ac78394388d5 tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ee40748-0f10-430d-b6a9-54fe2682774a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:09 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ba191585-fbc1-471f-b5e6-ac78394388d5 tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6947d283-5941-42e4-a8f2-e814cfa10d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:09 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-ba191585-fbc1-471f-b5e6-ac78394388d5 tempest-CreateVolumesFromImageTest-1023581998 None] Volume 1442518f-9b53-4b6d-9983-9e2eac6e4e69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1442518f-9b53-4b6d-9983-9e2eac6e4e69', 'volume_size': 1}
Nov 06 12:03:09 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ba191585-fbc1-471f-b5e6-ac78394388d5 tempest-CreateVolumesFromImageTest-1023581998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:09 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-dd281f83-9571-433f-a0c5-18ad01ba3d81 tempest-CreateVolumesFromImageTest-1023581998 None] Created volume successfully.
Nov 06 12:03:09 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f7cad53-1daf-45b1-a435-472ad8cdf392 tempest-VolumeDependencyTests-1785368670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:03:09 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3f7cad53-1daf-45b1-a435-472ad8cdf392 tempest-VolumeDependencyTests-1785368670 None] Flow 'volume_create_manager' (91187545-82a1-4a08-a058-ec13affe8e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:03:09 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3f7cad53-1daf-45b1-a435-472ad8cdf392 tempest-VolumeDependencyTests-1785368670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb6365cb-903a-4368-ad26-9a020e5a41eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:09 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3f7cad53-1daf-45b1-a435-472ad8cdf392 tempest-VolumeDependencyTests-1785368670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb6365cb-903a-4368-ad26-9a020e5a41eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1938416732',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2270067-0088-4742-9850-3770aea50857,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da3712183e0a4b009f1bbcd5f0a1f967',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:09Z,use_quota=True,user_id='54967af7e805463c9bf25de5841ff65f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:09 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3f7cad53-1daf-45b1-a435-472ad8cdf392 tempest-VolumeDependencyTests-1785368670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (579e40b1-9c9a-498d-8350-24e18d3c9423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:09 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3f7cad53-1daf-45b1-a435-472ad8cdf392 tempest-VolumeDependencyTests-1785368670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (579e40b1-9c9a-498d-8350-24e18d3c9423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:09 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3f7cad53-1daf-45b1-a435-472ad8cdf392 tempest-VolumeDependencyTests-1785368670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71154abe-ba85-4ed7-8db8-ccd07b815def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:09 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3f7cad53-1daf-45b1-a435-472ad8cdf392 tempest-VolumeDependencyTests-1785368670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71154abe-ba85-4ed7-8db8-ccd07b815def) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2270067-0088-4742-9850-3770aea50857', 'volume_name': 'volume-d2270067-0088-4742-9850-3770aea50857', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:09 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3f7cad53-1daf-45b1-a435-472ad8cdf392 tempest-VolumeDependencyTests-1785368670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a60e9d5-f66a-492a-9b7d-6d27e8799a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:09 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3f7cad53-1daf-45b1-a435-472ad8cdf392 tempest-VolumeDependencyTests-1785368670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a60e9d5-f66a-492a-9b7d-6d27e8799a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:09 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:09 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3f7cad53-1daf-45b1-a435-472ad8cdf392 tempest-VolumeDependencyTests-1785368670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0dda138-a414-4981-a8d4-f9360680158d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:09 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-3f7cad53-1daf-45b1-a435-472ad8cdf392 tempest-VolumeDependencyTests-1785368670 None] Volume d2270067-0088-4742-9850-3770aea50857: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2270067-0088-4742-9850-3770aea50857', 'volume_size': 1}
Nov 06 12:03:09 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3f7cad53-1daf-45b1-a435-472ad8cdf392 tempest-VolumeDependencyTests-1785368670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:09 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cd3fa004-f8ed-49a9-b45f-a632c8ed9950 tempest-CreateVolumesFromImageTest-1023581998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b6a1d7ce-eeee-4f83-88e3-8156e8638e9f 1073741824" returned: 0 in 0.721s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:09 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cd3fa004-f8ed-49a9-b45f-a632c8ed9950 tempest-CreateVolumesFromImageTest-1023581998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b6a1d7ce-eeee-4f83-88e3-8156e8638e9f {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:09 devstack sudo[107533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b6a1d7ce-eeee-4f83-88e3-8156e8638e9f
Nov 06 12:03:09 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:09 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0d9753a-c0cf-412e-9265-fe1cc35598df tempest-CreateVolumesFromImageTest-1023581998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:03:09 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e0d9753a-c0cf-412e-9265-fe1cc35598df tempest-CreateVolumesFromImageTest-1023581998 None] Flow 'volume_create_manager' (ff549e71-c8e4-4f7b-bf6b-18bf5ae013bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:03:09 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e0d9753a-c0cf-412e-9265-fe1cc35598df tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fff750a7-8581-4b95-818b-a6e911ee44d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:09 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e0d9753a-c0cf-412e-9265-fe1cc35598df tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fff750a7-8581-4b95-818b-a6e911ee44d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1171956137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3e38243-4b7f-449a-928b-7797038271ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3293eae76e264b01ac95b051f857eebb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:09Z,use_quota=True,user_id='c4e20de00df843faa8fc53c38885ea25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:09 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e0d9753a-c0cf-412e-9265-fe1cc35598df tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09f3f561-bc37-48c9-99a3-41672cec4afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:09 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e0d9753a-c0cf-412e-9265-fe1cc35598df tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09f3f561-bc37-48c9-99a3-41672cec4afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:09 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e0d9753a-c0cf-412e-9265-fe1cc35598df tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9acea42f-57d4-4385-996c-989487cc89ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:09 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e0d9753a-c0cf-412e-9265-fe1cc35598df tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9acea42f-57d4-4385-996c-989487cc89ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3e38243-4b7f-449a-928b-7797038271ac', 'volume_name': 'volume-a3e38243-4b7f-449a-928b-7797038271ac', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:09 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e0d9753a-c0cf-412e-9265-fe1cc35598df tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb4de267-bdd4-4fe9-a466-2697d170545f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:09 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e0d9753a-c0cf-412e-9265-fe1cc35598df tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb4de267-bdd4-4fe9-a466-2697d170545f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:09 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e0d9753a-c0cf-412e-9265-fe1cc35598df tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (225c7955-69fd-427a-b80e-6c85683340d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:09 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-e0d9753a-c0cf-412e-9265-fe1cc35598df tempest-CreateVolumesFromImageTest-1023581998 None] Volume a3e38243-4b7f-449a-928b-7797038271ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3e38243-4b7f-449a-928b-7797038271ac', 'volume_size': 1}
Nov 06 12:03:09 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e0d9753a-c0cf-412e-9265-fe1cc35598df tempest-CreateVolumesFromImageTest-1023581998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:09 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:09 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cd3fa004-f8ed-49a9-b45f-a632c8ed9950 tempest-CreateVolumesFromImageTest-1023581998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b6a1d7ce-eeee-4f83-88e3-8156e8638e9f" returned: 0 in 0.331s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:09 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-cd3fa004-f8ed-49a9-b45f-a632c8ed9950 tempest-CreateVolumesFromImageTest-1023581998 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:03:09 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-cd3fa004-f8ed-49a9-b45f-a632c8ed9950 tempest-CreateVolumesFromImageTest-1023581998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:09 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ba191585-fbc1-471f-b5e6-ac78394388d5 tempest-CreateVolumesFromImageTest-1023581998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.769s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:09 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ba191585-fbc1-471f-b5e6-ac78394388d5 tempest-CreateVolumesFromImageTest-1023581998 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1910175685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1442518f-9b53-4b6d-9983-9e2eac6e4e69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3293eae76e264b01ac95b051f857eebb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:09Z,use_quota=True,user_id='c4e20de00df843faa8fc53c38885ea25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:03:09 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-ba191585-fbc1-471f-b5e6-ac78394388d5 tempest-CreateVolumesFromImageTest-1023581998 None] Creating volume 1442518f-9b53-4b6d-9983-9e2eac6e4e69 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:03:09 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ba191585-fbc1-471f-b5e6-ac78394388d5 tempest-CreateVolumesFromImageTest-1023581998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:09 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ba191585-fbc1-471f-b5e6-ac78394388d5 tempest-CreateVolumesFromImageTest-1023581998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:09 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ba191585-fbc1-471f-b5e6-ac78394388d5 tempest-CreateVolumesFromImageTest-1023581998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:09 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ba191585-fbc1-471f-b5e6-ac78394388d5 tempest-CreateVolumesFromImageTest-1023581998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:09 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ba191585-fbc1-471f-b5e6-ac78394388d5 tempest-CreateVolumesFromImageTest-1023581998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:09 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ba191585-fbc1-471f-b5e6-ac78394388d5 tempest-CreateVolumesFromImageTest-1023581998 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:03:09 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-ba191585-fbc1-471f-b5e6-ac78394388d5 tempest-CreateVolumesFromImageTest-1023581998 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:03:09 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ba191585-fbc1-471f-b5e6-ac78394388d5 tempest-CreateVolumesFromImageTest-1023581998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1442518f-9b53-4b6d-9983-9e2eac6e4e69 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:09 devstack sudo[107536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1442518f-9b53-4b6d-9983-9e2eac6e4e69 1073741824
Nov 06 12:03:09 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:09 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-cd3fa004-f8ed-49a9-b45f-a632c8ed9950 tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24fec2e2-6d08-4da1-88b9-5d53101c194e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6a1d7ce-eeee-4f83-88e3-8156e8638e9f', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:09 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-cd3fa004-f8ed-49a9-b45f-a632c8ed9950 tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aa9a775-a738-4728-8d6c-aecf3f61eff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:09 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-cd3fa004-f8ed-49a9-b45f-a632c8ed9950 tempest-CreateVolumesFromImageTest-1023581998 None] Volume volume-b6a1d7ce-eeee-4f83-88e3-8156e8638e9f (b6a1d7ce-eeee-4f83-88e3-8156e8638e9f): created successfully
Nov 06 12:03:09 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-cd3fa004-f8ed-49a9-b45f-a632c8ed9950 tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aa9a775-a738-4728-8d6c-aecf3f61eff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:09 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-cd3fa004-f8ed-49a9-b45f-a632c8ed9950 tempest-CreateVolumesFromImageTest-1023581998 None] Flow 'volume_create_manager' (936f644d-edf5-4ea5-8571-328fab4ce59c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:03:09 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-cd3fa004-f8ed-49a9-b45f-a632c8ed9950 tempest-CreateVolumesFromImageTest-1023581998 None] Created volume successfully.
Nov 06 12:03:10 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-865e73e7-0707-4df8-9b75-40066fe68d4f tempest-CreateVolumesFromImageTest-1023581998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:03:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-865e73e7-0707-4df8-9b75-40066fe68d4f tempest-CreateVolumesFromImageTest-1023581998 None] Flow 'volume_create_manager' (5ac2219d-f04c-454f-ab70-5f55967722e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:03:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-865e73e7-0707-4df8-9b75-40066fe68d4f tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acbec016-93c3-4676-afb1-f47bc5d1ea62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-865e73e7-0707-4df8-9b75-40066fe68d4f tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acbec016-93c3-4676-afb1-f47bc5d1ea62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1777741424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02ee5658-3d80-4ebd-a287-0b5aef75b566,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3293eae76e264b01ac95b051f857eebb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:10Z,use_quota=True,user_id='c4e20de00df843faa8fc53c38885ea25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-865e73e7-0707-4df8-9b75-40066fe68d4f tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3490d80-924f-4f05-a4a6-e756ff5dd262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-865e73e7-0707-4df8-9b75-40066fe68d4f tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3490d80-924f-4f05-a4a6-e756ff5dd262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-865e73e7-0707-4df8-9b75-40066fe68d4f tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50dfcaaa-0038-404d-a739-a3c957ca06c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-865e73e7-0707-4df8-9b75-40066fe68d4f tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50dfcaaa-0038-404d-a739-a3c957ca06c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02ee5658-3d80-4ebd-a287-0b5aef75b566', 'volume_name': 'volume-02ee5658-3d80-4ebd-a287-0b5aef75b566', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-865e73e7-0707-4df8-9b75-40066fe68d4f tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cac2d209-f89b-45c7-a6bf-d4ec40965594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-865e73e7-0707-4df8-9b75-40066fe68d4f tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cac2d209-f89b-45c7-a6bf-d4ec40965594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-865e73e7-0707-4df8-9b75-40066fe68d4f tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af91d6bf-9414-4932-98f5-edb3c26654b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:10 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-865e73e7-0707-4df8-9b75-40066fe68d4f tempest-CreateVolumesFromImageTest-1023581998 None] Volume 02ee5658-3d80-4ebd-a287-0b5aef75b566: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02ee5658-3d80-4ebd-a287-0b5aef75b566', 'volume_size': 1}
Nov 06 12:03:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-865e73e7-0707-4df8-9b75-40066fe68d4f tempest-CreateVolumesFromImageTest-1023581998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:10 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ba191585-fbc1-471f-b5e6-ac78394388d5 tempest-CreateVolumesFromImageTest-1023581998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1442518f-9b53-4b6d-9983-9e2eac6e4e69 1073741824" returned: 0 in 0.547s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ba191585-fbc1-471f-b5e6-ac78394388d5 tempest-CreateVolumesFromImageTest-1023581998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1442518f-9b53-4b6d-9983-9e2eac6e4e69 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:10 devstack sudo[107542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1442518f-9b53-4b6d-9983-9e2eac6e4e69
Nov 06 12:03:10 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:10 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ba191585-fbc1-471f-b5e6-ac78394388d5 tempest-CreateVolumesFromImageTest-1023581998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1442518f-9b53-4b6d-9983-9e2eac6e4e69" returned: 0 in 0.275s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:10 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ba191585-fbc1-471f-b5e6-ac78394388d5 tempest-CreateVolumesFromImageTest-1023581998 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:03:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ba191585-fbc1-471f-b5e6-ac78394388d5 tempest-CreateVolumesFromImageTest-1023581998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3f7cad53-1daf-45b1-a435-472ad8cdf392 tempest-VolumeDependencyTests-1785368670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.247s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:10 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-3f7cad53-1daf-45b1-a435-472ad8cdf392 tempest-VolumeDependencyTests-1785368670 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1938416732',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2270067-0088-4742-9850-3770aea50857,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da3712183e0a4b009f1bbcd5f0a1f967',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:09Z,use_quota=True,user_id='54967af7e805463c9bf25de5841ff65f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:03:10 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-3f7cad53-1daf-45b1-a435-472ad8cdf392 tempest-VolumeDependencyTests-1785368670 None] Creating volume d2270067-0088-4742-9850-3770aea50857 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:03:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3f7cad53-1daf-45b1-a435-472ad8cdf392 tempest-VolumeDependencyTests-1785368670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3f7cad53-1daf-45b1-a435-472ad8cdf392 tempest-VolumeDependencyTests-1785368670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:10 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-3f7cad53-1daf-45b1-a435-472ad8cdf392 tempest-VolumeDependencyTests-1785368670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:10 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-3f7cad53-1daf-45b1-a435-472ad8cdf392 tempest-VolumeDependencyTests-1785368670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3f7cad53-1daf-45b1-a435-472ad8cdf392 tempest-VolumeDependencyTests-1785368670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:10 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-3f7cad53-1daf-45b1-a435-472ad8cdf392 tempest-VolumeDependencyTests-1785368670 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:03:10 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-3f7cad53-1daf-45b1-a435-472ad8cdf392 tempest-VolumeDependencyTests-1785368670 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:03:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3f7cad53-1daf-45b1-a435-472ad8cdf392 tempest-VolumeDependencyTests-1785368670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:10 devstack sudo[107545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857 1073741824
Nov 06 12:03:10 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ba191585-fbc1-471f-b5e6-ac78394388d5 tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6947d283-5941-42e4-a8f2-e814cfa10d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1442518f-9b53-4b6d-9983-9e2eac6e4e69', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ba191585-fbc1-471f-b5e6-ac78394388d5 tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7f576b2-b327-4ec9-8725-b3e1d7769084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:10 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-ba191585-fbc1-471f-b5e6-ac78394388d5 tempest-CreateVolumesFromImageTest-1023581998 None] Volume volume-1442518f-9b53-4b6d-9983-9e2eac6e4e69 (1442518f-9b53-4b6d-9983-9e2eac6e4e69): created successfully
Nov 06 12:03:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ba191585-fbc1-471f-b5e6-ac78394388d5 tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7f576b2-b327-4ec9-8725-b3e1d7769084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ba191585-fbc1-471f-b5e6-ac78394388d5 tempest-CreateVolumesFromImageTest-1023581998 None] Flow 'volume_create_manager' (ea8c8faf-86a5-4acb-94db-46a01fb0d407) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:03:10 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-ba191585-fbc1-471f-b5e6-ac78394388d5 tempest-CreateVolumesFromImageTest-1023581998 None] Created volume successfully.
Nov 06 12:03:11 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3f7cad53-1daf-45b1-a435-472ad8cdf392 tempest-VolumeDependencyTests-1785368670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857 1073741824" returned: 0 in 0.475s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3f7cad53-1daf-45b1-a435-472ad8cdf392 tempest-VolumeDependencyTests-1785368670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:11 devstack sudo[107551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857
Nov 06 12:03:11 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:11 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3f7cad53-1daf-45b1-a435-472ad8cdf392 tempest-VolumeDependencyTests-1785368670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857" returned: 0 in 0.273s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:11 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-3f7cad53-1daf-45b1-a435-472ad8cdf392 tempest-VolumeDependencyTests-1785368670 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:03:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3f7cad53-1daf-45b1-a435-472ad8cdf392 tempest-VolumeDependencyTests-1785368670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e0d9753a-c0cf-412e-9265-fe1cc35598df tempest-CreateVolumesFromImageTest-1023581998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.849s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:11 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-e0d9753a-c0cf-412e-9265-fe1cc35598df tempest-CreateVolumesFromImageTest-1023581998 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1171956137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3e38243-4b7f-449a-928b-7797038271ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3293eae76e264b01ac95b051f857eebb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:09Z,use_quota=True,user_id='c4e20de00df843faa8fc53c38885ea25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:03:11 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-e0d9753a-c0cf-412e-9265-fe1cc35598df tempest-CreateVolumesFromImageTest-1023581998 None] Creating volume a3e38243-4b7f-449a-928b-7797038271ac {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:03:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e0d9753a-c0cf-412e-9265-fe1cc35598df tempest-CreateVolumesFromImageTest-1023581998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e0d9753a-c0cf-412e-9265-fe1cc35598df tempest-CreateVolumesFromImageTest-1023581998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:11 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-e0d9753a-c0cf-412e-9265-fe1cc35598df tempest-CreateVolumesFromImageTest-1023581998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:11 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-e0d9753a-c0cf-412e-9265-fe1cc35598df tempest-CreateVolumesFromImageTest-1023581998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e0d9753a-c0cf-412e-9265-fe1cc35598df tempest-CreateVolumesFromImageTest-1023581998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:11 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-e0d9753a-c0cf-412e-9265-fe1cc35598df tempest-CreateVolumesFromImageTest-1023581998 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:03:11 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-e0d9753a-c0cf-412e-9265-fe1cc35598df tempest-CreateVolumesFromImageTest-1023581998 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:03:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e0d9753a-c0cf-412e-9265-fe1cc35598df tempest-CreateVolumesFromImageTest-1023581998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a3e38243-4b7f-449a-928b-7797038271ac 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:11 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3f7cad53-1daf-45b1-a435-472ad8cdf392 tempest-VolumeDependencyTests-1785368670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0dda138-a414-4981-a8d4-f9360680158d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2270067-0088-4742-9850-3770aea50857', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:11 devstack sudo[107554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a3e38243-4b7f-449a-928b-7797038271ac 1073741824
Nov 06 12:03:11 devstack sudo[107554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:11 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3f7cad53-1daf-45b1-a435-472ad8cdf392 tempest-VolumeDependencyTests-1785368670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adf9d8fd-2374-4ece-ad79-b52053303f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:11 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-3f7cad53-1daf-45b1-a435-472ad8cdf392 tempest-VolumeDependencyTests-1785368670 None] Volume volume-d2270067-0088-4742-9850-3770aea50857 (d2270067-0088-4742-9850-3770aea50857): created successfully
Nov 06 12:03:11 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3f7cad53-1daf-45b1-a435-472ad8cdf392 tempest-VolumeDependencyTests-1785368670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adf9d8fd-2374-4ece-ad79-b52053303f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:11 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3f7cad53-1daf-45b1-a435-472ad8cdf392 tempest-VolumeDependencyTests-1785368670 None] Flow 'volume_create_manager' (91187545-82a1-4a08-a058-ec13affe8e00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:03:11 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-3f7cad53-1daf-45b1-a435-472ad8cdf392 tempest-VolumeDependencyTests-1785368670 None] Created volume successfully.
Nov 06 12:03:12 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:03:12 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Flow 'volume_create_manager' (986f2f3c-3933-43a4-876e-a02720f10d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:03:12 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eabb202-b11c-4d9d-937e-8fff670a4dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:12 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eabb202-b11c-4d9d-937e-8fff670a4dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:03:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdb1129e-d670-4a18-af00-c427bad38669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5526812217b64973a9fb2ca17881c389',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:12Z,use_quota=True,user_id='d98a5173e7d84f9a914df512c2b479c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:12 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (402b3541-2185-4532-9933-dcd5e9a73f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:12 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (402b3541-2185-4532-9933-dcd5e9a73f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:12 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25c7a602-665a-4891-8a12-348d715a078d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:12 devstack cinder-volume[87165]: DEBUG cinder.image.glance [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Creating Keystone auth plugin from conf {{(pid=87165) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 06 12:03:12 devstack sudo[107554]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e0d9753a-c0cf-412e-9265-fe1cc35598df tempest-CreateVolumesFromImageTest-1023581998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a3e38243-4b7f-449a-928b-7797038271ac 1073741824" returned: 0 in 0.589s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e0d9753a-c0cf-412e-9265-fe1cc35598df tempest-CreateVolumesFromImageTest-1023581998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a3e38243-4b7f-449a-928b-7797038271ac {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:12 devstack sudo[107593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a3e38243-4b7f-449a-928b-7797038271ac
Nov 06 12:03:12 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:12 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25c7a602-665a-4891-8a12-348d715a078d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bdb1129e-d670-4a18-af00-c427bad38669', 'volume_name': 'volume-bdb1129e-d670-4a18-af00-c427bad38669', 'volume_size': 1, 'image_id': '8acd07c8-e1dc-474d-863e-0fa5b9f098db', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8acd07c8-e1dc-474d-863e-0fa5b9f098db', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fac7cc8e47acb20947fd62054289be52', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5526812217b64973a9fb2ca17881c389', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6935185185dbe0ebeb1c8f0a9ef06df0a1fcb6e94ba345ebaf44b114568a6a90f926733b477aeb1c00f0bf3f21d8a6aa271d56e9d9cd42fd8362e41ac4bf2a8d', 'id': '8acd07c8-e1dc-474d-863e-0fa5b9f098db', 'created_at': datetime.datetime(2026, 11, 6, 11, 3, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 11, 3, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8acd07c8-e1dc-474d-863e-0fa5b9f098db/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x742c1e21e420>}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:12 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:12 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f62cd73-46df-4f92-a283-4da355b73a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:12 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f62cd73-46df-4f92-a283-4da355b73a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:12 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5905ee7-bd6f-490c-8b1e-1e814524540d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:12 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Volume bdb1129e-d670-4a18-af00-c427bad38669: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bdb1129e-d670-4a18-af00-c427bad38669', 'volume_size': 1, 'image_id': '8acd07c8-e1dc-474d-863e-0fa5b9f098db', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8acd07c8-e1dc-474d-863e-0fa5b9f098db', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fac7cc8e47acb20947fd62054289be52', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5526812217b64973a9fb2ca17881c389', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6935185185dbe0ebeb1c8f0a9ef06df0a1fcb6e94ba345ebaf44b114568a6a90f926733b477aeb1c00f0bf3f21d8a6aa271d56e9d9cd42fd8362e41ac4bf2a8d', 'id': '8acd07c8-e1dc-474d-863e-0fa5b9f098db', 'created_at': datetime.datetime(2026, 11, 6, 11, 3, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 11, 3, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8acd07c8-e1dc-474d-863e-0fa5b9f098db/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x742c1e21e420>}
Nov 06 12:03:12 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Trying to clone bdb1129e-d670-4a18-af00-c427bad38669 from image 8acd07c8-e1dc-474d-863e-0fa5b9f098db at location (None, [{'url': 'file:///opt/stack/data/glance/images/8acd07c8-e1dc-474d-863e-0fa5b9f098db', 'metadata': {}}]). {{(pid=87165) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 06 12:03:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e0d9753a-c0cf-412e-9265-fe1cc35598df tempest-CreateVolumesFromImageTest-1023581998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a3e38243-4b7f-449a-928b-7797038271ac" returned: 0 in 0.331s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:12 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-e0d9753a-c0cf-412e-9265-fe1cc35598df tempest-CreateVolumesFromImageTest-1023581998 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:03:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e0d9753a-c0cf-412e-9265-fe1cc35598df tempest-CreateVolumesFromImageTest-1023581998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-865e73e7-0707-4df8-9b75-40066fe68d4f tempest-CreateVolumesFromImageTest-1023581998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.191s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:12 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-865e73e7-0707-4df8-9b75-40066fe68d4f tempest-CreateVolumesFromImageTest-1023581998 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1777741424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02ee5658-3d80-4ebd-a287-0b5aef75b566,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3293eae76e264b01ac95b051f857eebb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:10Z,use_quota=True,user_id='c4e20de00df843faa8fc53c38885ea25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:03:12 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-865e73e7-0707-4df8-9b75-40066fe68d4f tempest-CreateVolumesFromImageTest-1023581998 None] Creating volume 02ee5658-3d80-4ebd-a287-0b5aef75b566 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:03:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-865e73e7-0707-4df8-9b75-40066fe68d4f tempest-CreateVolumesFromImageTest-1023581998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-865e73e7-0707-4df8-9b75-40066fe68d4f tempest-CreateVolumesFromImageTest-1023581998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:12 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-865e73e7-0707-4df8-9b75-40066fe68d4f tempest-CreateVolumesFromImageTest-1023581998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:12 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-865e73e7-0707-4df8-9b75-40066fe68d4f tempest-CreateVolumesFromImageTest-1023581998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-865e73e7-0707-4df8-9b75-40066fe68d4f tempest-CreateVolumesFromImageTest-1023581998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:12 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-865e73e7-0707-4df8-9b75-40066fe68d4f tempest-CreateVolumesFromImageTest-1023581998 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:03:12 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-865e73e7-0707-4df8-9b75-40066fe68d4f tempest-CreateVolumesFromImageTest-1023581998 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:03:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-865e73e7-0707-4df8-9b75-40066fe68d4f tempest-CreateVolumesFromImageTest-1023581998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-02ee5658-3d80-4ebd-a287-0b5aef75b566 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:12 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e0d9753a-c0cf-412e-9265-fe1cc35598df tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (225c7955-69fd-427a-b80e-6c85683340d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3e38243-4b7f-449a-928b-7797038271ac', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:12 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e0d9753a-c0cf-412e-9265-fe1cc35598df tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fa104d8-3506-4436-a7cb-4b5b0f068849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:12 devstack sudo[107598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-02ee5658-3d80-4ebd-a287-0b5aef75b566 1073741824
Nov 06 12:03:12 devstack sudo[107598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:12 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-e0d9753a-c0cf-412e-9265-fe1cc35598df tempest-CreateVolumesFromImageTest-1023581998 None] Volume volume-a3e38243-4b7f-449a-928b-7797038271ac (a3e38243-4b7f-449a-928b-7797038271ac): created successfully
Nov 06 12:03:12 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e0d9753a-c0cf-412e-9265-fe1cc35598df tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fa104d8-3506-4436-a7cb-4b5b0f068849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:12 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e0d9753a-c0cf-412e-9265-fe1cc35598df tempest-CreateVolumesFromImageTest-1023581998 None] Flow 'volume_create_manager' (ff549e71-c8e4-4f7b-bf6b-18bf5ae013bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:03:12 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-e0d9753a-c0cf-412e-9265-fe1cc35598df tempest-CreateVolumesFromImageTest-1023581998 None] Created volume successfully.
Nov 06 12:03:12 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8acd07c8-e1dc-474d-863e-0fa5b9f098db_1j0w99rndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87165) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 06 12:03:12 devstack cinder-volume[87165]: INFO cinder.image.image_utils [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Image download 0.00 MB at 0.00 MB/s
Nov 06 12:03:12 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c8d607-d44a-4bdd-ba27-70217e5f19b8]: (4, 'raw') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:03:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8acd07c8-e1dc-474d-863e-0fa5b9f098db_1j0w99rndevstack@QuobyteHD {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e7250aec-0121-45b6-8c92-2e10ae8170bc tempest-VolumeDependencyTests-1785368670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:12 devstack sudo[107600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8acd07c8-e1dc-474d-863e-0fa5b9f098db_1j0w99rndevstack@QuobyteHD
Nov 06 12:03:12 devstack sudo[107600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:13 devstack sudo[107598]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-865e73e7-0707-4df8-9b75-40066fe68d4f tempest-CreateVolumesFromImageTest-1023581998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-02ee5658-3d80-4ebd-a287-0b5aef75b566 1073741824" returned: 0 in 0.550s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:13 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:03:13 devstack sudo[107600]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Flow 'volume_create_manager' (4174ec46-15b1-49f0-b0a3-578582611ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:03:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e41b491-6aee-4e87-a4d9-71921d6947a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-865e73e7-0707-4df8-9b75-40066fe68d4f tempest-CreateVolumesFromImageTest-1023581998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-02ee5658-3d80-4ebd-a287-0b5aef75b566 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8acd07c8-e1dc-474d-863e-0fa5b9f098db_1j0w99rndevstack@QuobyteHD" returned: 0 in 0.406s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8acd07c8-e1dc-474d-863e-0fa5b9f098db_1j0w99rndevstack@QuobyteHD {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:13 devstack sudo[107608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-02ee5658-3d80-4ebd-a287-0b5aef75b566
Nov 06 12:03:13 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e41b491-6aee-4e87-a4d9-71921d6947a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b148f22a-892f-4621-ae6e-ad932c2294b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3a143ac39bd4867b472ed4e2514227c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:13Z,use_quota=True,user_id='d31cf1f9f7664587a454f4235ea8d02a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d019e30-b386-4c65-b31e-1b7b9aeccc36),volume_type_id=2d019e30-b386-4c65-b31e-1b7b9aeccc36)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ca0d785-6b3b-4647-b86f-dc94ba5f872f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ca0d785-6b3b-4647-b86f-dc94ba5f872f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95978fd0-73a5-4d43-9dd7-163adddefb8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:13 devstack cinder-volume[87165]: DEBUG cinder.image.glance [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Creating Keystone auth plugin from conf {{(pid=87165) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 06 12:03:13 devstack sudo[107609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8acd07c8-e1dc-474d-863e-0fa5b9f098db_1j0w99rndevstack@QuobyteHD
Nov 06 12:03:13 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:13 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-865e73e7-0707-4df8-9b75-40066fe68d4f tempest-CreateVolumesFromImageTest-1023581998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-02ee5658-3d80-4ebd-a287-0b5aef75b566" returned: 0 in 0.248s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:13 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-865e73e7-0707-4df8-9b75-40066fe68d4f tempest-CreateVolumesFromImageTest-1023581998 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:03:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-865e73e7-0707-4df8-9b75-40066fe68d4f tempest-CreateVolumesFromImageTest-1023581998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e7250aec-0121-45b6-8c92-2e10ae8170bc tempest-VolumeDependencyTests-1785368670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.627s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-865e73e7-0707-4df8-9b75-40066fe68d4f tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af91d6bf-9414-4932-98f5-edb3c26654b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02ee5658-3d80-4ebd-a287-0b5aef75b566', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-865e73e7-0707-4df8-9b75-40066fe68d4f tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d362a7d6-15ec-4508-a75a-166d3da017da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:13 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-e7250aec-0121-45b6-8c92-2e10ae8170bc tempest-VolumeDependencyTests-1785368670 None] Creating offline snapshot 113f979a-9611-4766-adf9-163ae4c61795 of volume d2270067-0088-4742-9850-3770aea50857 {{(pid=87165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 12:03:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95978fd0-73a5-4d43-9dd7-163adddefb8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b148f22a-892f-4621-ae6e-ad932c2294b4', 'volume_name': 'volume-b148f22a-892f-4621-ae6e-ad932c2294b4', 'volume_size': 1, 'image_id': '3caf4112-ecba-41f1-97bc-1a88bfcdc35a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3caf4112-ecba-41f1-97bc-1a88bfcdc35a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd75d7549bd41f3abecda8807c18c6211', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f3a143ac39bd4867b472ed4e2514227c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5c96451cbca81ba6df304ec392132a334709a10ad3d018c02f86bcecf804a688125bc576d923e0f6d3fd744b7a949b234acde3c68410bd4bed506536dcf09e81', 'id': '3caf4112-ecba-41f1-97bc-1a88bfcdc35a', 'created_at': datetime.datetime(2026, 11, 6, 11, 3, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 11, 3, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3caf4112-ecba-41f1-97bc-1a88bfcdc35a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x742c1e44be90>}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a37fd96-8246-4e8d-9875-7d69b19a2598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a37fd96-8246-4e8d-9875-7d69b19a2598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (756302b8-64c1-4b4a-a341-c4f89600bebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:13 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Volume b148f22a-892f-4621-ae6e-ad932c2294b4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b148f22a-892f-4621-ae6e-ad932c2294b4', 'volume_size': 1, 'image_id': '3caf4112-ecba-41f1-97bc-1a88bfcdc35a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3caf4112-ecba-41f1-97bc-1a88bfcdc35a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd75d7549bd41f3abecda8807c18c6211', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f3a143ac39bd4867b472ed4e2514227c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5c96451cbca81ba6df304ec392132a334709a10ad3d018c02f86bcecf804a688125bc576d923e0f6d3fd744b7a949b234acde3c68410bd4bed506536dcf09e81', 'id': '3caf4112-ecba-41f1-97bc-1a88bfcdc35a', 'created_at': datetime.datetime(2026, 11, 6, 11, 3, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 11, 3, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3caf4112-ecba-41f1-97bc-1a88bfcdc35a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x742c1e44be90>}
Nov 06 12:03:13 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Trying to clone b148f22a-892f-4621-ae6e-ad932c2294b4 from image 3caf4112-ecba-41f1-97bc-1a88bfcdc35a at location (None, [{'url': 'file:///opt/stack/data/glance/images/3caf4112-ecba-41f1-97bc-1a88bfcdc35a', 'metadata': {}}]). {{(pid=87165) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 06 12:03:13 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeda4caf-6fae-4824-a2d8-579c696e99e9]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:03:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e7250aec-0121-45b6-8c92-2e10ae8170bc tempest-VolumeDependencyTests-1785368670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:13 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-865e73e7-0707-4df8-9b75-40066fe68d4f tempest-CreateVolumesFromImageTest-1023581998 None] Volume volume-02ee5658-3d80-4ebd-a287-0b5aef75b566 (02ee5658-3d80-4ebd-a287-0b5aef75b566): created successfully
Nov 06 12:03:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-865e73e7-0707-4df8-9b75-40066fe68d4f tempest-CreateVolumesFromImageTest-1023581998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d362a7d6-15ec-4508-a75a-166d3da017da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:13 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-865e73e7-0707-4df8-9b75-40066fe68d4f tempest-CreateVolumesFromImageTest-1023581998 None] Flow 'volume_create_manager' (5ac2219d-f04c-454f-ab70-5f55967722e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:03:13 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8acd07c8-e1dc-474d-863e-0fa5b9f098db_1j0w99rndevstack@QuobyteHD" returned: 1 in 0.370s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8acd07c8-e1dc-474d-863e-0fa5b9f098db_1j0w99rndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 12:03:13 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Temporary image 8acd07c8-e1dc-474d-863e-0fa5b9f098db is fetched for user d98a5173e7d84f9a914df512c2b479c4. {{(pid=87165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 06 12:03:13 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-865e73e7-0707-4df8-9b75-40066fe68d4f tempest-CreateVolumesFromImageTest-1023581998 None] Created volume successfully.
Nov 06 12:03:13 devstack sudo[107614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857
Nov 06 12:03:13 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:13 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f763f3b5-bde5-45b5-ac0d-b4a6006d36b4]: (4, 'raw') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:03:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8acd07c8-e1dc-474d-863e-0fa5b9f098db_1j0w99rndevstack@QuobyteHD {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:13 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3caf4112-ecba-41f1-97bc-1a88bfcdc35a_otmkgmqudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87165) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 06 12:03:13 devstack cinder-volume[87165]: INFO cinder.image.image_utils [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Image download 0.00 MB at 0.00 MB/s
Nov 06 12:03:13 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-52d32df1-d252-4820-a5e0-4208b365cf84 tempest-CreateVolumesFromImageTest-1023581998 None] Acquiring lock "cinder-02ee5658-3d80-4ebd-a287-0b5aef75b566-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:13 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-52d32df1-d252-4820-a5e0-4208b365cf84 tempest-CreateVolumesFromImageTest-1023581998 None] Lock "cinder-02ee5658-3d80-4ebd-a287-0b5aef75b566-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:13 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-52d32df1-d252-4820-a5e0-4208b365cf84 tempest-CreateVolumesFromImageTest-1023581998 None] Acquiring lock "cinder-quobyte-02ee5658-3d80-4ebd-a287-0b5aef75b566" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:13 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c01bbe-12c2-4429-94ed-4a84437b48e4]: (4, 'raw') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:03:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3caf4112-ecba-41f1-97bc-1a88bfcdc35a_otmkgmqudevstack@QuobyteHD {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:13 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-52d32df1-d252-4820-a5e0-4208b365cf84 tempest-CreateVolumesFromImageTest-1023581998 None] Lock "cinder-quobyte-02ee5658-3d80-4ebd-a287-0b5aef75b566" acquired by "delete_volume" :: waited 0.035s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:13 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66c978f-b2a6-4907-8bfb-29a89b70be4a]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:03:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-52d32df1-d252-4820-a5e0-4208b365cf84 tempest-CreateVolumesFromImageTest-1023581998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-02ee5658-3d80-4ebd-a287-0b5aef75b566 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:13 devstack sudo[107618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8acd07c8-e1dc-474d-863e-0fa5b9f098db_1j0w99rndevstack@QuobyteHD
Nov 06 12:03:13 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:13 devstack sudo[107619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3caf4112-ecba-41f1-97bc-1a88bfcdc35a_otmkgmqudevstack@QuobyteHD
Nov 06 12:03:13 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:13 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e7250aec-0121-45b6-8c92-2e10ae8170bc tempest-VolumeDependencyTests-1785368670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857" returned: 0 in 0.434s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e7250aec-0121-45b6-8c92-2e10ae8170bc tempest-VolumeDependencyTests-1785368670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857.113f979a-9611-4766-adf9-163ae4c61795 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:13 devstack sudo[107628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857.113f979a-9611-4766-adf9-163ae4c61795 1G
Nov 06 12:03:13 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:13 devstack sudo[107622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-02ee5658-3d80-4ebd-a287-0b5aef75b566
Nov 06 12:03:13 devstack sudo[107622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:14 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8acd07c8-e1dc-474d-863e-0fa5b9f098db_1j0w99rndevstack@QuobyteHD" returned: 0 in 0.496s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8acd07c8-e1dc-474d-863e-0fa5b9f098db_1j0w99rndevstack@QuobyteHD {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:14 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3caf4112-ecba-41f1-97bc-1a88bfcdc35a_otmkgmqudevstack@QuobyteHD" returned: 0 in 0.423s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3caf4112-ecba-41f1-97bc-1a88bfcdc35a_otmkgmqudevstack@QuobyteHD {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:14 devstack sudo[107622]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-52d32df1-d252-4820-a5e0-4208b365cf84 tempest-CreateVolumesFromImageTest-1023581998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-02ee5658-3d80-4ebd-a287-0b5aef75b566" returned: 0 in 0.481s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-52d32df1-d252-4820-a5e0-4208b365cf84 tempest-CreateVolumesFromImageTest-1023581998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-02ee5658-3d80-4ebd-a287-0b5aef75b566 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:14 devstack sudo[107635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8acd07c8-e1dc-474d-863e-0fa5b9f098db_1j0w99rndevstack@QuobyteHD
Nov 06 12:03:14 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:14 devstack sudo[107638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3caf4112-ecba-41f1-97bc-1a88bfcdc35a_otmkgmqudevstack@QuobyteHD
Nov 06 12:03:14 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:14 devstack sudo[107643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-02ee5658-3d80-4ebd-a287-0b5aef75b566
Nov 06 12:03:14 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:14 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e7250aec-0121-45b6-8c92-2e10ae8170bc tempest-VolumeDependencyTests-1785368670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857.113f979a-9611-4766-adf9-163ae4c61795 1G" returned: 0 in 0.520s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e7250aec-0121-45b6-8c92-2e10ae8170bc tempest-VolumeDependencyTests-1785368670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2270067-0088-4742-9850-3770aea50857 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857.113f979a-9611-4766-adf9-163ae4c61795 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:14 devstack sudo[107648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2270067-0088-4742-9850-3770aea50857 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857.113f979a-9611-4766-adf9-163ae4c61795
Nov 06 12:03:14 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:14 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8acd07c8-e1dc-474d-863e-0fa5b9f098db_1j0w99rndevstack@QuobyteHD" returned: 1 in 0.412s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8acd07c8-e1dc-474d-863e-0fa5b9f098db_1j0w99rndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 12:03:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:14 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3caf4112-ecba-41f1-97bc-1a88bfcdc35a_otmkgmqudevstack@QuobyteHD" returned: 1 in 0.397s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3caf4112-ecba-41f1-97bc-1a88bfcdc35a_otmkgmqudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 12:03:14 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Temporary image 3caf4112-ecba-41f1-97bc-1a88bfcdc35a is fetched for user d31cf1f9f7664587a454f4235ea8d02a. {{(pid=87165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 06 12:03:14 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-52d32df1-d252-4820-a5e0-4208b365cf84 tempest-CreateVolumesFromImageTest-1023581998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-02ee5658-3d80-4ebd-a287-0b5aef75b566" returned: 0 in 0.302s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:14 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-52d32df1-d252-4820-a5e0-4208b365cf84 tempest-CreateVolumesFromImageTest-1023581998 None] Lock "cinder-quobyte-02ee5658-3d80-4ebd-a287-0b5aef75b566" released by "delete_volume" :: held 0.835s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:14 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f69323-d7b5-4873-938e-b2ac146b7e8d]: (4, 'raw') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:03:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3caf4112-ecba-41f1-97bc-1a88bfcdc35a_otmkgmqudevstack@QuobyteHD {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:14 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-52d32df1-d252-4820-a5e0-4208b365cf84 tempest-CreateVolumesFromImageTest-1023581998 None] Created reservations ['19c26181-3b6a-495a-9f94-6588a2a3a853', '3c2ce54c-e442-4305-ae53-d2f73b997e4e', '25587503-4694-4c3d-9f2d-ded2f52197de', '29f2f301-186d-4b6c-b2e5-e328d840d667'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:03:14 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e7250aec-0121-45b6-8c92-2e10ae8170bc tempest-VolumeDependencyTests-1785368670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2270067-0088-4742-9850-3770aea50857 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857.113f979a-9611-4766-adf9-163ae4c61795" returned: 0 in 0.330s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:14 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-e7250aec-0121-45b6-8c92-2e10ae8170bc tempest-VolumeDependencyTests-1785368670 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857.113f979a-9611-4766-adf9-163ae4c61795 is being set with open permissions: ugo+rw
Nov 06 12:03:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e7250aec-0121-45b6-8c92-2e10ae8170bc tempest-VolumeDependencyTests-1785368670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857.113f979a-9611-4766-adf9-163ae4c61795 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-52d32df1-d252-4820-a5e0-4208b365cf84 tempest-CreateVolumesFromImageTest-1023581998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-52d32df1-d252-4820-a5e0-4208b365cf84 tempest-CreateVolumesFromImageTest-1023581998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:14 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-52d32df1-d252-4820-a5e0-4208b365cf84 tempest-CreateVolumesFromImageTest-1023581998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:14 devstack sudo[107662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857.113f979a-9611-4766-adf9-163ae4c61795
Nov 06 12:03:14 devstack sudo[107662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:14 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-52d32df1-d252-4820-a5e0-4208b365cf84 tempest-CreateVolumesFromImageTest-1023581998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-52d32df1-d252-4820-a5e0-4208b365cf84 tempest-CreateVolumesFromImageTest-1023581998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-52d32df1-d252-4820-a5e0-4208b365cf84 tempest-CreateVolumesFromImageTest-1023581998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:14 devstack sudo[107657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3caf4112-ecba-41f1-97bc-1a88bfcdc35a_otmkgmqudevstack@QuobyteHD
Nov 06 12:03:14 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:14 devstack sudo[107665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:03:14 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:14 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-4327a4ce-3faa-4ad3-8032-afc2ad56542d tempest-CreateVolumesFromImageTest-1023581998 None] Acquiring lock "cinder-a3e38243-4b7f-449a-928b-7797038271ac-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:14 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-4327a4ce-3faa-4ad3-8032-afc2ad56542d tempest-CreateVolumesFromImageTest-1023581998 None] Lock "cinder-a3e38243-4b7f-449a-928b-7797038271ac-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:14 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-4327a4ce-3faa-4ad3-8032-afc2ad56542d tempest-CreateVolumesFromImageTest-1023581998 None] Acquiring lock "cinder-quobyte-a3e38243-4b7f-449a-928b-7797038271ac" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:14 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-4327a4ce-3faa-4ad3-8032-afc2ad56542d tempest-CreateVolumesFromImageTest-1023581998 None] Lock "cinder-quobyte-a3e38243-4b7f-449a-928b-7797038271ac" acquired by "delete_volume" :: waited 0.024s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:15 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81d31d3-32b0-4914-af0e-e3b766cfbe19]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:03:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4327a4ce-3faa-4ad3-8032-afc2ad56542d tempest-CreateVolumesFromImageTest-1023581998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a3e38243-4b7f-449a-928b-7797038271ac {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:15 devstack sudo[107662]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e7250aec-0121-45b6-8c92-2e10ae8170bc tempest-VolumeDependencyTests-1785368670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857.113f979a-9611-4766-adf9-163ae4c61795" returned: 0 in 0.281s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:15 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3caf4112-ecba-41f1-97bc-1a88bfcdc35a_otmkgmqudevstack@QuobyteHD" returned: 0 in 0.473s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3caf4112-ecba-41f1-97bc-1a88bfcdc35a_otmkgmqudevstack@QuobyteHD {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e7250aec-0121-45b6-8c92-2e10ae8170bc tempest-VolumeDependencyTests-1785368670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:15 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-52d32df1-d252-4820-a5e0-4208b365cf84 tempest-CreateVolumesFromImageTest-1023581998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.369s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:15 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-52d32df1-d252-4820-a5e0-4208b365cf84 tempest-CreateVolumesFromImageTest-1023581998 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:03:15 devstack sudo[107669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a3e38243-4b7f-449a-928b-7797038271ac
Nov 06 12:03:15 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:15 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-52d32df1-d252-4820-a5e0-4208b365cf84 tempest-CreateVolumesFromImageTest-1023581998 None] Deleted volume successfully.
Nov 06 12:03:15 devstack sudo[107674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857.info
Nov 06 12:03:15 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:15 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-52d32df1-d252-4820-a5e0-4208b365cf84 tempest-CreateVolumesFromImageTest-1023581998 None] Lock "cinder-02ee5658-3d80-4ebd-a287-0b5aef75b566-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:15 devstack sudo[107673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3caf4112-ecba-41f1-97bc-1a88bfcdc35a_otmkgmqudevstack@QuobyteHD
Nov 06 12:03:15 devstack sudo[107673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:15 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e7250aec-0121-45b6-8c92-2e10ae8170bc tempest-VolumeDependencyTests-1785368670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857.info" returned: 0 in 0.263s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:15 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-e7250aec-0121-45b6-8c92-2e10ae8170bc tempest-VolumeDependencyTests-1785368670 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857.info is being set with open permissions: ugo+rw
Nov 06 12:03:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e7250aec-0121-45b6-8c92-2e10ae8170bc tempest-VolumeDependencyTests-1785368670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:15 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4327a4ce-3faa-4ad3-8032-afc2ad56542d tempest-CreateVolumesFromImageTest-1023581998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a3e38243-4b7f-449a-928b-7797038271ac" returned: 0 in 0.432s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4327a4ce-3faa-4ad3-8032-afc2ad56542d tempest-CreateVolumesFromImageTest-1023581998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a3e38243-4b7f-449a-928b-7797038271ac {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:15 devstack sudo[107682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857.info
Nov 06 12:03:15 devstack sudo[107682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:15 devstack sudo[107683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a3e38243-4b7f-449a-928b-7797038271ac
Nov 06 12:03:15 devstack sudo[107683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:15 devstack sudo[107673]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3caf4112-ecba-41f1-97bc-1a88bfcdc35a_otmkgmqudevstack@QuobyteHD" returned: 1 in 0.370s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3caf4112-ecba-41f1-97bc-1a88bfcdc35a_otmkgmqudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 12:03:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:15 devstack sudo[107682]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e7250aec-0121-45b6-8c92-2e10ae8170bc tempest-VolumeDependencyTests-1785368670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857.info" returned: 0 in 0.260s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:15 devstack sudo[107683]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e7250aec-0121-45b6-8c92-2e10ae8170bc tempest-VolumeDependencyTests-1785368670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.309s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.159s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:15 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:03:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdb1129e-d670-4a18-af00-c427bad38669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5526812217b64973a9fb2ca17881c389',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:12Z,use_quota=True,user_id='d98a5173e7d84f9a914df512c2b479c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:03:15 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Creating volume bdb1129e-d670-4a18-af00-c427bad38669 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:03:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:15 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:15 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:15 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:03:15 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:03:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bdb1129e-d670-4a18-af00-c427bad38669 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4327a4ce-3faa-4ad3-8032-afc2ad56542d tempest-CreateVolumesFromImageTest-1023581998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a3e38243-4b7f-449a-928b-7797038271ac" returned: 0 in 0.296s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:15 devstack sudo[107691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bdb1129e-d670-4a18-af00-c427bad38669 1073741824
Nov 06 12:03:15 devstack sudo[107691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:15 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-4327a4ce-3faa-4ad3-8032-afc2ad56542d tempest-CreateVolumesFromImageTest-1023581998 None] Lock "cinder-quobyte-a3e38243-4b7f-449a-928b-7797038271ac" released by "delete_volume" :: held 0.785s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:15 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-e7250aec-0121-45b6-8c92-2e10ae8170bc tempest-VolumeDependencyTests-1785368670 None] Create snapshot completed successfully
Nov 06 12:03:15 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-4327a4ce-3faa-4ad3-8032-afc2ad56542d tempest-CreateVolumesFromImageTest-1023581998 None] Created reservations ['222b4694-ff6b-456b-8d07-11af327052e4', 'aa2e95b5-3749-4924-ab79-e76593a20550', 'ffde3407-ce15-4c46-9423-ed65a84d9e19', '7f277ea4-f207-4a4e-9a96-55a1e128faea'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:03:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4327a4ce-3faa-4ad3-8032-afc2ad56542d tempest-CreateVolumesFromImageTest-1023581998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4327a4ce-3faa-4ad3-8032-afc2ad56542d tempest-CreateVolumesFromImageTest-1023581998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:15 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-4327a4ce-3faa-4ad3-8032-afc2ad56542d tempest-CreateVolumesFromImageTest-1023581998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:15 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-4327a4ce-3faa-4ad3-8032-afc2ad56542d tempest-CreateVolumesFromImageTest-1023581998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4327a4ce-3faa-4ad3-8032-afc2ad56542d tempest-CreateVolumesFromImageTest-1023581998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4327a4ce-3faa-4ad3-8032-afc2ad56542d tempest-CreateVolumesFromImageTest-1023581998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:15 devstack sudo[107693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:03:15 devstack sudo[107693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:16 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-7dce8792-9d36-462c-99f3-0b62773a9ff6 tempest-CreateVolumesFromImageTest-1023581998 None] Acquiring lock "cinder-1442518f-9b53-4b6d-9983-9e2eac6e4e69-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:16 devstack sudo[107693]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:16 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-7dce8792-9d36-462c-99f3-0b62773a9ff6 tempest-CreateVolumesFromImageTest-1023581998 None] Lock "cinder-1442518f-9b53-4b6d-9983-9e2eac6e4e69-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4327a4ce-3faa-4ad3-8032-afc2ad56542d tempest-CreateVolumesFromImageTest-1023581998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.287s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:16 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-4327a4ce-3faa-4ad3-8032-afc2ad56542d tempest-CreateVolumesFromImageTest-1023581998 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:03:16 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-4327a4ce-3faa-4ad3-8032-afc2ad56542d tempest-CreateVolumesFromImageTest-1023581998 None] Deleted volume successfully.
Nov 06 12:03:16 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-4327a4ce-3faa-4ad3-8032-afc2ad56542d tempest-CreateVolumesFromImageTest-1023581998 None] Lock "cinder-a3e38243-4b7f-449a-928b-7797038271ac-delete_volume" released by "delete_volume" :: held 1.331s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:16 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-7dce8792-9d36-462c-99f3-0b62773a9ff6 tempest-CreateVolumesFromImageTest-1023581998 None] Acquiring lock "cinder-quobyte-1442518f-9b53-4b6d-9983-9e2eac6e4e69" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:16 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-7dce8792-9d36-462c-99f3-0b62773a9ff6 tempest-CreateVolumesFromImageTest-1023581998 None] Lock "cinder-quobyte-1442518f-9b53-4b6d-9983-9e2eac6e4e69" acquired by "delete_volume" :: waited 0.023s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:16 devstack sudo[107691]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bdb1129e-d670-4a18-af00-c427bad38669 1073741824" returned: 0 in 0.553s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:16 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[26cf67d0-7235-411f-8e7f-63b6e253a086]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:03:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7dce8792-9d36-462c-99f3-0b62773a9ff6 tempest-CreateVolumesFromImageTest-1023581998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1442518f-9b53-4b6d-9983-9e2eac6e4e69 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bdb1129e-d670-4a18-af00-c427bad38669 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:16 devstack sudo[107701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bdb1129e-d670-4a18-af00-c427bad38669
Nov 06 12:03:16 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:16 devstack sudo[107700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1442518f-9b53-4b6d-9983-9e2eac6e4e69
Nov 06 12:03:16 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:16 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:03:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] Flow 'volume_create_manager' (5b2551c0-a132-4db8-ae51-debb2184a363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:03:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (494ec1bb-3f9e-41a9-ac6d-ca1a03da116d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (494ec1bb-3f9e-41a9-ac6d-ca1a03da116d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1093158815',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a87ab5d-94f2-4a3b-87bd-1aadbf7638c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da3712183e0a4b009f1bbcd5f0a1f967',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=113f979a-9611-4766-adf9-163ae4c61795,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:16Z,use_quota=True,user_id='54967af7e805463c9bf25de5841ff65f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88adc498-87c7-4ef1-a1cc-d430d0e68e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88adc498-87c7-4ef1-a1cc-d430d0e68e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82a5f79d-2b8b-4f78-bc98-1082fe0337d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82a5f79d-2b8b-4f78-bc98-1082fe0337d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6a87ab5d-94f2-4a3b-87bd-1aadbf7638c6', 'volume_name': 'volume-6a87ab5d-94f2-4a3b-87bd-1aadbf7638c6', 'volume_size': 1, 'snapshot_id': '113f979a-9611-4766-adf9-163ae4c61795'}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1789ee59-8b2b-462b-a1ee-5cab2b6ef0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1789ee59-8b2b-462b-a1ee-5cab2b6ef0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (806be4a1-975e-40bf-964a-386481b8b0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:16 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] Volume 6a87ab5d-94f2-4a3b-87bd-1aadbf7638c6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6a87ab5d-94f2-4a3b-87bd-1aadbf7638c6', 'volume_size': 1, 'snapshot_id': '113f979a-9611-4766-adf9-163ae4c61795'}
Nov 06 12:03:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:16 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bdb1129e-d670-4a18-af00-c427bad38669" returned: 0 in 0.270s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:16 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:03:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.123s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:16 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b148f22a-892f-4621-ae6e-ad932c2294b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3a143ac39bd4867b472ed4e2514227c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:13Z,use_quota=True,user_id='d31cf1f9f7664587a454f4235ea8d02a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d019e30-b386-4c65-b31e-1b7b9aeccc36),volume_type_id=2d019e30-b386-4c65-b31e-1b7b9aeccc36)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:03:16 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Creating volume b148f22a-892f-4621-ae6e-ad932c2294b4 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:03:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:16 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:16 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:16 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:03:16 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:03:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b148f22a-892f-4621-ae6e-ad932c2294b4 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:16 devstack sudo[107707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b148f22a-892f-4621-ae6e-ad932c2294b4 1073741824
Nov 06 12:03:16 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:16 devstack cinder-volume[87165]: DEBUG cinder.volume.volume_utils [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Attempting download of 8acd07c8-e1dc-474d-863e-0fa5b9f098db ((None, [{'url': 'file:///opt/stack/data/glance/images/8acd07c8-e1dc-474d-863e-0fa5b9f098db', 'metadata': {}}])) to volume bdb1129e-d670-4a18-af00-c427bad38669. {{(pid=87165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 06 12:03:16 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7dce8792-9d36-462c-99f3-0b62773a9ff6 tempest-CreateVolumesFromImageTest-1023581998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1442518f-9b53-4b6d-9983-9e2eac6e4e69" returned: 0 in 0.421s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7dce8792-9d36-462c-99f3-0b62773a9ff6 tempest-CreateVolumesFromImageTest-1023581998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1442518f-9b53-4b6d-9983-9e2eac6e4e69 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:16 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[045c48c6-c7ac-4dbd-918b-c5aa5dbe4b64]: (4, 'raw') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:03:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8acd07c8-e1dc-474d-863e-0fa5b9f098db_7c39eem_ {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:16 devstack sudo[107710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1442518f-9b53-4b6d-9983-9e2eac6e4e69
Nov 06 12:03:16 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:16 devstack sudo[107711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8acd07c8-e1dc-474d-863e-0fa5b9f098db_7c39eem_
Nov 06 12:03:16 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:16 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7dce8792-9d36-462c-99f3-0b62773a9ff6 tempest-CreateVolumesFromImageTest-1023581998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1442518f-9b53-4b6d-9983-9e2eac6e4e69" returned: 0 in 0.252s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:16 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-7dce8792-9d36-462c-99f3-0b62773a9ff6 tempest-CreateVolumesFromImageTest-1023581998 None] Lock "cinder-quobyte-1442518f-9b53-4b6d-9983-9e2eac6e4e69" released by "delete_volume" :: held 0.726s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-7dce8792-9d36-462c-99f3-0b62773a9ff6 tempest-CreateVolumesFromImageTest-1023581998 None] Created reservations ['8ba03c63-2217-43ce-992f-70ba9e7a61b1', 'dfbfd17b-3c58-419f-8195-129d874b7649', '111e70b4-ed98-4270-b859-17c030603094', 'e79fd30e-d600-4997-9f24-831410e29512'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:03:17 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8acd07c8-e1dc-474d-863e-0fa5b9f098db_7c39eem_" returned: 0 in 0.356s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8acd07c8-e1dc-474d-863e-0fa5b9f098db_7c39eem_ {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:17 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-7dce8792-9d36-462c-99f3-0b62773a9ff6 tempest-CreateVolumesFromImageTest-1023581998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-7dce8792-9d36-462c-99f3-0b62773a9ff6 tempest-CreateVolumesFromImageTest-1023581998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-7dce8792-9d36-462c-99f3-0b62773a9ff6 tempest-CreateVolumesFromImageTest-1023581998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-7dce8792-9d36-462c-99f3-0b62773a9ff6 tempest-CreateVolumesFromImageTest-1023581998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-7dce8792-9d36-462c-99f3-0b62773a9ff6 tempest-CreateVolumesFromImageTest-1023581998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7dce8792-9d36-462c-99f3-0b62773a9ff6 tempest-CreateVolumesFromImageTest-1023581998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b148f22a-892f-4621-ae6e-ad932c2294b4 1073741824" returned: 0 in 0.495s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:17 devstack sudo[107722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:03:17 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG oslo_service.periodic_task [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b148f22a-892f-4621-ae6e-ad932c2294b4 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:17 devstack sudo[107721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8acd07c8-e1dc-474d-863e-0fa5b9f098db_7c39eem_
Nov 06 12:03:17 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:17 devstack sudo[107724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:03:17 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:17 devstack sudo[107726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b148f22a-892f-4621-ae6e-ad932c2294b4
Nov 06 12:03:17 devstack sudo[107726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d0693878-9a19-4a0c-8cc4-44486f97af96 tempest-CreateVolumesFromImageTest-1023581998 None] Acquiring lock "cinder-b6a1d7ce-eeee-4f83-88e3-8156e8638e9f-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d0693878-9a19-4a0c-8cc4-44486f97af96 tempest-CreateVolumesFromImageTest-1023581998 None] Lock "cinder-b6a1d7ce-eeee-4f83-88e3-8156e8638e9f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:17 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d0693878-9a19-4a0c-8cc4-44486f97af96 tempest-CreateVolumesFromImageTest-1023581998 None] Acquiring lock "cinder-quobyte-b6a1d7ce-eeee-4f83-88e3-8156e8638e9f" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7dce8792-9d36-462c-99f3-0b62773a9ff6 tempest-CreateVolumesFromImageTest-1023581998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.357s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-7dce8792-9d36-462c-99f3-0b62773a9ff6 tempest-CreateVolumesFromImageTest-1023581998 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:03:17 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-7dce8792-9d36-462c-99f3-0b62773a9ff6 tempest-CreateVolumesFromImageTest-1023581998 None] Deleted volume successfully.
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d0693878-9a19-4a0c-8cc4-44486f97af96 tempest-CreateVolumesFromImageTest-1023581998 None] Lock "cinder-quobyte-b6a1d7ce-eeee-4f83-88e3-8156e8638e9f" acquired by "delete_volume" :: waited 0.049s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-7dce8792-9d36-462c-99f3-0b62773a9ff6 tempest-CreateVolumesFromImageTest-1023581998 None] Lock "cinder-1442518f-9b53-4b6d-9983-9e2eac6e4e69-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c3f9f9-32e0-4cf0-bd59-4b99da28feb6]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d0693878-9a19-4a0c-8cc4-44486f97af96 tempest-CreateVolumesFromImageTest-1023581998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b6a1d7ce-eeee-4f83-88e3-8156e8638e9f {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:17 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.427s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG oslo_service.periodic_task [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running periodic task VolumeManager._thread_info {{(pid=87165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] thread count: 29 {{(pid=87165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] thread info: [<_MainThread(MainThread, started 127732956901504)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127732842693056)>, <Thread(Thread-3 (stat_writer), started daemon 127732841891136)>, <Thread(Rabbit-heartbeat, started daemon 127732842515648)>, <Thread(Thread-5 (_runner), started daemon 127732840534464)>, <Thread(Thread-7 (_runner), started daemon 127732840636032)>, <Thread(fd_logger, started daemon 127732838664256)>, <Thread(privsep_reader, started daemon 127732838673408)>, <Thread(tpool_thread_0, started daemon 127732829828800)>, <Thread(tpool_thread_1, started daemon 127732821436096)>, <Thread(tpool_thread_2, started daemon 127732813043392)>, <Thread(tpool_thread_3, started daemon 127732804650688)>, <Thread(tpool_thread_4, started daemon 127732796257984)>, <Thread(tpool_thread_5, started daemon 127732787865280)>, <Thread(tpool_thread_6, started daemon 127732779456192)>, <Thread(tpool_thread_7, started daemon 127732771047104)>, <Thread(tpool_thread_8, started daemon 127732762638016)>, <Thread(tpool_thread_9, started daemon 127732754228928)>, <Thread(tpool_thread_10, started daemon 127732745819840)>, <Thread(tpool_thread_11, started daemon 127732737410752)>, <Thread(tpool_thread_12, started daemon 127732729001664)>, <Thread(tpool_thread_13, started daemon 127732720592576)>, <Thread(tpool_thread_14, started daemon 127732712183488)>, <Thread(tpool_thread_15, started daemon 127732703774400)>, <Thread(tpool_thread_16, started daemon 127732695365312)>, <Thread(tpool_thread_17, started daemon 127732686956224)>, <Thread(tpool_thread_18, started daemon 127732678547136)>, <Thread(tpool_thread_19, started daemon 127732670138048)>, <Thread(Rabbit-heartbeat, started daemon 127732832631296)>] {{(pid=87165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 12:03:17 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8acd07c8-e1dc-474d-863e-0fa5b9f098db_7c39eem_" returned: 1 in 0.518s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8acd07c8-e1dc-474d-863e-0fa5b9f098db_7c39eem_' failed. Not Retrying. {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5faf0866-c75f-49ac-8b2e-082b59832727]: (4, 'raw') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8acd07c8-e1dc-474d-863e-0fa5b9f098db_1j0w99rndevstack@QuobyteHD {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:17 devstack sudo[107726]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b148f22a-892f-4621-ae6e-ad932c2294b4" returned: 0 in 0.474s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:17 devstack sudo[107732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b6a1d7ce-eeee-4f83-88e3-8156e8638e9f
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.061s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:17 devstack sudo[107732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] Acquiring lock "cinder-quobyte-113f979a-9611-4766-adf9-163ae4c61795-6a87ab5d-94f2-4a3b-87bd-1aadbf7638c6" by "_create_volume_from_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] Lock "cinder-quobyte-113f979a-9611-4766-adf9-163ae4c61795-6a87ab5d-94f2-4a3b-87bd-1aadbf7638c6" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] Creating volume 6a87ab5d-94f2-4a3b-87bd-1aadbf7638c6 from snapshot 113f979a-9611-4766-adf9-163ae4c61795 {{(pid=87165) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] Acquiring lock "cinder-quobyte-6a87ab5d-94f2-4a3b-87bd-1aadbf7638c6" by "_copy_volume_from_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG cinder.volume.volume_utils [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Attempting download of 3caf4112-ecba-41f1-97bc-1a88bfcdc35a ((None, [{'url': 'file:///opt/stack/data/glance/images/3caf4112-ecba-41f1-97bc-1a88bfcdc35a', 'metadata': {}}])) to volume b148f22a-892f-4621-ae6e-ad932c2294b4. {{(pid=87165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 06 12:03:17 devstack sudo[107735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8acd07c8-e1dc-474d-863e-0fa5b9f098db_1j0w99rndevstack@QuobyteHD
Nov 06 12:03:17 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] Lock "cinder-quobyte-6a87ab5d-94f2-4a3b-87bd-1aadbf7638c6" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] snapshot: 113f979a-9611-4766-adf9-163ae4c61795, volume: 6a87ab5d-94f2-4a3b-87bd-1aadbf7638c6,  {{(pid=87165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d79cc5-e6da-46cf-bd47-47f62475573f]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857.113f979a-9611-4766-adf9-163ae4c61795 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[221fe888-92e3-462e-b597-530412ee163b]: (4, 'raw') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3caf4112-ecba-41f1-97bc-1a88bfcdc35a_ufo6473f {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:17 devstack sudo[107739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3caf4112-ecba-41f1-97bc-1a88bfcdc35a_ufo6473f
Nov 06 12:03:17 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:17 devstack sudo[107738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857.113f979a-9611-4766-adf9-163ae4c61795
Nov 06 12:03:17 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:17 devstack sudo[107738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8acd07c8-e1dc-474d-863e-0fa5b9f098db_1j0w99rndevstack@QuobyteHD" returned: 0 in 0.350s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8acd07c8-e1dc-474d-863e-0fa5b9f098db_1j0w99rndevstack@QuobyteHD {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:17 devstack sudo[107732]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d0693878-9a19-4a0c-8cc4-44486f97af96 tempest-CreateVolumesFromImageTest-1023581998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b6a1d7ce-eeee-4f83-88e3-8156e8638e9f" returned: 0 in 0.409s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d0693878-9a19-4a0c-8cc4-44486f97af96 tempest-CreateVolumesFromImageTest-1023581998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b6a1d7ce-eeee-4f83-88e3-8156e8638e9f {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:17 devstack sudo[107749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b6a1d7ce-eeee-4f83-88e3-8156e8638e9f
Nov 06 12:03:17 devstack sudo[107749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:18 devstack sudo[107748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8acd07c8-e1dc-474d-863e-0fa5b9f098db_1j0w99rndevstack@QuobyteHD
Nov 06 12:03:18 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:18 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3caf4112-ecba-41f1-97bc-1a88bfcdc35a_ufo6473f" returned: 0 in 0.386s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3caf4112-ecba-41f1-97bc-1a88bfcdc35a_ufo6473f {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:18 devstack sudo[107738]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857.113f979a-9611-4766-adf9-163ae4c61795" returned: 0 in 0.423s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:18 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2270067-0088-4742-9850-3770aea50857(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 12:03:18 devstack sudo[107749]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d0693878-9a19-4a0c-8cc4-44486f97af96 tempest-CreateVolumesFromImageTest-1023581998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b6a1d7ce-eeee-4f83-88e3-8156e8638e9f" returned: 0 in 0.266s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:18 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[00600c06-bbc2-4106-8add-e5d5f3b88d09]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:03:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:18 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d0693878-9a19-4a0c-8cc4-44486f97af96 tempest-CreateVolumesFromImageTest-1023581998 None] Lock "cinder-quobyte-b6a1d7ce-eeee-4f83-88e3-8156e8638e9f" released by "delete_volume" :: held 0.746s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:18 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8acd07c8-e1dc-474d-863e-0fa5b9f098db_1j0w99rndevstack@QuobyteHD" returned: 1 in 0.352s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8acd07c8-e1dc-474d-863e-0fa5b9f098db_1j0w99rndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 12:03:18 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] 8acd07c8-e1dc-474d-863e-0fa5b9f098db was raw, converting to qcow2 {{(pid=87165) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 06 12:03:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8acd07c8-e1dc-474d-863e-0fa5b9f098db_1j0w99rndevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bdb1129e-d670-4a18-af00-c427bad38669 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:18 devstack sudo[107758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3caf4112-ecba-41f1-97bc-1a88bfcdc35a_ufo6473f
Nov 06 12:03:18 devstack sudo[107758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:18 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-d0693878-9a19-4a0c-8cc4-44486f97af96 tempest-CreateVolumesFromImageTest-1023581998 None] Created reservations ['fa79babc-cc61-42b7-b711-5e867aa77f3b', '4d968946-2711-4f1c-ab51-9b4a5e7bf195', '4dcd0a5e-2395-45e9-b6b8-4839519ed0da', 'cad96600-f3b4-4cf8-9451-a4bc20dc2420'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:03:18 devstack sudo[107763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8acd07c8-e1dc-474d-863e-0fa5b9f098db_1j0w99rndevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bdb1129e-d670-4a18-af00-c427bad38669
Nov 06 12:03:18 devstack sudo[107763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:18 devstack sudo[107759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857
Nov 06 12:03:18 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d0693878-9a19-4a0c-8cc4-44486f97af96 tempest-CreateVolumesFromImageTest-1023581998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d0693878-9a19-4a0c-8cc4-44486f97af96 tempest-CreateVolumesFromImageTest-1023581998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:18 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-d0693878-9a19-4a0c-8cc4-44486f97af96 tempest-CreateVolumesFromImageTest-1023581998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:18 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-d0693878-9a19-4a0c-8cc4-44486f97af96 tempest-CreateVolumesFromImageTest-1023581998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d0693878-9a19-4a0c-8cc4-44486f97af96 tempest-CreateVolumesFromImageTest-1023581998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d0693878-9a19-4a0c-8cc4-44486f97af96 tempest-CreateVolumesFromImageTest-1023581998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:18 devstack sudo[107767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:03:18 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:18 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d9839156-12e5-4e7b-9f62-e639335d8a3c tempest-CreateVolumesFromImageTest-1023581998 None] Acquiring lock "cinder-6ce06884-03a1-45f2-abd8-a22849e9b2a3-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:18 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d9839156-12e5-4e7b-9f62-e639335d8a3c tempest-CreateVolumesFromImageTest-1023581998 None] Lock "cinder-6ce06884-03a1-45f2-abd8-a22849e9b2a3-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:18 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d9839156-12e5-4e7b-9f62-e639335d8a3c tempest-CreateVolumesFromImageTest-1023581998 None] Acquiring lock "cinder-quobyte-6ce06884-03a1-45f2-abd8-a22849e9b2a3" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:18 devstack sudo[107758]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:18 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d9839156-12e5-4e7b-9f62-e639335d8a3c tempest-CreateVolumesFromImageTest-1023581998 None] Lock "cinder-quobyte-6ce06884-03a1-45f2-abd8-a22849e9b2a3" acquired by "delete_volume" :: waited 0.023s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3caf4112-ecba-41f1-97bc-1a88bfcdc35a_ufo6473f" returned: 1 in 0.570s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3caf4112-ecba-41f1-97bc-1a88bfcdc35a_ufo6473f' failed. Not Retrying. {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 12:03:18 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dde9516-87a9-4062-b6af-e1b889b958c7]: (4, 'raw') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:03:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3caf4112-ecba-41f1-97bc-1a88bfcdc35a_otmkgmqudevstack@QuobyteHD {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:18 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:18 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbac2ef-8d25-4234-b594-c814a38c0f07]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:03:18 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d9839156-12e5-4e7b-9f62-e639335d8a3c tempest-CreateVolumesFromImageTest-1023581998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6ce06884-03a1-45f2-abd8-a22849e9b2a3 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857" returned: 0 in 0.561s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:18 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857 {{(pid=87165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 06 12:03:18 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] Creating direct copy from snapshot {{(pid=87165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 06 12:03:18 devstack cinder-volume[87165]: DEBUG cinder.utils [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] Path /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6a87ab5d-94f2-4a3b-87bd-1aadbf7638c6 not found in is_blk_device check {{(pid=87165) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 06 12:03:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6a87ab5d-94f2-4a3b-87bd-1aadbf7638c6 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d0693878-9a19-4a0c-8cc4-44486f97af96 tempest-CreateVolumesFromImageTest-1023581998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.392s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:18 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-d0693878-9a19-4a0c-8cc4-44486f97af96 tempest-CreateVolumesFromImageTest-1023581998 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:03:18 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-d0693878-9a19-4a0c-8cc4-44486f97af96 tempest-CreateVolumesFromImageTest-1023581998 None] Deleted volume successfully.
Nov 06 12:03:18 devstack sudo[107780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6a87ab5d-94f2-4a3b-87bd-1aadbf7638c6
Nov 06 12:03:18 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:18 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d0693878-9a19-4a0c-8cc4-44486f97af96 tempest-CreateVolumesFromImageTest-1023581998 None] Lock "cinder-b6a1d7ce-eeee-4f83-88e3-8156e8638e9f-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:18 devstack sudo[107778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3caf4112-ecba-41f1-97bc-1a88bfcdc35a_otmkgmqudevstack@QuobyteHD
Nov 06 12:03:18 devstack sudo[107778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:18 devstack sudo[107779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6ce06884-03a1-45f2-abd8-a22849e9b2a3
Nov 06 12:03:18 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:18 devstack sudo[107763]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8acd07c8-e1dc-474d-863e-0fa5b9f098db_1j0w99rndevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bdb1129e-d670-4a18-af00-c427bad38669" returned: 0 in 0.672s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:18 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8acd07c8-e1dc-474d-863e-0fa5b9f098db_1j0w99rndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bdb1129e-d670-4a18-af00-c427bad38669 {{(pid=87165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 12:03:18 devstack cinder-volume[87165]: INFO cinder.image.image_utils [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Converted 0.00 MB image at 0.00 MB/s
Nov 06 12:03:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bdb1129e-d670-4a18-af00-c427bad38669 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:19 devstack sudo[107785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bdb1129e-d670-4a18-af00-c427bad38669 1G
Nov 06 12:03:19 devstack sudo[107785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:19 devstack sudo[107778]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3caf4112-ecba-41f1-97bc-1a88bfcdc35a_otmkgmqudevstack@QuobyteHD" returned: 0 in 0.373s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3caf4112-ecba-41f1-97bc-1a88bfcdc35a_otmkgmqudevstack@QuobyteHD {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:19 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d9839156-12e5-4e7b-9f62-e639335d8a3c tempest-CreateVolumesFromImageTest-1023581998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6ce06884-03a1-45f2-abd8-a22849e9b2a3" returned: 0 in 0.430s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d9839156-12e5-4e7b-9f62-e639335d8a3c tempest-CreateVolumesFromImageTest-1023581998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6ce06884-03a1-45f2-abd8-a22849e9b2a3 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:19 devstack sudo[107799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6ce06884-03a1-45f2-abd8-a22849e9b2a3
Nov 06 12:03:19 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:19 devstack sudo[107795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3caf4112-ecba-41f1-97bc-1a88bfcdc35a_otmkgmqudevstack@QuobyteHD
Nov 06 12:03:19 devstack sudo[107795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:19 devstack sudo[107785]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bdb1129e-d670-4a18-af00-c427bad38669 1G" returned: 0 in 0.366s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:19 devstack cinder-volume[87165]: DEBUG cinder.volume.volume_utils [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Downloaded image 8acd07c8-e1dc-474d-863e-0fa5b9f098db ((None, [{'url': 'file:///opt/stack/data/glance/images/8acd07c8-e1dc-474d-863e-0fa5b9f098db', 'metadata': {}}])) to volume bdb1129e-d670-4a18-af00-c427bad38669 successfully. {{(pid=87165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 06 12:03:19 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Temporary image 8acd07c8-e1dc-474d-863e-0fa5b9f098db for user d98a5173e7d84f9a914df512c2b479c4 is deleted. {{(pid=87165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 06 12:03:19 devstack cinder-volume[87165]: DEBUG cinder.volume.volume_utils [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Marking volume bdb1129e-d670-4a18-af00-c427bad38669 as bootable. {{(pid=87165) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 06 12:03:19 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Copying metadata from image 8acd07c8-e1dc-474d-863e-0fa5b9f098db to bdb1129e-d670-4a18-af00-c427bad38669. {{(pid=87165) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 06 12:03:19 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Creating volume glance metadata for volume bdb1129e-d670-4a18-af00-c427bad38669 backed by image 8acd07c8-e1dc-474d-863e-0fa5b9f098db with: {'image_id': '8acd07c8-e1dc-474d-863e-0fa5b9f098db', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'fac7cc8e47acb20947fd62054289be52', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87165) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 06 12:03:19 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5905ee7-bd6f-490c-8b1e-1e814524540d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdb1129e-d670-4a18-af00-c427bad38669', 'volume_size': 1, 'image_id': '8acd07c8-e1dc-474d-863e-0fa5b9f098db', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8acd07c8-e1dc-474d-863e-0fa5b9f098db', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fac7cc8e47acb20947fd62054289be52', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5526812217b64973a9fb2ca17881c389', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6935185185dbe0ebeb1c8f0a9ef06df0a1fcb6e94ba345ebaf44b114568a6a90f926733b477aeb1c00f0bf3f21d8a6aa271d56e9d9cd42fd8362e41ac4bf2a8d', 'id': '8acd07c8-e1dc-474d-863e-0fa5b9f098db', 'created_at': datetime.datetime(2026, 11, 6, 11, 3, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 11, 3, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8acd07c8-e1dc-474d-863e-0fa5b9f098db/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x742c1e21e420>}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:19 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9407b473-2e83-4d6c-89bd-1997c89c63d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:19 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Volume volume-bdb1129e-d670-4a18-af00-c427bad38669 (bdb1129e-d670-4a18-af00-c427bad38669): created successfully
Nov 06 12:03:19 devstack sudo[107795]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:19 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9407b473-2e83-4d6c-89bd-1997c89c63d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:19 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:19 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Flow 'volume_create_manager' (986f2f3c-3933-43a4-876e-a02720f10d8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:03:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d9839156-12e5-4e7b-9f62-e639335d8a3c tempest-CreateVolumesFromImageTest-1023581998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6ce06884-03a1-45f2-abd8-a22849e9b2a3" returned: 0 in 0.394s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3caf4112-ecba-41f1-97bc-1a88bfcdc35a_otmkgmqudevstack@QuobyteHD" returned: 1 in 0.466s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3caf4112-ecba-41f1-97bc-1a88bfcdc35a_otmkgmqudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 06 12:03:19 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] 3caf4112-ecba-41f1-97bc-1a88bfcdc35a was raw, converting to qcow2 {{(pid=87165) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 06 12:03:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3caf4112-ecba-41f1-97bc-1a88bfcdc35a_otmkgmqudevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b148f22a-892f-4621-ae6e-ad932c2294b4 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:19 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d9839156-12e5-4e7b-9f62-e639335d8a3c tempest-CreateVolumesFromImageTest-1023581998 None] Lock "cinder-quobyte-6ce06884-03a1-45f2-abd8-a22849e9b2a3" released by "delete_volume" :: held 0.932s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:19 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-5ac0cbe1-73c3-411d-b412-aaab78f991a4 tempest-VolumeImageDependencyTests-1102662028 None] Created volume successfully.
Nov 06 12:03:19 devstack sudo[107814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3caf4112-ecba-41f1-97bc-1a88bfcdc35a_otmkgmqudevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b148f22a-892f-4621-ae6e-ad932c2294b4
Nov 06 12:03:19 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:19 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-d9839156-12e5-4e7b-9f62-e639335d8a3c tempest-CreateVolumesFromImageTest-1023581998 None] Created reservations ['6464cf7b-5dc1-4d4c-a15b-4b5c2a662526', 'c8d90113-5978-4c78-8532-f0e108e2e31d', '36e8eef4-2c15-42aa-9f0d-22f2414bf179', '253f75e4-a44d-4c9f-bcf6-dc104098213b'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:03:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d9839156-12e5-4e7b-9f62-e639335d8a3c tempest-CreateVolumesFromImageTest-1023581998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d9839156-12e5-4e7b-9f62-e639335d8a3c tempest-CreateVolumesFromImageTest-1023581998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:19 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-d9839156-12e5-4e7b-9f62-e639335d8a3c tempest-CreateVolumesFromImageTest-1023581998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:19 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-d9839156-12e5-4e7b-9f62-e639335d8a3c tempest-CreateVolumesFromImageTest-1023581998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d9839156-12e5-4e7b-9f62-e639335d8a3c tempest-CreateVolumesFromImageTest-1023581998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d9839156-12e5-4e7b-9f62-e639335d8a3c tempest-CreateVolumesFromImageTest-1023581998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:19 devstack sudo[107816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:03:19 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:20 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d9839156-12e5-4e7b-9f62-e639335d8a3c tempest-CreateVolumesFromImageTest-1023581998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.593s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:20 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-d9839156-12e5-4e7b-9f62-e639335d8a3c tempest-CreateVolumesFromImageTest-1023581998 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:03:20 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-d9839156-12e5-4e7b-9f62-e639335d8a3c tempest-CreateVolumesFromImageTest-1023581998 None] Deleted volume successfully.
Nov 06 12:03:20 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d9839156-12e5-4e7b-9f62-e639335d8a3c tempest-CreateVolumesFromImageTest-1023581998 None] Lock "cinder-6ce06884-03a1-45f2-abd8-a22849e9b2a3-delete_volume" released by "delete_volume" :: held 1.924s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:20 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3caf4112-ecba-41f1-97bc-1a88bfcdc35a_otmkgmqudevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b148f22a-892f-4621-ae6e-ad932c2294b4" returned: 0 in 0.974s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:20 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3caf4112-ecba-41f1-97bc-1a88bfcdc35a_otmkgmqudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b148f22a-892f-4621-ae6e-ad932c2294b4 {{(pid=87165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 12:03:20 devstack cinder-volume[87165]: INFO cinder.image.image_utils [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Converted 0.00 MB image at 0.00 MB/s
Nov 06 12:03:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b148f22a-892f-4621-ae6e-ad932c2294b4 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:20 devstack sudo[107824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b148f22a-892f-4621-ae6e-ad932c2294b4 1G
Nov 06 12:03:20 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:21 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-28e6b9d2-f9a6-43f3-bc13-28e676afb2ba tempest-VolumeImageDependencyTests-1102662028 None] Acquiring lock "cinder-bdb1129e-d670-4a18-af00-c427bad38669-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:21 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-28e6b9d2-f9a6-43f3-bc13-28e676afb2ba tempest-VolumeImageDependencyTests-1102662028 None] Lock "cinder-bdb1129e-d670-4a18-af00-c427bad38669-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:21 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-28e6b9d2-f9a6-43f3-bc13-28e676afb2ba tempest-VolumeImageDependencyTests-1102662028 None] Acquiring lock "cinder-quobyte-bdb1129e-d670-4a18-af00-c427bad38669" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:21 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-28e6b9d2-f9a6-43f3-bc13-28e676afb2ba tempest-VolumeImageDependencyTests-1102662028 None] Lock "cinder-quobyte-bdb1129e-d670-4a18-af00-c427bad38669" acquired by "delete_volume" :: waited 0.032s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:21 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9026e1e3-cb4f-4ece-ae82-c2bc67f3a8ff]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:03:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-28e6b9d2-f9a6-43f3-bc13-28e676afb2ba tempest-VolumeImageDependencyTests-1102662028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bdb1129e-d670-4a18-af00-c427bad38669 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:21 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b148f22a-892f-4621-ae6e-ad932c2294b4 1G" returned: 0 in 0.896s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:21 devstack cinder-volume[87165]: DEBUG cinder.volume.volume_utils [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Downloaded image 3caf4112-ecba-41f1-97bc-1a88bfcdc35a ((None, [{'url': 'file:///opt/stack/data/glance/images/3caf4112-ecba-41f1-97bc-1a88bfcdc35a', 'metadata': {}}])) to volume b148f22a-892f-4621-ae6e-ad932c2294b4 successfully. {{(pid=87165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 06 12:03:21 devstack sudo[107829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bdb1129e-d670-4a18-af00-c427bad38669
Nov 06 12:03:21 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:21 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Temporary image 3caf4112-ecba-41f1-97bc-1a88bfcdc35a for user d31cf1f9f7664587a454f4235ea8d02a is deleted. {{(pid=87165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 06 12:03:21 devstack cinder-volume[87165]: DEBUG cinder.volume.volume_utils [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Marking volume b148f22a-892f-4621-ae6e-ad932c2294b4 as bootable. {{(pid=87165) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 06 12:03:21 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Copying metadata from image 3caf4112-ecba-41f1-97bc-1a88bfcdc35a to b148f22a-892f-4621-ae6e-ad932c2294b4. {{(pid=87165) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 06 12:03:21 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Creating volume glance metadata for volume b148f22a-892f-4621-ae6e-ad932c2294b4 backed by image 3caf4112-ecba-41f1-97bc-1a88bfcdc35a with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '3caf4112-ecba-41f1-97bc-1a88bfcdc35a', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'd75d7549bd41f3abecda8807c18c6211', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87165) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 06 12:03:21 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (756302b8-64c1-4b4a-a341-c4f89600bebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b148f22a-892f-4621-ae6e-ad932c2294b4', 'volume_size': 1, 'image_id': '3caf4112-ecba-41f1-97bc-1a88bfcdc35a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3caf4112-ecba-41f1-97bc-1a88bfcdc35a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd75d7549bd41f3abecda8807c18c6211', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f3a143ac39bd4867b472ed4e2514227c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5c96451cbca81ba6df304ec392132a334709a10ad3d018c02f86bcecf804a688125bc576d923e0f6d3fd744b7a949b234acde3c68410bd4bed506536dcf09e81', 'id': '3caf4112-ecba-41f1-97bc-1a88bfcdc35a', 'created_at': datetime.datetime(2026, 11, 6, 11, 3, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 11, 3, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3caf4112-ecba-41f1-97bc-1a88bfcdc35a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x742c1e44be90>}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:21 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (654f1cd5-94b9-4341-ba08-a212c5ac0f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:21 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Volume volume-b148f22a-892f-4621-ae6e-ad932c2294b4 (b148f22a-892f-4621-ae6e-ad932c2294b4): created successfully
Nov 06 12:03:21 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (654f1cd5-94b9-4341-ba08-a212c5ac0f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:21 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Flow 'volume_create_manager' (4174ec46-15b1-49f0-b0a3-578582611ef2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:03:21 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-ba2b0b88-a4df-4c4f-8a6d-451dad2dbf48 tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Created volume successfully.
Nov 06 12:03:22 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a2ee8ca9-0989-4c9c-8d41-d0419685ea3a tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Acquiring lock "cinder-b148f22a-892f-4621-ae6e-ad932c2294b4-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:22 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a2ee8ca9-0989-4c9c-8d41-d0419685ea3a tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Lock "cinder-b148f22a-892f-4621-ae6e-ad932c2294b4-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:22 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-28e6b9d2-f9a6-43f3-bc13-28e676afb2ba tempest-VolumeImageDependencyTests-1102662028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bdb1129e-d670-4a18-af00-c427bad38669" returned: 0 in 0.756s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-28e6b9d2-f9a6-43f3-bc13-28e676afb2ba tempest-VolumeImageDependencyTests-1102662028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bdb1129e-d670-4a18-af00-c427bad38669 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:22 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a2ee8ca9-0989-4c9c-8d41-d0419685ea3a tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Acquiring lock "cinder-quobyte-b148f22a-892f-4621-ae6e-ad932c2294b4" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:22 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a2ee8ca9-0989-4c9c-8d41-d0419685ea3a tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Lock "cinder-quobyte-b148f22a-892f-4621-ae6e-ad932c2294b4" acquired by "delete_volume" :: waited 0.046s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:22 devstack sudo[107834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bdb1129e-d670-4a18-af00-c427bad38669
Nov 06 12:03:22 devstack sudo[107834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:22 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95eca1e-f5f4-49c8-9343-f213b97598fc]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:03:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a2ee8ca9-0989-4c9c-8d41-d0419685ea3a tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b148f22a-892f-4621-ae6e-ad932c2294b4 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:22 devstack sudo[107836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b148f22a-892f-4621-ae6e-ad932c2294b4
Nov 06 12:03:22 devstack sudo[107836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:22 devstack sudo[107834]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-28e6b9d2-f9a6-43f3-bc13-28e676afb2ba tempest-VolumeImageDependencyTests-1102662028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-bdb1129e-d670-4a18-af00-c427bad38669" returned: 0 in 0.523s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:22 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-28e6b9d2-f9a6-43f3-bc13-28e676afb2ba tempest-VolumeImageDependencyTests-1102662028 None] Lock "cinder-quobyte-bdb1129e-d670-4a18-af00-c427bad38669" released by "delete_volume" :: held 1.407s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:22 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-28e6b9d2-f9a6-43f3-bc13-28e676afb2ba tempest-VolumeImageDependencyTests-1102662028 None] Created reservations ['3ae2193d-722c-44fb-a333-301c46ad67d6', '452c459e-6e64-476c-b034-79049066ebf3', '8e2e539e-992a-4e7d-adb0-5baee9ef4e00', 'a35e1917-1cf0-4393-894c-5f446598308f'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:03:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-28e6b9d2-f9a6-43f3-bc13-28e676afb2ba tempest-VolumeImageDependencyTests-1102662028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-28e6b9d2-f9a6-43f3-bc13-28e676afb2ba tempest-VolumeImageDependencyTests-1102662028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:23 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-28e6b9d2-f9a6-43f3-bc13-28e676afb2ba tempest-VolumeImageDependencyTests-1102662028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:23 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-28e6b9d2-f9a6-43f3-bc13-28e676afb2ba tempest-VolumeImageDependencyTests-1102662028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-28e6b9d2-f9a6-43f3-bc13-28e676afb2ba tempest-VolumeImageDependencyTests-1102662028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-28e6b9d2-f9a6-43f3-bc13-28e676afb2ba tempest-VolumeImageDependencyTests-1102662028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:23 devstack sudo[107841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:03:23 devstack sudo[107841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:23 devstack sudo[107836]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a2ee8ca9-0989-4c9c-8d41-d0419685ea3a tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b148f22a-892f-4621-ae6e-ad932c2294b4" returned: 0 in 1.016s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a2ee8ca9-0989-4c9c-8d41-d0419685ea3a tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b148f22a-892f-4621-ae6e-ad932c2294b4 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:23 devstack sudo[107844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b148f22a-892f-4621-ae6e-ad932c2294b4
Nov 06 12:03:23 devstack sudo[107844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:23 devstack sudo[107841]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-28e6b9d2-f9a6-43f3-bc13-28e676afb2ba tempest-VolumeImageDependencyTests-1102662028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.385s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:23 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-28e6b9d2-f9a6-43f3-bc13-28e676afb2ba tempest-VolumeImageDependencyTests-1102662028 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:03:23 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-28e6b9d2-f9a6-43f3-bc13-28e676afb2ba tempest-VolumeImageDependencyTests-1102662028 None] Deleted volume successfully.
Nov 06 12:03:23 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-28e6b9d2-f9a6-43f3-bc13-28e676afb2ba tempest-VolumeImageDependencyTests-1102662028 None] Lock "cinder-bdb1129e-d670-4a18-af00-c427bad38669-delete_volume" released by "delete_volume" :: held 2.367s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:23 devstack sudo[107844]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a2ee8ca9-0989-4c9c-8d41-d0419685ea3a tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-b148f22a-892f-4621-ae6e-ad932c2294b4" returned: 0 in 0.481s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:23 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a2ee8ca9-0989-4c9c-8d41-d0419685ea3a tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Lock "cinder-quobyte-b148f22a-892f-4621-ae6e-ad932c2294b4" released by "delete_volume" :: held 1.626s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:24 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-a2ee8ca9-0989-4c9c-8d41-d0419685ea3a tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Created reservations ['cbb82bd3-d89f-4ee3-8794-b970f6dd2d12', '56b1096b-cb18-4f88-a585-46fa42751e2d', '45417d88-d454-416c-a10d-0a432fca8982', '11ebb783-1e62-4a69-9903-9e206305521b'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:03:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a2ee8ca9-0989-4c9c-8d41-d0419685ea3a tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a2ee8ca9-0989-4c9c-8d41-d0419685ea3a tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:24 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a2ee8ca9-0989-4c9c-8d41-d0419685ea3a tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:24 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a2ee8ca9-0989-4c9c-8d41-d0419685ea3a tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a2ee8ca9-0989-4c9c-8d41-d0419685ea3a tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a2ee8ca9-0989-4c9c-8d41-d0419685ea3a tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:24 devstack sudo[107848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:03:24 devstack sudo[107848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:24 devstack sudo[107848]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a2ee8ca9-0989-4c9c-8d41-d0419685ea3a tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.738s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:24 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-a2ee8ca9-0989-4c9c-8d41-d0419685ea3a tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:03:24 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-a2ee8ca9-0989-4c9c-8d41-d0419685ea3a tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Deleted volume successfully.
Nov 06 12:03:25 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a2ee8ca9-0989-4c9c-8d41-d0419685ea3a tempest-VolumeAndVolumeTypeFromImageTest-2118973153 None] Lock "cinder-b148f22a-892f-4621-ae6e-ad932c2294b4-delete_volume" released by "delete_volume" :: held 2.946s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:27 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6a87ab5d-94f2-4a3b-87bd-1aadbf7638c6" returned: 0 in 8.708s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:27 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] Image conversion details: src /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857, size 1024.00 MB, duration 8.71 sec, destination /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6a87ab5d-94f2-4a3b-87bd-1aadbf7638c6 {{(pid=87165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 12:03:27 devstack cinder-volume[87165]: INFO cinder.image.image_utils [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] Converted 1024.00 MB image at 117.58 MB/s
Nov 06 12:03:27 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6a87ab5d-94f2-4a3b-87bd-1aadbf7638c6 is being set with open permissions: ugo+rw
Nov 06 12:03:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6a87ab5d-94f2-4a3b-87bd-1aadbf7638c6 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:27 devstack sudo[107852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6a87ab5d-94f2-4a3b-87bd-1aadbf7638c6
Nov 06 12:03:27 devstack sudo[107852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:27 devstack sudo[107852]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6a87ab5d-94f2-4a3b-87bd-1aadbf7638c6" returned: 0 in 0.456s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:27 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] Lock "cinder-quobyte-6a87ab5d-94f2-4a3b-87bd-1aadbf7638c6" released by "_copy_volume_from_snapshot" :: held 10.260s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:28 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] Lock "cinder-quobyte-113f979a-9611-4766-adf9-163ae4c61795-6a87ab5d-94f2-4a3b-87bd-1aadbf7638c6" released by "_create_volume_from_snapshot" :: held 10.355s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.386s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:28 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (806be4a1-975e-40bf-964a-386481b8b0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a87ab5d-94f2-4a3b-87bd-1aadbf7638c6', 'volume_size': 1, 'snapshot_id': '113f979a-9611-4766-adf9-163ae4c61795'}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:28 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6f45df2-7e0d-4439-a3e3-c8ff6da0fba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:28 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] Volume volume-6a87ab5d-94f2-4a3b-87bd-1aadbf7638c6 (6a87ab5d-94f2-4a3b-87bd-1aadbf7638c6): created successfully
Nov 06 12:03:28 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6f45df2-7e0d-4439-a3e3-c8ff6da0fba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:28 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] Flow 'volume_create_manager' (5b2551c0-a132-4db8-ae51-debb2184a363) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:03:28 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-50b2e597-692c-4d26-825d-b3007d095305 tempest-CreateVolumesFromSnapshotTest-998218628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:03:28 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-50b2e597-692c-4d26-825d-b3007d095305 tempest-CreateVolumesFromSnapshotTest-998218628 None] Flow 'volume_create_manager' (e692b989-208e-4f1b-9985-45330a1e9fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:03:28 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-50b2e597-692c-4d26-825d-b3007d095305 tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cec62bf9-7fb7-411f-95d4-5641511d436b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:28 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-50b2e597-692c-4d26-825d-b3007d095305 tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cec62bf9-7fb7-411f-95d4-5641511d436b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1134688498',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b500dc8-e60a-4c01-a3cc-d9c4de537d4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf8ab2e2f801464eb8a1acb7e214bc52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:28Z,use_quota=True,user_id='5f4273e4066d4ed09f3949c126bc4417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:28 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-50b2e597-692c-4d26-825d-b3007d095305 tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (775da64b-b313-4f5a-8950-9ec6cdaee6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:28 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-50b2e597-692c-4d26-825d-b3007d095305 tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (775da64b-b313-4f5a-8950-9ec6cdaee6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:28 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-50b2e597-692c-4d26-825d-b3007d095305 tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02336117-b20f-481c-81e9-1373ebc3f03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:28 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-50b2e597-692c-4d26-825d-b3007d095305 tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02336117-b20f-481c-81e9-1373ebc3f03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b500dc8-e60a-4c01-a3cc-d9c4de537d4f', 'volume_name': 'volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:28 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-50b2e597-692c-4d26-825d-b3007d095305 tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9878755-2536-4dda-b374-843021eaa0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:28 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-50b2e597-692c-4d26-825d-b3007d095305 tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9878755-2536-4dda-b374-843021eaa0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:28 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-50b2e597-692c-4d26-825d-b3007d095305 tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89a0da79-49b8-4cb3-9524-6daecccc5848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:28 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-50b2e597-692c-4d26-825d-b3007d095305 tempest-CreateVolumesFromSnapshotTest-998218628 None] Volume 3b500dc8-e60a-4c01-a3cc-d9c4de537d4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f', 'volume_size': 1}
Nov 06 12:03:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-50b2e597-692c-4d26-825d-b3007d095305 tempest-CreateVolumesFromSnapshotTest-998218628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-50b2e597-692c-4d26-825d-b3007d095305 tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:28 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-50b2e597-692c-4d26-825d-b3007d095305 tempest-CreateVolumesFromSnapshotTest-998218628 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1134688498',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b500dc8-e60a-4c01-a3cc-d9c4de537d4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf8ab2e2f801464eb8a1acb7e214bc52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:28Z,use_quota=True,user_id='5f4273e4066d4ed09f3949c126bc4417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:03:28 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-50b2e597-692c-4d26-825d-b3007d095305 tempest-CreateVolumesFromSnapshotTest-998218628 None] Creating volume 3b500dc8-e60a-4c01-a3cc-d9c4de537d4f {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:03:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-50b2e597-692c-4d26-825d-b3007d095305 tempest-CreateVolumesFromSnapshotTest-998218628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-50b2e597-692c-4d26-825d-b3007d095305 tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:28 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-50b2e597-692c-4d26-825d-b3007d095305 tempest-CreateVolumesFromSnapshotTest-998218628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:28 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-50b2e597-692c-4d26-825d-b3007d095305 tempest-CreateVolumesFromSnapshotTest-998218628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-50b2e597-692c-4d26-825d-b3007d095305 tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:28 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-50b2e597-692c-4d26-825d-b3007d095305 tempest-CreateVolumesFromSnapshotTest-998218628 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:03:28 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-50b2e597-692c-4d26-825d-b3007d095305 tempest-CreateVolumesFromSnapshotTest-998218628 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:03:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-50b2e597-692c-4d26-825d-b3007d095305 tempest-CreateVolumesFromSnapshotTest-998218628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:28 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-2ef5d47c-e2a1-4438-bcd2-eef13dc0cce6 tempest-VolumeDependencyTests-1785368670 None] Created volume successfully.
Nov 06 12:03:28 devstack sudo[107857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f 1073741824
Nov 06 12:03:28 devstack sudo[107857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:28 devstack sudo[107857]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-50b2e597-692c-4d26-825d-b3007d095305 tempest-CreateVolumesFromSnapshotTest-998218628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f 1073741824" returned: 0 in 0.525s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-50b2e597-692c-4d26-825d-b3007d095305 tempest-CreateVolumesFromSnapshotTest-998218628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:28 devstack sudo[107863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f
Nov 06 12:03:28 devstack sudo[107863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:29 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0b056de9-d449-4066-8cfc-77df64b10519 tempest-VolumeDependencyTests-1785368670 None] Acquiring lock "cinder-113f979a-9611-4766-adf9-163ae4c61795-delete_snapshot" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:29 devstack sudo[107863]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:29 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0b056de9-d449-4066-8cfc-77df64b10519 tempest-VolumeDependencyTests-1785368670 None] Lock "cinder-113f979a-9611-4766-adf9-163ae4c61795-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:29 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0b056de9-d449-4066-8cfc-77df64b10519 tempest-VolumeDependencyTests-1785368670 None] Acquiring lock "cinder-quobyte-d2270067-0088-4742-9850-3770aea50857" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-50b2e597-692c-4d26-825d-b3007d095305 tempest-CreateVolumesFromSnapshotTest-998218628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f" returned: 0 in 0.307s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:29 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-50b2e597-692c-4d26-825d-b3007d095305 tempest-CreateVolumesFromSnapshotTest-998218628 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:03:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-50b2e597-692c-4d26-825d-b3007d095305 tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:29 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-50b2e597-692c-4d26-825d-b3007d095305 tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89a0da79-49b8-4cb3-9524-6daecccc5848) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:29 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-50b2e597-692c-4d26-825d-b3007d095305 tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3adff16-087b-4338-a494-10df6fe08f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:29 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0b056de9-d449-4066-8cfc-77df64b10519 tempest-VolumeDependencyTests-1785368670 None] Lock "cinder-quobyte-d2270067-0088-4742-9850-3770aea50857" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:29 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0b056de9-d449-4066-8cfc-77df64b10519 tempest-VolumeDependencyTests-1785368670 None] Acquiring lock "cinder-quobyte-113f979a-9611-4766-adf9-163ae4c61795" by "_delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:29 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-50b2e597-692c-4d26-825d-b3007d095305 tempest-CreateVolumesFromSnapshotTest-998218628 None] Volume volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f (3b500dc8-e60a-4c01-a3cc-d9c4de537d4f): created successfully
Nov 06 12:03:29 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-50b2e597-692c-4d26-825d-b3007d095305 tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3adff16-087b-4338-a494-10df6fe08f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:29 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-50b2e597-692c-4d26-825d-b3007d095305 tempest-CreateVolumesFromSnapshotTest-998218628 None] Flow 'volume_create_manager' (e692b989-208e-4f1b-9985-45330a1e9fcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:03:29 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0b056de9-d449-4066-8cfc-77df64b10519 tempest-VolumeDependencyTests-1785368670 None] Lock "cinder-quobyte-113f979a-9611-4766-adf9-163ae4c61795" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:29 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-0b056de9-d449-4066-8cfc-77df64b10519 tempest-VolumeDependencyTests-1785368670 None] Deleting offline snapshot 113f979a-9611-4766-adf9-163ae4c61795 of volume d2270067-0088-4742-9850-3770aea50857 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 12:03:29 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-0b056de9-d449-4066-8cfc-77df64b10519 tempest-VolumeDependencyTests-1785368670 None] snapshot_file for this snap is: volume-d2270067-0088-4742-9850-3770aea50857.113f979a-9611-4766-adf9-163ae4c61795 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 12:03:29 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-50b2e597-692c-4d26-825d-b3007d095305 tempest-CreateVolumesFromSnapshotTest-998218628 None] Created volume successfully.
Nov 06 12:03:29 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3954850-4440-4330-b3f8-8969f27d57ba]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:03:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0b056de9-d449-4066-8cfc-77df64b10519 tempest-VolumeDependencyTests-1785368670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857.113f979a-9611-4766-adf9-163ae4c61795 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:29 devstack sudo[107866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857.113f979a-9611-4766-adf9-163ae4c61795
Nov 06 12:03:29 devstack sudo[107866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:29 devstack sudo[107866]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0b056de9-d449-4066-8cfc-77df64b10519 tempest-VolumeDependencyTests-1785368670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857.113f979a-9611-4766-adf9-163ae4c61795" returned: 0 in 0.400s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:29 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-0b056de9-d449-4066-8cfc-77df64b10519 tempest-VolumeDependencyTests-1785368670 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2270067-0088-4742-9850-3770aea50857(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 12:03:29 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[506a70a3-33f6-4c83-83fa-897f77f3f7c2]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:03:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0b056de9-d449-4066-8cfc-77df64b10519 tempest-VolumeDependencyTests-1785368670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:29 devstack sudo[107872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857
Nov 06 12:03:29 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:30 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0b056de9-d449-4066-8cfc-77df64b10519 tempest-VolumeDependencyTests-1785368670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857" returned: 0 in 0.609s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0b056de9-d449-4066-8cfc-77df64b10519 tempest-VolumeDependencyTests-1785368670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857.113f979a-9611-4766-adf9-163ae4c61795 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:30 devstack sudo[107878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857.113f979a-9611-4766-adf9-163ae4c61795
Nov 06 12:03:30 devstack sudo[107878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b016e90e-a61a-43d3-9375-b8d6da9a82e7 tempest-CreateVolumesFromSnapshotTest-998218628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b016e90e-a61a-43d3-9375-b8d6da9a82e7 tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:30 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-b016e90e-a61a-43d3-9375-b8d6da9a82e7 tempest-CreateVolumesFromSnapshotTest-998218628 None] Creating offline snapshot fecb6ef2-3bb3-4d41-b986-fc40834b3753 of volume 3b500dc8-e60a-4c01-a3cc-d9c4de537d4f {{(pid=87165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 12:03:30 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[626c5262-933d-4ea4-b083-e75b0c854157]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:03:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b016e90e-a61a-43d3-9375-b8d6da9a82e7 tempest-CreateVolumesFromSnapshotTest-998218628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:30 devstack sudo[107880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f
Nov 06 12:03:30 devstack sudo[107880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:30 devstack sudo[107878]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0b056de9-d449-4066-8cfc-77df64b10519 tempest-VolumeDependencyTests-1785368670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857.113f979a-9611-4766-adf9-163ae4c61795" returned: 0 in 0.418s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0b056de9-d449-4066-8cfc-77df64b10519 tempest-VolumeDependencyTests-1785368670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857.113f979a-9611-4766-adf9-163ae4c61795 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:30 devstack sudo[107886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857.113f979a-9611-4766-adf9-163ae4c61795
Nov 06 12:03:30 devstack sudo[107886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:30 devstack sudo[107880]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b016e90e-a61a-43d3-9375-b8d6da9a82e7 tempest-CreateVolumesFromSnapshotTest-998218628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f" returned: 0 in 0.395s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b016e90e-a61a-43d3-9375-b8d6da9a82e7 tempest-CreateVolumesFromSnapshotTest-998218628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f.fecb6ef2-3bb3-4d41-b986-fc40834b3753 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:30 devstack sudo[107891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f.fecb6ef2-3bb3-4d41-b986-fc40834b3753 1G
Nov 06 12:03:30 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:31 devstack sudo[107886]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0b056de9-d449-4066-8cfc-77df64b10519 tempest-VolumeDependencyTests-1785368670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857.113f979a-9611-4766-adf9-163ae4c61795" returned: 0 in 0.342s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:31 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0b056de9-d449-4066-8cfc-77df64b10519 tempest-VolumeDependencyTests-1785368670 None] Lock "cinder-quobyte-113f979a-9611-4766-adf9-163ae4c61795" released by "_delete_snapshot" :: held 1.963s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:31 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0b056de9-d449-4066-8cfc-77df64b10519 tempest-VolumeDependencyTests-1785368670 None] Lock "cinder-quobyte-d2270067-0088-4742-9850-3770aea50857" released by "delete_snapshot" :: held 2.018s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:31 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-0b056de9-d449-4066-8cfc-77df64b10519 tempest-VolumeDependencyTests-1785368670 None] Created reservations ['8f1e2c55-965a-4b51-a7d9-75726e9f79dd', '648ce481-b493-4aeb-9b11-58160312df59', '06ee4b84-34fc-4349-971c-2c419b040b33', '878bf823-5385-420c-bd22-aa2b318c71d3'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:03:31 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-45bbad9e-4439-44cb-8392-d276deaced3a tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:03:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-45bbad9e-4439-44cb-8392-d276deaced3a tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Flow 'volume_create_manager' (5d9e18f4-2ea8-44c3-b06b-076dcc4f0738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:03:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-45bbad9e-4439-44cb-8392-d276deaced3a tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee681b4c-1d8a-4939-bb08-32530e1edb29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-45bbad9e-4439-44cb-8392-d276deaced3a tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee681b4c-1d8a-4939-bb08-32530e1edb29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:03:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-699544389',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64186387-a895-4ffd-a6cb-d6daf1b74cf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da410887685d462a87549836b08a546c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:31Z,use_quota=True,user_id='62a0bda5ea9349baa1f40d765c852d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-45bbad9e-4439-44cb-8392-d276deaced3a tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10437111-6f57-4941-a3ba-da2e5fb52c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-45bbad9e-4439-44cb-8392-d276deaced3a tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10437111-6f57-4941-a3ba-da2e5fb52c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-45bbad9e-4439-44cb-8392-d276deaced3a tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2ed1955-5609-4d09-a2ad-9ead0d73ff73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-45bbad9e-4439-44cb-8392-d276deaced3a tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2ed1955-5609-4d09-a2ad-9ead0d73ff73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64186387-a895-4ffd-a6cb-d6daf1b74cf9', 'volume_name': 'volume-64186387-a895-4ffd-a6cb-d6daf1b74cf9', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-45bbad9e-4439-44cb-8392-d276deaced3a tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (122a5316-6182-4eb1-b318-04fe01199852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-45bbad9e-4439-44cb-8392-d276deaced3a tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (122a5316-6182-4eb1-b318-04fe01199852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:31 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-45bbad9e-4439-44cb-8392-d276deaced3a tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e964c898-fb0a-4486-b91a-58e8346ab27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:31 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-45bbad9e-4439-44cb-8392-d276deaced3a tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Volume 64186387-a895-4ffd-a6cb-d6daf1b74cf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64186387-a895-4ffd-a6cb-d6daf1b74cf9', 'volume_size': 1}
Nov 06 12:03:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-45bbad9e-4439-44cb-8392-d276deaced3a tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:31 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-0b056de9-d449-4066-8cfc-77df64b10519 tempest-VolumeDependencyTests-1785368670 None] Delete snapshot completed successfully.
Nov 06 12:03:31 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0b056de9-d449-4066-8cfc-77df64b10519 tempest-VolumeDependencyTests-1785368670 None] Lock "cinder-113f979a-9611-4766-adf9-163ae4c61795-delete_snapshot" released by "delete_snapshot" :: held 2.340s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:31 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b016e90e-a61a-43d3-9375-b8d6da9a82e7 tempest-CreateVolumesFromSnapshotTest-998218628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f.fecb6ef2-3bb3-4d41-b986-fc40834b3753 1G" returned: 0 in 0.619s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b016e90e-a61a-43d3-9375-b8d6da9a82e7 tempest-CreateVolumesFromSnapshotTest-998218628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f.fecb6ef2-3bb3-4d41-b986-fc40834b3753 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:31 devstack sudo[107898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f.fecb6ef2-3bb3-4d41-b986-fc40834b3753
Nov 06 12:03:31 devstack sudo[107898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:31 devstack sudo[107898]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b016e90e-a61a-43d3-9375-b8d6da9a82e7 tempest-CreateVolumesFromSnapshotTest-998218628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f.fecb6ef2-3bb3-4d41-b986-fc40834b3753" returned: 0 in 0.297s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:31 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-b016e90e-a61a-43d3-9375-b8d6da9a82e7 tempest-CreateVolumesFromSnapshotTest-998218628 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f.fecb6ef2-3bb3-4d41-b986-fc40834b3753 is being set with open permissions: ugo+rw
Nov 06 12:03:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b016e90e-a61a-43d3-9375-b8d6da9a82e7 tempest-CreateVolumesFromSnapshotTest-998218628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f.fecb6ef2-3bb3-4d41-b986-fc40834b3753 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:31 devstack sudo[107903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f.fecb6ef2-3bb3-4d41-b986-fc40834b3753
Nov 06 12:03:31 devstack sudo[107903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:32 devstack sudo[107903]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b016e90e-a61a-43d3-9375-b8d6da9a82e7 tempest-CreateVolumesFromSnapshotTest-998218628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f.fecb6ef2-3bb3-4d41-b986-fc40834b3753" returned: 0 in 0.240s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b016e90e-a61a-43d3-9375-b8d6da9a82e7 tempest-CreateVolumesFromSnapshotTest-998218628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:32 devstack sudo[107906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f.info
Nov 06 12:03:32 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:32 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-14ea3d2b-8061-432c-8030-64f2dc25c590 tempest-VolumeDependencyTests-1785368670 None] Acquiring lock "cinder-d2270067-0088-4742-9850-3770aea50857-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:32 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-14ea3d2b-8061-432c-8030-64f2dc25c590 tempest-VolumeDependencyTests-1785368670 None] Lock "cinder-d2270067-0088-4742-9850-3770aea50857-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:32 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b016e90e-a61a-43d3-9375-b8d6da9a82e7 tempest-CreateVolumesFromSnapshotTest-998218628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f.info" returned: 0 in 0.268s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:32 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-b016e90e-a61a-43d3-9375-b8d6da9a82e7 tempest-CreateVolumesFromSnapshotTest-998218628 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f.info is being set with open permissions: ugo+rw
Nov 06 12:03:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b016e90e-a61a-43d3-9375-b8d6da9a82e7 tempest-CreateVolumesFromSnapshotTest-998218628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:32 devstack sudo[107909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f.info
Nov 06 12:03:32 devstack sudo[107909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:32 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-14ea3d2b-8061-432c-8030-64f2dc25c590 tempest-VolumeDependencyTests-1785368670 None] Acquiring lock "cinder-quobyte-d2270067-0088-4742-9850-3770aea50857" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:32 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-14ea3d2b-8061-432c-8030-64f2dc25c590 tempest-VolumeDependencyTests-1785368670 None] Lock "cinder-quobyte-d2270067-0088-4742-9850-3770aea50857" acquired by "delete_volume" :: waited 0.016s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:32 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a8a1d0-9fbc-43c5-a086-293ce725e80b]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:03:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-14ea3d2b-8061-432c-8030-64f2dc25c590 tempest-VolumeDependencyTests-1785368670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:32 devstack sudo[107911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857
Nov 06 12:03:32 devstack sudo[107911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:32 devstack sudo[107909]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b016e90e-a61a-43d3-9375-b8d6da9a82e7 tempest-CreateVolumesFromSnapshotTest-998218628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f.info" returned: 0 in 0.258s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b016e90e-a61a-43d3-9375-b8d6da9a82e7 tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.178s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-45bbad9e-4439-44cb-8392-d276deaced3a tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.233s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:32 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-45bbad9e-4439-44cb-8392-d276deaced3a tempest-CreateVolumesFromSourceVolumeTest-889966002 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:03:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-699544389',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64186387-a895-4ffd-a6cb-d6daf1b74cf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da410887685d462a87549836b08a546c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:31Z,use_quota=True,user_id='62a0bda5ea9349baa1f40d765c852d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:03:32 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-45bbad9e-4439-44cb-8392-d276deaced3a tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Creating volume 64186387-a895-4ffd-a6cb-d6daf1b74cf9 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:03:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-45bbad9e-4439-44cb-8392-d276deaced3a tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-45bbad9e-4439-44cb-8392-d276deaced3a tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:32 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-45bbad9e-4439-44cb-8392-d276deaced3a tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:32 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-45bbad9e-4439-44cb-8392-d276deaced3a tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-45bbad9e-4439-44cb-8392-d276deaced3a tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:32 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-45bbad9e-4439-44cb-8392-d276deaced3a tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:03:32 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-45bbad9e-4439-44cb-8392-d276deaced3a tempest-CreateVolumesFromSourceVolumeTest-889966002 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:03:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-45bbad9e-4439-44cb-8392-d276deaced3a tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-64186387-a895-4ffd-a6cb-d6daf1b74cf9 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:32 devstack sudo[107914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-64186387-a895-4ffd-a6cb-d6daf1b74cf9 1073741824
Nov 06 12:03:32 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:32 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-b016e90e-a61a-43d3-9375-b8d6da9a82e7 tempest-CreateVolumesFromSnapshotTest-998218628 None] Create snapshot completed successfully
Nov 06 12:03:32 devstack sudo[107911]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-14ea3d2b-8061-432c-8030-64f2dc25c590 tempest-VolumeDependencyTests-1785368670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857" returned: 0 in 0.395s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-14ea3d2b-8061-432c-8030-64f2dc25c590 tempest-VolumeDependencyTests-1785368670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:32 devstack sudo[107919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857
Nov 06 12:03:32 devstack sudo[107919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:33 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-45bbad9e-4439-44cb-8392-d276deaced3a tempest-CreateVolumesFromSourceVolumeTest-889966002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-64186387-a895-4ffd-a6cb-d6daf1b74cf9 1073741824" returned: 0 in 0.462s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:33 devstack sudo[107919]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-45bbad9e-4439-44cb-8392-d276deaced3a tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-64186387-a895-4ffd-a6cb-d6daf1b74cf9 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-14ea3d2b-8061-432c-8030-64f2dc25c590 tempest-VolumeDependencyTests-1785368670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-d2270067-0088-4742-9850-3770aea50857" returned: 0 in 0.312s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:33 devstack sudo[107925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-64186387-a895-4ffd-a6cb-d6daf1b74cf9
Nov 06 12:03:33 devstack sudo[107925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:33 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-14ea3d2b-8061-432c-8030-64f2dc25c590 tempest-VolumeDependencyTests-1785368670 None] Lock "cinder-quobyte-d2270067-0088-4742-9850-3770aea50857" released by "delete_volume" :: held 0.779s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:33 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-14ea3d2b-8061-432c-8030-64f2dc25c590 tempest-VolumeDependencyTests-1785368670 None] Created reservations ['33dd9080-f431-4591-aded-82e02bd3ee8c', '76cb027f-2b1f-4b97-b448-3ecaed6babc1', '7cff4293-fefb-4c31-82a4-6d3952d5a855', 'f6a37969-c7fb-4b0d-8bf8-b5f4062195b2'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:03:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-14ea3d2b-8061-432c-8030-64f2dc25c590 tempest-VolumeDependencyTests-1785368670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-14ea3d2b-8061-432c-8030-64f2dc25c590 tempest-VolumeDependencyTests-1785368670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:33 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-14ea3d2b-8061-432c-8030-64f2dc25c590 tempest-VolumeDependencyTests-1785368670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:33 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-14ea3d2b-8061-432c-8030-64f2dc25c590 tempest-VolumeDependencyTests-1785368670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-14ea3d2b-8061-432c-8030-64f2dc25c590 tempest-VolumeDependencyTests-1785368670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-14ea3d2b-8061-432c-8030-64f2dc25c590 tempest-VolumeDependencyTests-1785368670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:33 devstack sudo[107927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:03:33 devstack sudo[107927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:33 devstack sudo[107925]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-45bbad9e-4439-44cb-8392-d276deaced3a tempest-CreateVolumesFromSourceVolumeTest-889966002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-64186387-a895-4ffd-a6cb-d6daf1b74cf9" returned: 0 in 0.311s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:33 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-45bbad9e-4439-44cb-8392-d276deaced3a tempest-CreateVolumesFromSourceVolumeTest-889966002 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:03:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-45bbad9e-4439-44cb-8392-d276deaced3a tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:33 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-45bbad9e-4439-44cb-8392-d276deaced3a tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e964c898-fb0a-4486-b91a-58e8346ab27d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64186387-a895-4ffd-a6cb-d6daf1b74cf9', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:33 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-45bbad9e-4439-44cb-8392-d276deaced3a tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eec0580d-a333-49f7-8300-368f1092aaa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:33 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5e9406dc-c308-4bda-ae89-1eb2cf96f433 tempest-VolumeDependencyTests-1785368670 None] Acquiring lock "cinder-6a87ab5d-94f2-4a3b-87bd-1aadbf7638c6-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:33 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-45bbad9e-4439-44cb-8392-d276deaced3a tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Volume volume-64186387-a895-4ffd-a6cb-d6daf1b74cf9 (64186387-a895-4ffd-a6cb-d6daf1b74cf9): created successfully
Nov 06 12:03:33 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-45bbad9e-4439-44cb-8392-d276deaced3a tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eec0580d-a333-49f7-8300-368f1092aaa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:33 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-45bbad9e-4439-44cb-8392-d276deaced3a tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Flow 'volume_create_manager' (5d9e18f4-2ea8-44c3-b06b-076dcc4f0738) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:03:33 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5e9406dc-c308-4bda-ae89-1eb2cf96f433 tempest-VolumeDependencyTests-1785368670 None] Lock "cinder-6a87ab5d-94f2-4a3b-87bd-1aadbf7638c6-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:33 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-45bbad9e-4439-44cb-8392-d276deaced3a tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Created volume successfully.
Nov 06 12:03:33 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5e9406dc-c308-4bda-ae89-1eb2cf96f433 tempest-VolumeDependencyTests-1785368670 None] Acquiring lock "cinder-quobyte-6a87ab5d-94f2-4a3b-87bd-1aadbf7638c6" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:33 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5e9406dc-c308-4bda-ae89-1eb2cf96f433 tempest-VolumeDependencyTests-1785368670 None] Lock "cinder-quobyte-6a87ab5d-94f2-4a3b-87bd-1aadbf7638c6" acquired by "delete_volume" :: waited 0.025s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:33 devstack sudo[107927]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-14ea3d2b-8061-432c-8030-64f2dc25c590 tempest-VolumeDependencyTests-1785368670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.350s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:33 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-14ea3d2b-8061-432c-8030-64f2dc25c590 tempest-VolumeDependencyTests-1785368670 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:03:33 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[848b6ea5-340c-4bb9-b33b-74f605c2596b]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:03:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5e9406dc-c308-4bda-ae89-1eb2cf96f433 tempest-VolumeDependencyTests-1785368670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6a87ab5d-94f2-4a3b-87bd-1aadbf7638c6 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:33 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-14ea3d2b-8061-432c-8030-64f2dc25c590 tempest-VolumeDependencyTests-1785368670 None] Deleted volume successfully.
Nov 06 12:03:33 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-14ea3d2b-8061-432c-8030-64f2dc25c590 tempest-VolumeDependencyTests-1785368670 None] Lock "cinder-d2270067-0088-4742-9850-3770aea50857-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:33 devstack sudo[107931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6a87ab5d-94f2-4a3b-87bd-1aadbf7638c6
Nov 06 12:03:33 devstack sudo[107931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:34 devstack sudo[107931]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5e9406dc-c308-4bda-ae89-1eb2cf96f433 tempest-VolumeDependencyTests-1785368670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6a87ab5d-94f2-4a3b-87bd-1aadbf7638c6" returned: 0 in 0.487s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5e9406dc-c308-4bda-ae89-1eb2cf96f433 tempest-VolumeDependencyTests-1785368670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6a87ab5d-94f2-4a3b-87bd-1aadbf7638c6 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:34 devstack sudo[107937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6a87ab5d-94f2-4a3b-87bd-1aadbf7638c6
Nov 06 12:03:34 devstack sudo[107937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:34 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-0de29d21-cbbe-4408-9b19-db916c86578d tempest-CreateVolumesFromSnapshotTest-998218628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:03:34 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-0de29d21-cbbe-4408-9b19-db916c86578d tempest-CreateVolumesFromSnapshotTest-998218628 None] Flow 'volume_create_manager' (e0372017-d7cf-47be-b326-4dc238cb373c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:03:34 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-0de29d21-cbbe-4408-9b19-db916c86578d tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c016678c-7148-4b9c-8bc9-2537620d5940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:34 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-0de29d21-cbbe-4408-9b19-db916c86578d tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c016678c-7148-4b9c-8bc9-2537620d5940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1649234969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=970c1f71-7258-487b-a300-d9a4262915c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf8ab2e2f801464eb8a1acb7e214bc52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:34Z,use_quota=True,user_id='5f4273e4066d4ed09f3949c126bc4417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:34 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-0de29d21-cbbe-4408-9b19-db916c86578d tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cfab3bb-67b3-4d94-87d1-f539bf2223a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:34 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-0de29d21-cbbe-4408-9b19-db916c86578d tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cfab3bb-67b3-4d94-87d1-f539bf2223a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:34 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-0de29d21-cbbe-4408-9b19-db916c86578d tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eca6918a-c528-43f1-bc3e-6c30d45ea1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:34 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-0de29d21-cbbe-4408-9b19-db916c86578d tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eca6918a-c528-43f1-bc3e-6c30d45ea1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '970c1f71-7258-487b-a300-d9a4262915c0', 'volume_name': 'volume-970c1f71-7258-487b-a300-d9a4262915c0', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:34 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-0de29d21-cbbe-4408-9b19-db916c86578d tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f63db5f3-f7dd-4d9a-b43c-98645c684e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:34 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-0de29d21-cbbe-4408-9b19-db916c86578d tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f63db5f3-f7dd-4d9a-b43c-98645c684e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:34 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-0de29d21-cbbe-4408-9b19-db916c86578d tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fa187ac-b31b-4ce6-9e4c-20c7ea93fdd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:34 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-0de29d21-cbbe-4408-9b19-db916c86578d tempest-CreateVolumesFromSnapshotTest-998218628 None] Volume 970c1f71-7258-487b-a300-d9a4262915c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-970c1f71-7258-487b-a300-d9a4262915c0', 'volume_size': 1}
Nov 06 12:03:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-0de29d21-cbbe-4408-9b19-db916c86578d tempest-CreateVolumesFromSnapshotTest-998218628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-0de29d21-cbbe-4408-9b19-db916c86578d tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:34 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-0de29d21-cbbe-4408-9b19-db916c86578d tempest-CreateVolumesFromSnapshotTest-998218628 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1649234969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=970c1f71-7258-487b-a300-d9a4262915c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf8ab2e2f801464eb8a1acb7e214bc52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:34Z,use_quota=True,user_id='5f4273e4066d4ed09f3949c126bc4417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:03:34 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-0de29d21-cbbe-4408-9b19-db916c86578d tempest-CreateVolumesFromSnapshotTest-998218628 None] Creating volume 970c1f71-7258-487b-a300-d9a4262915c0 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:03:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-0de29d21-cbbe-4408-9b19-db916c86578d tempest-CreateVolumesFromSnapshotTest-998218628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-0de29d21-cbbe-4408-9b19-db916c86578d tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:34 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-0de29d21-cbbe-4408-9b19-db916c86578d tempest-CreateVolumesFromSnapshotTest-998218628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:34 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-0de29d21-cbbe-4408-9b19-db916c86578d tempest-CreateVolumesFromSnapshotTest-998218628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-0de29d21-cbbe-4408-9b19-db916c86578d tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:34 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-0de29d21-cbbe-4408-9b19-db916c86578d tempest-CreateVolumesFromSnapshotTest-998218628 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:03:34 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-0de29d21-cbbe-4408-9b19-db916c86578d tempest-CreateVolumesFromSnapshotTest-998218628 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:03:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0de29d21-cbbe-4408-9b19-db916c86578d tempest-CreateVolumesFromSnapshotTest-998218628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-970c1f71-7258-487b-a300-d9a4262915c0 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:34 devstack sudo[107939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-970c1f71-7258-487b-a300-d9a4262915c0 1073741824
Nov 06 12:03:34 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:34 devstack sudo[107937]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5e9406dc-c308-4bda-ae89-1eb2cf96f433 tempest-VolumeDependencyTests-1785368670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-6a87ab5d-94f2-4a3b-87bd-1aadbf7638c6" returned: 0 in 0.333s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:34 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5e9406dc-c308-4bda-ae89-1eb2cf96f433 tempest-VolumeDependencyTests-1785368670 None] Lock "cinder-quobyte-6a87ab5d-94f2-4a3b-87bd-1aadbf7638c6" released by "delete_volume" :: held 0.889s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:34 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-5e9406dc-c308-4bda-ae89-1eb2cf96f433 tempest-VolumeDependencyTests-1785368670 None] Created reservations ['6d08fe4c-3569-4661-9c55-c24675db50a9', '8ccf5a2b-a0b9-47d6-9413-eb707e32c48d', 'da1aa743-70d2-4419-8f18-c142e23b148e', '552fda63-f270-49a5-b450-14c3f692a9d7'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:03:34 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-4eb5100c-e280-4662-af75-1c3211030e95 tempest-CreateVolumesFromSnapshotTest-998218628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:03:34 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4eb5100c-e280-4662-af75-1c3211030e95 tempest-CreateVolumesFromSnapshotTest-998218628 None] Flow 'volume_create_manager' (c2c7558a-45a8-4ed3-9990-ceb874ae55e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:03:34 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4eb5100c-e280-4662-af75-1c3211030e95 tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4ac092a-c6c7-403f-a2cc-45be1198f4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:34 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4eb5100c-e280-4662-af75-1c3211030e95 tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4ac092a-c6c7-403f-a2cc-45be1198f4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1068798283',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aab28781-ccaa-4125-9104-c4acd286e668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf8ab2e2f801464eb8a1acb7e214bc52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:35Z,use_quota=True,user_id='5f4273e4066d4ed09f3949c126bc4417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:34 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4eb5100c-e280-4662-af75-1c3211030e95 tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79d882d4-3810-409d-bbda-6e43bc0c58d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:34 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4eb5100c-e280-4662-af75-1c3211030e95 tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79d882d4-3810-409d-bbda-6e43bc0c58d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:34 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4eb5100c-e280-4662-af75-1c3211030e95 tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (720a3b77-8e5c-4c45-a61c-4a55a5ef60de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:34 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4eb5100c-e280-4662-af75-1c3211030e95 tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (720a3b77-8e5c-4c45-a61c-4a55a5ef60de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aab28781-ccaa-4125-9104-c4acd286e668', 'volume_name': 'volume-aab28781-ccaa-4125-9104-c4acd286e668', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:34 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4eb5100c-e280-4662-af75-1c3211030e95 tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f45e1d30-bb17-4df0-88ed-1efa9e34b8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:34 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4eb5100c-e280-4662-af75-1c3211030e95 tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f45e1d30-bb17-4df0-88ed-1efa9e34b8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:34 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4eb5100c-e280-4662-af75-1c3211030e95 tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d84d2fd-06cf-4bba-a06c-95bddcf430be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:34 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-4eb5100c-e280-4662-af75-1c3211030e95 tempest-CreateVolumesFromSnapshotTest-998218628 None] Volume aab28781-ccaa-4125-9104-c4acd286e668: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aab28781-ccaa-4125-9104-c4acd286e668', 'volume_size': 1}
Nov 06 12:03:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4eb5100c-e280-4662-af75-1c3211030e95 tempest-CreateVolumesFromSnapshotTest-998218628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5e9406dc-c308-4bda-ae89-1eb2cf96f433 tempest-VolumeDependencyTests-1785368670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5e9406dc-c308-4bda-ae89-1eb2cf96f433 tempest-VolumeDependencyTests-1785368670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:34 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5e9406dc-c308-4bda-ae89-1eb2cf96f433 tempest-VolumeDependencyTests-1785368670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:34 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5e9406dc-c308-4bda-ae89-1eb2cf96f433 tempest-VolumeDependencyTests-1785368670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5e9406dc-c308-4bda-ae89-1eb2cf96f433 tempest-VolumeDependencyTests-1785368670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5e9406dc-c308-4bda-ae89-1eb2cf96f433 tempest-VolumeDependencyTests-1785368670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:34 devstack sudo[107947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:03:34 devstack sudo[107947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:35 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0de29d21-cbbe-4408-9b19-db916c86578d tempest-CreateVolumesFromSnapshotTest-998218628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-970c1f71-7258-487b-a300-d9a4262915c0 1073741824" returned: 0 in 0.623s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0de29d21-cbbe-4408-9b19-db916c86578d tempest-CreateVolumesFromSnapshotTest-998218628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-970c1f71-7258-487b-a300-d9a4262915c0 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:35 devstack sudo[107949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-970c1f71-7258-487b-a300-d9a4262915c0
Nov 06 12:03:35 devstack sudo[107949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:35 devstack sudo[107947]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5e9406dc-c308-4bda-ae89-1eb2cf96f433 tempest-VolumeDependencyTests-1785368670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.331s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:35 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-5e9406dc-c308-4bda-ae89-1eb2cf96f433 tempest-VolumeDependencyTests-1785368670 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:03:35 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-5e9406dc-c308-4bda-ae89-1eb2cf96f433 tempest-VolumeDependencyTests-1785368670 None] Deleted volume successfully.
Nov 06 12:03:35 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5e9406dc-c308-4bda-ae89-1eb2cf96f433 tempest-VolumeDependencyTests-1785368670 None] Lock "cinder-6a87ab5d-94f2-4a3b-87bd-1aadbf7638c6-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:35 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-77f5af52-4727-42cb-8177-d2c93bcfdde7 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:03:35 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-77f5af52-4727-42cb-8177-d2c93bcfdde7 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Flow 'volume_create_manager' (26adf801-2e63-4170-8276-b25f6952567d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:03:35 devstack sudo[107949]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:35 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-77f5af52-4727-42cb-8177-d2c93bcfdde7 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26513b69-9d8c-48d7-980d-41450b4f3bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0de29d21-cbbe-4408-9b19-db916c86578d tempest-CreateVolumesFromSnapshotTest-998218628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-970c1f71-7258-487b-a300-d9a4262915c0" returned: 0 in 0.365s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:35 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-0de29d21-cbbe-4408-9b19-db916c86578d tempest-CreateVolumesFromSnapshotTest-998218628 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:03:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-0de29d21-cbbe-4408-9b19-db916c86578d tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4eb5100c-e280-4662-af75-1c3211030e95 tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.579s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:35 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-4eb5100c-e280-4662-af75-1c3211030e95 tempest-CreateVolumesFromSnapshotTest-998218628 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1068798283',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aab28781-ccaa-4125-9104-c4acd286e668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf8ab2e2f801464eb8a1acb7e214bc52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:35Z,use_quota=True,user_id='5f4273e4066d4ed09f3949c126bc4417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:03:35 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-4eb5100c-e280-4662-af75-1c3211030e95 tempest-CreateVolumesFromSnapshotTest-998218628 None] Creating volume aab28781-ccaa-4125-9104-c4acd286e668 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:03:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4eb5100c-e280-4662-af75-1c3211030e95 tempest-CreateVolumesFromSnapshotTest-998218628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4eb5100c-e280-4662-af75-1c3211030e95 tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:35 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-4eb5100c-e280-4662-af75-1c3211030e95 tempest-CreateVolumesFromSnapshotTest-998218628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:35 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-4eb5100c-e280-4662-af75-1c3211030e95 tempest-CreateVolumesFromSnapshotTest-998218628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4eb5100c-e280-4662-af75-1c3211030e95 tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:35 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-4eb5100c-e280-4662-af75-1c3211030e95 tempest-CreateVolumesFromSnapshotTest-998218628 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:03:35 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-4eb5100c-e280-4662-af75-1c3211030e95 tempest-CreateVolumesFromSnapshotTest-998218628 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:03:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4eb5100c-e280-4662-af75-1c3211030e95 tempest-CreateVolumesFromSnapshotTest-998218628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-aab28781-ccaa-4125-9104-c4acd286e668 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:35 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-77f5af52-4727-42cb-8177-d2c93bcfdde7 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26513b69-9d8c-48d7-980d-41450b4f3bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1193275819',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35c3b300-a218-4dd2-ba8e-14b24bf88b5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da410887685d462a87549836b08a546c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:35Z,use_quota=True,user_id='62a0bda5ea9349baa1f40d765c852d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:35 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-77f5af52-4727-42cb-8177-d2c93bcfdde7 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41d46c78-7826-4288-a1be-7c0914fb27ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:35 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-77f5af52-4727-42cb-8177-d2c93bcfdde7 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41d46c78-7826-4288-a1be-7c0914fb27ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:35 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-77f5af52-4727-42cb-8177-d2c93bcfdde7 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (546cda24-e7a0-4ee3-9ec1-44deea86f102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:35 devstack sudo[107953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-aab28781-ccaa-4125-9104-c4acd286e668 1073741824
Nov 06 12:03:35 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:35 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-77f5af52-4727-42cb-8177-d2c93bcfdde7 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (546cda24-e7a0-4ee3-9ec1-44deea86f102) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35c3b300-a218-4dd2-ba8e-14b24bf88b5d', 'volume_name': 'volume-35c3b300-a218-4dd2-ba8e-14b24bf88b5d', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:35 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-77f5af52-4727-42cb-8177-d2c93bcfdde7 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f032247-247f-49cb-9953-450a6cdfb458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:35 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-77f5af52-4727-42cb-8177-d2c93bcfdde7 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f032247-247f-49cb-9953-450a6cdfb458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:35 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-77f5af52-4727-42cb-8177-d2c93bcfdde7 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0360d418-91d7-40dc-9333-cad60ff5c1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:35 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-77f5af52-4727-42cb-8177-d2c93bcfdde7 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Volume 35c3b300-a218-4dd2-ba8e-14b24bf88b5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35c3b300-a218-4dd2-ba8e-14b24bf88b5d', 'volume_size': 1}
Nov 06 12:03:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-77f5af52-4727-42cb-8177-d2c93bcfdde7 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:35 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-0de29d21-cbbe-4408-9b19-db916c86578d tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fa187ac-b31b-4ce6-9e4c-20c7ea93fdd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-970c1f71-7258-487b-a300-d9a4262915c0', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:35 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-0de29d21-cbbe-4408-9b19-db916c86578d tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (345cb18f-dcff-48b6-b2a5-99e8f61a9338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:35 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-0de29d21-cbbe-4408-9b19-db916c86578d tempest-CreateVolumesFromSnapshotTest-998218628 None] Volume volume-970c1f71-7258-487b-a300-d9a4262915c0 (970c1f71-7258-487b-a300-d9a4262915c0): created successfully
Nov 06 12:03:35 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-0de29d21-cbbe-4408-9b19-db916c86578d tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (345cb18f-dcff-48b6-b2a5-99e8f61a9338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:35 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-0de29d21-cbbe-4408-9b19-db916c86578d tempest-CreateVolumesFromSnapshotTest-998218628 None] Flow 'volume_create_manager' (e0372017-d7cf-47be-b326-4dc238cb373c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:03:35 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-0de29d21-cbbe-4408-9b19-db916c86578d tempest-CreateVolumesFromSnapshotTest-998218628 None] Created volume successfully.
Nov 06 12:03:36 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4eb5100c-e280-4662-af75-1c3211030e95 tempest-CreateVolumesFromSnapshotTest-998218628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-aab28781-ccaa-4125-9104-c4acd286e668 1073741824" returned: 0 in 0.557s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4eb5100c-e280-4662-af75-1c3211030e95 tempest-CreateVolumesFromSnapshotTest-998218628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-aab28781-ccaa-4125-9104-c4acd286e668 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:36 devstack sudo[107961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-aab28781-ccaa-4125-9104-c4acd286e668
Nov 06 12:03:36 devstack sudo[107961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:36 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-caa86816-44b0-4247-98df-f0b810e3c9ff tempest-CreateVolumesFromSnapshotTest-998218628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:03:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-caa86816-44b0-4247-98df-f0b810e3c9ff tempest-CreateVolumesFromSnapshotTest-998218628 None] Flow 'volume_create_manager' (e54c082a-26ab-43f9-b256-95dd261ea206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:03:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-caa86816-44b0-4247-98df-f0b810e3c9ff tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfb4fccf-3224-44e0-a65d-b590dbef22f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-caa86816-44b0-4247-98df-f0b810e3c9ff tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfb4fccf-3224-44e0-a65d-b590dbef22f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1806202938',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8679eae-e1c6-4227-8f45-52975039c1b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf8ab2e2f801464eb8a1acb7e214bc52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:36Z,use_quota=True,user_id='5f4273e4066d4ed09f3949c126bc4417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-caa86816-44b0-4247-98df-f0b810e3c9ff tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b59184c6-8c93-49ed-b854-a7f961dd0ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-caa86816-44b0-4247-98df-f0b810e3c9ff tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b59184c6-8c93-49ed-b854-a7f961dd0ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-caa86816-44b0-4247-98df-f0b810e3c9ff tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ad90ab0-fc9d-4943-83d2-8a5f984b307f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-caa86816-44b0-4247-98df-f0b810e3c9ff tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ad90ab0-fc9d-4943-83d2-8a5f984b307f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8679eae-e1c6-4227-8f45-52975039c1b7', 'volume_name': 'volume-e8679eae-e1c6-4227-8f45-52975039c1b7', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-caa86816-44b0-4247-98df-f0b810e3c9ff tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d39b8042-5a32-45e1-af87-761ac5aa09d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-caa86816-44b0-4247-98df-f0b810e3c9ff tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d39b8042-5a32-45e1-af87-761ac5aa09d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-caa86816-44b0-4247-98df-f0b810e3c9ff tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc0c13cc-ab59-4202-97ab-749db114b9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:36 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-caa86816-44b0-4247-98df-f0b810e3c9ff tempest-CreateVolumesFromSnapshotTest-998218628 None] Volume e8679eae-e1c6-4227-8f45-52975039c1b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8679eae-e1c6-4227-8f45-52975039c1b7', 'volume_size': 1}
Nov 06 12:03:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-caa86816-44b0-4247-98df-f0b810e3c9ff tempest-CreateVolumesFromSnapshotTest-998218628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:36 devstack sudo[107961]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4eb5100c-e280-4662-af75-1c3211030e95 tempest-CreateVolumesFromSnapshotTest-998218628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-aab28781-ccaa-4125-9104-c4acd286e668" returned: 0 in 0.454s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:36 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-4eb5100c-e280-4662-af75-1c3211030e95 tempest-CreateVolumesFromSnapshotTest-998218628 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:03:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4eb5100c-e280-4662-af75-1c3211030e95 tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-77f5af52-4727-42cb-8177-d2c93bcfdde7 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.997s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:36 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-77f5af52-4727-42cb-8177-d2c93bcfdde7 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1193275819',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35c3b300-a218-4dd2-ba8e-14b24bf88b5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da410887685d462a87549836b08a546c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:35Z,use_quota=True,user_id='62a0bda5ea9349baa1f40d765c852d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:03:36 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-77f5af52-4727-42cb-8177-d2c93bcfdde7 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Creating volume 35c3b300-a218-4dd2-ba8e-14b24bf88b5d {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:03:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-77f5af52-4727-42cb-8177-d2c93bcfdde7 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-77f5af52-4727-42cb-8177-d2c93bcfdde7 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:36 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-77f5af52-4727-42cb-8177-d2c93bcfdde7 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:36 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-77f5af52-4727-42cb-8177-d2c93bcfdde7 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-77f5af52-4727-42cb-8177-d2c93bcfdde7 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:36 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-77f5af52-4727-42cb-8177-d2c93bcfdde7 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:03:36 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-77f5af52-4727-42cb-8177-d2c93bcfdde7 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:03:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-77f5af52-4727-42cb-8177-d2c93bcfdde7 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35c3b300-a218-4dd2-ba8e-14b24bf88b5d 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:36 devstack sudo[107966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35c3b300-a218-4dd2-ba8e-14b24bf88b5d 1073741824
Nov 06 12:03:36 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4eb5100c-e280-4662-af75-1c3211030e95 tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d84d2fd-06cf-4bba-a06c-95bddcf430be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aab28781-ccaa-4125-9104-c4acd286e668', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4eb5100c-e280-4662-af75-1c3211030e95 tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be1f401e-0c90-4490-881a-326491dd6c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:36 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-4eb5100c-e280-4662-af75-1c3211030e95 tempest-CreateVolumesFromSnapshotTest-998218628 None] Volume volume-aab28781-ccaa-4125-9104-c4acd286e668 (aab28781-ccaa-4125-9104-c4acd286e668): created successfully
Nov 06 12:03:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4eb5100c-e280-4662-af75-1c3211030e95 tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be1f401e-0c90-4490-881a-326491dd6c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-4eb5100c-e280-4662-af75-1c3211030e95 tempest-CreateVolumesFromSnapshotTest-998218628 None] Flow 'volume_create_manager' (c2c7558a-45a8-4ed3-9990-ceb874ae55e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:03:36 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-4eb5100c-e280-4662-af75-1c3211030e95 tempest-CreateVolumesFromSnapshotTest-998218628 None] Created volume successfully.
Nov 06 12:03:36 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc13b034-ea7d-4f47-a140-b3278c85add2 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:03:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-cc13b034-ea7d-4f47-a140-b3278c85add2 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Flow 'volume_create_manager' (32e23dcd-7e45-4909-a6ea-f5cecfe4b695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:03:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-cc13b034-ea7d-4f47-a140-b3278c85add2 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f68b4d4b-c748-4ecd-9271-0acf3adf3d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-cc13b034-ea7d-4f47-a140-b3278c85add2 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f68b4d4b-c748-4ecd-9271-0acf3adf3d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1825690464',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b8c6773-5b7a-49fe-bb09-d3cb117e5fc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da410887685d462a87549836b08a546c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:37Z,use_quota=True,user_id='62a0bda5ea9349baa1f40d765c852d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-cc13b034-ea7d-4f47-a140-b3278c85add2 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cdbd30b-4961-44f6-a3ac-a8f77ca8be32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-cc13b034-ea7d-4f47-a140-b3278c85add2 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cdbd30b-4961-44f6-a3ac-a8f77ca8be32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-cc13b034-ea7d-4f47-a140-b3278c85add2 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (991c4a46-e60b-41c0-a3c6-4430dee82c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-cc13b034-ea7d-4f47-a140-b3278c85add2 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (991c4a46-e60b-41c0-a3c6-4430dee82c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b8c6773-5b7a-49fe-bb09-d3cb117e5fc0', 'volume_name': 'volume-4b8c6773-5b7a-49fe-bb09-d3cb117e5fc0', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-cc13b034-ea7d-4f47-a140-b3278c85add2 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (930fc79c-b234-4bae-a355-5e26ff361f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:36 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-cc13b034-ea7d-4f47-a140-b3278c85add2 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (930fc79c-b234-4bae-a355-5e26ff361f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-cc13b034-ea7d-4f47-a140-b3278c85add2 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0784d68c-10ca-4f05-b2ec-11fb89f291fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:37 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-cc13b034-ea7d-4f47-a140-b3278c85add2 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Volume 4b8c6773-5b7a-49fe-bb09-d3cb117e5fc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b8c6773-5b7a-49fe-bb09-d3cb117e5fc0', 'volume_size': 1}
Nov 06 12:03:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-cc13b034-ea7d-4f47-a140-b3278c85add2 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:37 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-77f5af52-4727-42cb-8177-d2c93bcfdde7 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35c3b300-a218-4dd2-ba8e-14b24bf88b5d 1073741824" returned: 0 in 0.753s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-77f5af52-4727-42cb-8177-d2c93bcfdde7 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35c3b300-a218-4dd2-ba8e-14b24bf88b5d {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:37 devstack sudo[107980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35c3b300-a218-4dd2-ba8e-14b24bf88b5d
Nov 06 12:03:37 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:37 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-5edcd01e-f765-408e-82fc-04d026978065 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:03:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5edcd01e-f765-408e-82fc-04d026978065 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Flow 'volume_create_manager' (307e5ab2-1191-484b-9016-7b6a970228f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:03:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5edcd01e-f765-408e-82fc-04d026978065 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (483535da-511c-4423-bbe5-32cd557df3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:37 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-77f5af52-4727-42cb-8177-d2c93bcfdde7 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35c3b300-a218-4dd2-ba8e-14b24bf88b5d" returned: 0 in 0.344s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:37 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-77f5af52-4727-42cb-8177-d2c93bcfdde7 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:03:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-77f5af52-4727-42cb-8177-d2c93bcfdde7 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-caa86816-44b0-4247-98df-f0b810e3c9ff tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.244s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:37 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-caa86816-44b0-4247-98df-f0b810e3c9ff tempest-CreateVolumesFromSnapshotTest-998218628 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1806202938',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8679eae-e1c6-4227-8f45-52975039c1b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf8ab2e2f801464eb8a1acb7e214bc52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:36Z,use_quota=True,user_id='5f4273e4066d4ed09f3949c126bc4417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:03:37 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-caa86816-44b0-4247-98df-f0b810e3c9ff tempest-CreateVolumesFromSnapshotTest-998218628 None] Creating volume e8679eae-e1c6-4227-8f45-52975039c1b7 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:03:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-caa86816-44b0-4247-98df-f0b810e3c9ff tempest-CreateVolumesFromSnapshotTest-998218628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-caa86816-44b0-4247-98df-f0b810e3c9ff tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:37 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-caa86816-44b0-4247-98df-f0b810e3c9ff tempest-CreateVolumesFromSnapshotTest-998218628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:37 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-caa86816-44b0-4247-98df-f0b810e3c9ff tempest-CreateVolumesFromSnapshotTest-998218628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-caa86816-44b0-4247-98df-f0b810e3c9ff tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:37 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-caa86816-44b0-4247-98df-f0b810e3c9ff tempest-CreateVolumesFromSnapshotTest-998218628 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:03:37 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-caa86816-44b0-4247-98df-f0b810e3c9ff tempest-CreateVolumesFromSnapshotTest-998218628 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:03:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-caa86816-44b0-4247-98df-f0b810e3c9ff tempest-CreateVolumesFromSnapshotTest-998218628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e8679eae-e1c6-4227-8f45-52975039c1b7 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:37 devstack sudo[107983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e8679eae-e1c6-4227-8f45-52975039c1b7 1073741824
Nov 06 12:03:37 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5edcd01e-f765-408e-82fc-04d026978065 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (483535da-511c-4423-bbe5-32cd557df3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-16586626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36ca2b62-a646-487a-ac9e-d33ebe53aadb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da410887685d462a87549836b08a546c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:38Z,use_quota=True,user_id='62a0bda5ea9349baa1f40d765c852d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5edcd01e-f765-408e-82fc-04d026978065 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (650296b8-6859-4a84-9633-a51d89483f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5edcd01e-f765-408e-82fc-04d026978065 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (650296b8-6859-4a84-9633-a51d89483f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5edcd01e-f765-408e-82fc-04d026978065 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c52cbc26-d8de-4796-abfe-20c474992da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5edcd01e-f765-408e-82fc-04d026978065 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c52cbc26-d8de-4796-abfe-20c474992da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36ca2b62-a646-487a-ac9e-d33ebe53aadb', 'volume_name': 'volume-36ca2b62-a646-487a-ac9e-d33ebe53aadb', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5edcd01e-f765-408e-82fc-04d026978065 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47034ebb-f847-41f5-ba4e-941269156f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5edcd01e-f765-408e-82fc-04d026978065 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47034ebb-f847-41f5-ba4e-941269156f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5edcd01e-f765-408e-82fc-04d026978065 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1138cac8-155e-409f-b116-3d60e14c855d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:37 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-5edcd01e-f765-408e-82fc-04d026978065 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Volume 36ca2b62-a646-487a-ac9e-d33ebe53aadb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36ca2b62-a646-487a-ac9e-d33ebe53aadb', 'volume_size': 1}
Nov 06 12:03:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5edcd01e-f765-408e-82fc-04d026978065 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-77f5af52-4727-42cb-8177-d2c93bcfdde7 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0360d418-91d7-40dc-9333-cad60ff5c1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35c3b300-a218-4dd2-ba8e-14b24bf88b5d', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-77f5af52-4727-42cb-8177-d2c93bcfdde7 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf01ca61-74df-4fe3-adb1-79f63e0563f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:38 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-77f5af52-4727-42cb-8177-d2c93bcfdde7 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Volume volume-35c3b300-a218-4dd2-ba8e-14b24bf88b5d (35c3b300-a218-4dd2-ba8e-14b24bf88b5d): created successfully
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-77f5af52-4727-42cb-8177-d2c93bcfdde7 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf01ca61-74df-4fe3-adb1-79f63e0563f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-77f5af52-4727-42cb-8177-d2c93bcfdde7 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Flow 'volume_create_manager' (26adf801-2e63-4170-8276-b25f6952567d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-da14ab22-8ed2-4d8e-b1f6-bbcb4f365354 tempest-CreateVolumesFromSnapshotTest-998218628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-da14ab22-8ed2-4d8e-b1f6-bbcb4f365354 tempest-CreateVolumesFromSnapshotTest-998218628 None] Flow 'volume_create_manager' (9f81607d-091e-4678-a593-a5e544a29a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-da14ab22-8ed2-4d8e-b1f6-bbcb4f365354 tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38e408be-d77b-4bda-a632-48b4ab688467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-c83395e0-be0c-421a-ab58-9bdf673214e4 tempest-CreateVolumesFromSnapshotTest-998218628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c83395e0-be0c-421a-ab58-9bdf673214e4 tempest-CreateVolumesFromSnapshotTest-998218628 None] Flow 'volume_create_manager' (08dc7ac1-c696-4e6b-96d6-b0f4f56c6880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c83395e0-be0c-421a-ab58-9bdf673214e4 tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db4c49e8-84f3-4994-9cd3-0fd8d1088958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c83395e0-be0c-421a-ab58-9bdf673214e4 tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db4c49e8-84f3-4994-9cd3-0fd8d1088958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-541614748',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=365041ff-1929-4030-85ad-fd232d27cd4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf8ab2e2f801464eb8a1acb7e214bc52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:38Z,use_quota=True,user_id='5f4273e4066d4ed09f3949c126bc4417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c83395e0-be0c-421a-ab58-9bdf673214e4 tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdd1566f-96c1-4514-9087-a24ad4f77e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c83395e0-be0c-421a-ab58-9bdf673214e4 tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdd1566f-96c1-4514-9087-a24ad4f77e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c83395e0-be0c-421a-ab58-9bdf673214e4 tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6676e2fa-86ca-431c-9e41-049ed5e355de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c83395e0-be0c-421a-ab58-9bdf673214e4 tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6676e2fa-86ca-431c-9e41-049ed5e355de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '365041ff-1929-4030-85ad-fd232d27cd4a', 'volume_name': 'volume-365041ff-1929-4030-85ad-fd232d27cd4a', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c83395e0-be0c-421a-ab58-9bdf673214e4 tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5860ee0-15a8-4911-ba97-c802bc54ac3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c83395e0-be0c-421a-ab58-9bdf673214e4 tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5860ee0-15a8-4911-ba97-c802bc54ac3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c83395e0-be0c-421a-ab58-9bdf673214e4 tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dda23391-96d5-45fa-9353-1a501f475484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:38 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-c83395e0-be0c-421a-ab58-9bdf673214e4 tempest-CreateVolumesFromSnapshotTest-998218628 None] Volume 365041ff-1929-4030-85ad-fd232d27cd4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-365041ff-1929-4030-85ad-fd232d27cd4a', 'volume_size': 1}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c83395e0-be0c-421a-ab58-9bdf673214e4 tempest-CreateVolumesFromSnapshotTest-998218628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-da14ab22-8ed2-4d8e-b1f6-bbcb4f365354 tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38e408be-d77b-4bda-a632-48b4ab688467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1467755927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67586f51-4385-48d9-ab10-7bd2fd87a397,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf8ab2e2f801464eb8a1acb7e214bc52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:38Z,use_quota=True,user_id='5f4273e4066d4ed09f3949c126bc4417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-da14ab22-8ed2-4d8e-b1f6-bbcb4f365354 tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46d6605d-2b50-477b-a268-4c7e14d2d161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-da14ab22-8ed2-4d8e-b1f6-bbcb4f365354 tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46d6605d-2b50-477b-a268-4c7e14d2d161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-da14ab22-8ed2-4d8e-b1f6-bbcb4f365354 tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ce6eda6-33cc-408c-95ba-5491df950be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-da14ab22-8ed2-4d8e-b1f6-bbcb4f365354 tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ce6eda6-33cc-408c-95ba-5491df950be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67586f51-4385-48d9-ab10-7bd2fd87a397', 'volume_name': 'volume-67586f51-4385-48d9-ab10-7bd2fd87a397', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-da14ab22-8ed2-4d8e-b1f6-bbcb4f365354 tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f51920f-8d2e-484b-8ca3-748b7cc0766d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-da14ab22-8ed2-4d8e-b1f6-bbcb4f365354 tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f51920f-8d2e-484b-8ca3-748b7cc0766d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-da14ab22-8ed2-4d8e-b1f6-bbcb4f365354 tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e61f44c-fe38-4b39-bcc3-3538b965fcca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:38 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-da14ab22-8ed2-4d8e-b1f6-bbcb4f365354 tempest-CreateVolumesFromSnapshotTest-998218628 None] Volume 67586f51-4385-48d9-ab10-7bd2fd87a397: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67586f51-4385-48d9-ab10-7bd2fd87a397', 'volume_size': 1}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-da14ab22-8ed2-4d8e-b1f6-bbcb4f365354 tempest-CreateVolumesFromSnapshotTest-998218628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:38 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-77f5af52-4727-42cb-8177-d2c93bcfdde7 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Created volume successfully.
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e5856dd-088d-4a43-9c7f-bb36e02759a9 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:03:38 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6e5856dd-088d-4a43-9c7f-bb36e02759a9 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Flow 'volume_create_manager' (62893260-78a9-435d-84b3-01fb0cb0484b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6e5856dd-088d-4a43-9c7f-bb36e02759a9 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9786f0f-2ca1-470d-bbf6-c10f2c3edba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fea9c6d-151c-4094-80cb-27ca288dd201 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9fea9c6d-151c-4094-80cb-27ca288dd201 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Flow 'volume_create_manager' (0c997ffa-ae25-453c-a2c9-5f8060769337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9fea9c6d-151c-4094-80cb-27ca288dd201 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbb279fa-9462-48c1-9c7d-7289724a0c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-caa86816-44b0-4247-98df-f0b810e3c9ff tempest-CreateVolumesFromSnapshotTest-998218628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e8679eae-e1c6-4227-8f45-52975039c1b7 1073741824" returned: 0 in 0.849s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6e5856dd-088d-4a43-9c7f-bb36e02759a9 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9786f0f-2ca1-470d-bbf6-c10f2c3edba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:03:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-596155101',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b306f2e-0bc5-4e99-88a0-4e723ab7f3b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da410887685d462a87549836b08a546c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:38Z,use_quota=True,user_id='62a0bda5ea9349baa1f40d765c852d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6e5856dd-088d-4a43-9c7f-bb36e02759a9 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7797c9a-ab7f-4c52-b97c-90daf890dfc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6e5856dd-088d-4a43-9c7f-bb36e02759a9 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7797c9a-ab7f-4c52-b97c-90daf890dfc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6e5856dd-088d-4a43-9c7f-bb36e02759a9 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (234bf787-0a3b-4586-a671-9538e0c53960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6e5856dd-088d-4a43-9c7f-bb36e02759a9 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (234bf787-0a3b-4586-a671-9538e0c53960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b306f2e-0bc5-4e99-88a0-4e723ab7f3b8', 'volume_name': 'volume-8b306f2e-0bc5-4e99-88a0-4e723ab7f3b8', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6e5856dd-088d-4a43-9c7f-bb36e02759a9 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52ec8061-aaac-4085-8cea-84a49c4208c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6e5856dd-088d-4a43-9c7f-bb36e02759a9 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52ec8061-aaac-4085-8cea-84a49c4208c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6e5856dd-088d-4a43-9c7f-bb36e02759a9 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e412db6-9c85-4689-ad5d-0e6a53225769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:38 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-6e5856dd-088d-4a43-9c7f-bb36e02759a9 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Volume 8b306f2e-0bc5-4e99-88a0-4e723ab7f3b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b306f2e-0bc5-4e99-88a0-4e723ab7f3b8', 'volume_size': 1}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6e5856dd-088d-4a43-9c7f-bb36e02759a9 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9fea9c6d-151c-4094-80cb-27ca288dd201 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbb279fa-9462-48c1-9c7d-7289724a0c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:03:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1761260677',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e466a146-6d4a-4e15-9f24-99d8817227e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da410887685d462a87549836b08a546c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:38Z,use_quota=True,user_id='62a0bda5ea9349baa1f40d765c852d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9fea9c6d-151c-4094-80cb-27ca288dd201 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51c7efda-e535-445f-820d-8d6a86430ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9fea9c6d-151c-4094-80cb-27ca288dd201 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51c7efda-e535-445f-820d-8d6a86430ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9fea9c6d-151c-4094-80cb-27ca288dd201 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13c57d80-b3f3-4e21-ab97-cdcbe95a5a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9fea9c6d-151c-4094-80cb-27ca288dd201 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13c57d80-b3f3-4e21-ab97-cdcbe95a5a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e466a146-6d4a-4e15-9f24-99d8817227e0', 'volume_name': 'volume-e466a146-6d4a-4e15-9f24-99d8817227e0', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9fea9c6d-151c-4094-80cb-27ca288dd201 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd402ebc-2fa1-492c-8767-e303997fb758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9fea9c6d-151c-4094-80cb-27ca288dd201 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd402ebc-2fa1-492c-8767-e303997fb758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9fea9c6d-151c-4094-80cb-27ca288dd201 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe4fe443-2a14-4d14-859d-77251b3785df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:38 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-9fea9c6d-151c-4094-80cb-27ca288dd201 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Volume e466a146-6d4a-4e15-9f24-99d8817227e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e466a146-6d4a-4e15-9f24-99d8817227e0', 'volume_size': 1}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9fea9c6d-151c-4094-80cb-27ca288dd201 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-caa86816-44b0-4247-98df-f0b810e3c9ff tempest-CreateVolumesFromSnapshotTest-998218628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e8679eae-e1c6-4227-8f45-52975039c1b7 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:38 devstack sudo[107989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e8679eae-e1c6-4227-8f45-52975039c1b7
Nov 06 12:03:38 devstack sudo[107989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:39 devstack sudo[107989]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-caa86816-44b0-4247-98df-f0b810e3c9ff tempest-CreateVolumesFromSnapshotTest-998218628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e8679eae-e1c6-4227-8f45-52975039c1b7" returned: 0 in 0.297s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:39 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-caa86816-44b0-4247-98df-f0b810e3c9ff tempest-CreateVolumesFromSnapshotTest-998218628 None] <== create_volume: return (1320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:03:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-caa86816-44b0-4247-98df-f0b810e3c9ff tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.323s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-cc13b034-ea7d-4f47-a140-b3278c85add2 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.113s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:39 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-cc13b034-ea7d-4f47-a140-b3278c85add2 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1825690464',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b8c6773-5b7a-49fe-bb09-d3cb117e5fc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da410887685d462a87549836b08a546c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:37Z,use_quota=True,user_id='62a0bda5ea9349baa1f40d765c852d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:03:39 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-cc13b034-ea7d-4f47-a140-b3278c85add2 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Creating volume 4b8c6773-5b7a-49fe-bb09-d3cb117e5fc0 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:03:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-cc13b034-ea7d-4f47-a140-b3278c85add2 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-cc13b034-ea7d-4f47-a140-b3278c85add2 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:39 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-cc13b034-ea7d-4f47-a140-b3278c85add2 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:39 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-cc13b034-ea7d-4f47-a140-b3278c85add2 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-cc13b034-ea7d-4f47-a140-b3278c85add2 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:39 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-cc13b034-ea7d-4f47-a140-b3278c85add2 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:03:39 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-cc13b034-ea7d-4f47-a140-b3278c85add2 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:03:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cc13b034-ea7d-4f47-a140-b3278c85add2 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4b8c6773-5b7a-49fe-bb09-d3cb117e5fc0 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:39 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-caa86816-44b0-4247-98df-f0b810e3c9ff tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc0c13cc-ab59-4202-97ab-749db114b9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8679eae-e1c6-4227-8f45-52975039c1b7', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:39 devstack sudo[107992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4b8c6773-5b7a-49fe-bb09-d3cb117e5fc0 1073741824
Nov 06 12:03:39 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-caa86816-44b0-4247-98df-f0b810e3c9ff tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00a57203-2587-439b-8aba-38753d60d2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:39 devstack sudo[107992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:39 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-caa86816-44b0-4247-98df-f0b810e3c9ff tempest-CreateVolumesFromSnapshotTest-998218628 None] Volume volume-e8679eae-e1c6-4227-8f45-52975039c1b7 (e8679eae-e1c6-4227-8f45-52975039c1b7): created successfully
Nov 06 12:03:39 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-caa86816-44b0-4247-98df-f0b810e3c9ff tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00a57203-2587-439b-8aba-38753d60d2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:39 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-caa86816-44b0-4247-98df-f0b810e3c9ff tempest-CreateVolumesFromSnapshotTest-998218628 None] Flow 'volume_create_manager' (e54c082a-26ab-43f9-b256-95dd261ea206) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:03:39 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-caa86816-44b0-4247-98df-f0b810e3c9ff tempest-CreateVolumesFromSnapshotTest-998218628 None] Created volume successfully.
Nov 06 12:03:39 devstack sudo[107992]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cc13b034-ea7d-4f47-a140-b3278c85add2 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4b8c6773-5b7a-49fe-bb09-d3cb117e5fc0 1073741824" returned: 0 in 0.506s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cc13b034-ea7d-4f47-a140-b3278c85add2 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4b8c6773-5b7a-49fe-bb09-d3cb117e5fc0 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:39 devstack sudo[107998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4b8c6773-5b7a-49fe-bb09-d3cb117e5fc0
Nov 06 12:03:39 devstack sudo[107998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:39 devstack sudo[107998]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cc13b034-ea7d-4f47-a140-b3278c85add2 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4b8c6773-5b7a-49fe-bb09-d3cb117e5fc0" returned: 0 in 0.297s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:39 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-cc13b034-ea7d-4f47-a140-b3278c85add2 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:03:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-cc13b034-ea7d-4f47-a140-b3278c85add2 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5edcd01e-f765-408e-82fc-04d026978065 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.009s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:39 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5edcd01e-f765-408e-82fc-04d026978065 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-16586626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36ca2b62-a646-487a-ac9e-d33ebe53aadb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da410887685d462a87549836b08a546c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:38Z,use_quota=True,user_id='62a0bda5ea9349baa1f40d765c852d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:03:39 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-5edcd01e-f765-408e-82fc-04d026978065 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Creating volume 36ca2b62-a646-487a-ac9e-d33ebe53aadb {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:03:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5edcd01e-f765-408e-82fc-04d026978065 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5edcd01e-f765-408e-82fc-04d026978065 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:39 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5edcd01e-f765-408e-82fc-04d026978065 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:39 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5edcd01e-f765-408e-82fc-04d026978065 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5edcd01e-f765-408e-82fc-04d026978065 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:39 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5edcd01e-f765-408e-82fc-04d026978065 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:03:39 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-5edcd01e-f765-408e-82fc-04d026978065 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:03:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5edcd01e-f765-408e-82fc-04d026978065 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-36ca2b62-a646-487a-ac9e-d33ebe53aadb 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-cc13b034-ea7d-4f47-a140-b3278c85add2 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0784d68c-10ca-4f05-b2ec-11fb89f291fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b8c6773-5b7a-49fe-bb09-d3cb117e5fc0', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-cc13b034-ea7d-4f47-a140-b3278c85add2 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55a8cf5c-4286-471c-90fa-6c708c5fc3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:40 devstack sudo[108001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-36ca2b62-a646-487a-ac9e-d33ebe53aadb 1073741824
Nov 06 12:03:40 devstack sudo[108001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:40 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-cc13b034-ea7d-4f47-a140-b3278c85add2 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Volume volume-4b8c6773-5b7a-49fe-bb09-d3cb117e5fc0 (4b8c6773-5b7a-49fe-bb09-d3cb117e5fc0): created successfully
Nov 06 12:03:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-cc13b034-ea7d-4f47-a140-b3278c85add2 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55a8cf5c-4286-471c-90fa-6c708c5fc3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-cc13b034-ea7d-4f47-a140-b3278c85add2 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Flow 'volume_create_manager' (32e23dcd-7e45-4909-a6ea-f5cecfe4b695) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:03:40 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-cc13b034-ea7d-4f47-a140-b3278c85add2 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Created volume successfully.
Nov 06 12:03:40 devstack sudo[108001]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5edcd01e-f765-408e-82fc-04d026978065 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-36ca2b62-a646-487a-ac9e-d33ebe53aadb 1073741824" returned: 0 in 0.512s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5edcd01e-f765-408e-82fc-04d026978065 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-36ca2b62-a646-487a-ac9e-d33ebe53aadb {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:40 devstack sudo[108007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-36ca2b62-a646-487a-ac9e-d33ebe53aadb
Nov 06 12:03:40 devstack sudo[108007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:40 devstack sudo[108007]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5edcd01e-f765-408e-82fc-04d026978065 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-36ca2b62-a646-487a-ac9e-d33ebe53aadb" returned: 0 in 0.258s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:40 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5edcd01e-f765-408e-82fc-04d026978065 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:03:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5edcd01e-f765-408e-82fc-04d026978065 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c83395e0-be0c-421a-ab58-9bdf673214e4 tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.338s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:40 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-c83395e0-be0c-421a-ab58-9bdf673214e4 tempest-CreateVolumesFromSnapshotTest-998218628 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-541614748',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=365041ff-1929-4030-85ad-fd232d27cd4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf8ab2e2f801464eb8a1acb7e214bc52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:38Z,use_quota=True,user_id='5f4273e4066d4ed09f3949c126bc4417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:03:40 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-c83395e0-be0c-421a-ab58-9bdf673214e4 tempest-CreateVolumesFromSnapshotTest-998218628 None] Creating volume 365041ff-1929-4030-85ad-fd232d27cd4a {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:03:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c83395e0-be0c-421a-ab58-9bdf673214e4 tempest-CreateVolumesFromSnapshotTest-998218628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c83395e0-be0c-421a-ab58-9bdf673214e4 tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:40 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-c83395e0-be0c-421a-ab58-9bdf673214e4 tempest-CreateVolumesFromSnapshotTest-998218628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:40 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-c83395e0-be0c-421a-ab58-9bdf673214e4 tempest-CreateVolumesFromSnapshotTest-998218628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c83395e0-be0c-421a-ab58-9bdf673214e4 tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:40 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-c83395e0-be0c-421a-ab58-9bdf673214e4 tempest-CreateVolumesFromSnapshotTest-998218628 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:03:40 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-c83395e0-be0c-421a-ab58-9bdf673214e4 tempest-CreateVolumesFromSnapshotTest-998218628 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:03:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c83395e0-be0c-421a-ab58-9bdf673214e4 tempest-CreateVolumesFromSnapshotTest-998218628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-365041ff-1929-4030-85ad-fd232d27cd4a 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5edcd01e-f765-408e-82fc-04d026978065 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1138cac8-155e-409f-b116-3d60e14c855d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36ca2b62-a646-487a-ac9e-d33ebe53aadb', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5edcd01e-f765-408e-82fc-04d026978065 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af71b071-c6d7-4742-8575-04ef54dcb535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:40 devstack sudo[108010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-365041ff-1929-4030-85ad-fd232d27cd4a 1073741824
Nov 06 12:03:40 devstack sudo[108010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:40 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-5edcd01e-f765-408e-82fc-04d026978065 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Volume volume-36ca2b62-a646-487a-ac9e-d33ebe53aadb (36ca2b62-a646-487a-ac9e-d33ebe53aadb): created successfully
Nov 06 12:03:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5edcd01e-f765-408e-82fc-04d026978065 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af71b071-c6d7-4742-8575-04ef54dcb535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5edcd01e-f765-408e-82fc-04d026978065 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Flow 'volume_create_manager' (307e5ab2-1191-484b-9016-7b6a970228f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:03:40 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-5edcd01e-f765-408e-82fc-04d026978065 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Created volume successfully.
Nov 06 12:03:41 devstack sudo[108010]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c83395e0-be0c-421a-ab58-9bdf673214e4 tempest-CreateVolumesFromSnapshotTest-998218628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-365041ff-1929-4030-85ad-fd232d27cd4a 1073741824" returned: 0 in 0.531s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c83395e0-be0c-421a-ab58-9bdf673214e4 tempest-CreateVolumesFromSnapshotTest-998218628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-365041ff-1929-4030-85ad-fd232d27cd4a {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:41 devstack sudo[108016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-365041ff-1929-4030-85ad-fd232d27cd4a
Nov 06 12:03:41 devstack sudo[108016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:41 devstack sudo[108016]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c83395e0-be0c-421a-ab58-9bdf673214e4 tempest-CreateVolumesFromSnapshotTest-998218628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-365041ff-1929-4030-85ad-fd232d27cd4a" returned: 0 in 0.257s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:41 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-c83395e0-be0c-421a-ab58-9bdf673214e4 tempest-CreateVolumesFromSnapshotTest-998218628 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:03:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c83395e0-be0c-421a-ab58-9bdf673214e4 tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-da14ab22-8ed2-4d8e-b1f6-bbcb4f365354 tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.124s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:41 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-da14ab22-8ed2-4d8e-b1f6-bbcb4f365354 tempest-CreateVolumesFromSnapshotTest-998218628 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1467755927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67586f51-4385-48d9-ab10-7bd2fd87a397,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf8ab2e2f801464eb8a1acb7e214bc52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:38Z,use_quota=True,user_id='5f4273e4066d4ed09f3949c126bc4417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:03:41 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-da14ab22-8ed2-4d8e-b1f6-bbcb4f365354 tempest-CreateVolumesFromSnapshotTest-998218628 None] Creating volume 67586f51-4385-48d9-ab10-7bd2fd87a397 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:03:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-da14ab22-8ed2-4d8e-b1f6-bbcb4f365354 tempest-CreateVolumesFromSnapshotTest-998218628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-da14ab22-8ed2-4d8e-b1f6-bbcb4f365354 tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:41 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-da14ab22-8ed2-4d8e-b1f6-bbcb4f365354 tempest-CreateVolumesFromSnapshotTest-998218628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:41 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-da14ab22-8ed2-4d8e-b1f6-bbcb4f365354 tempest-CreateVolumesFromSnapshotTest-998218628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-da14ab22-8ed2-4d8e-b1f6-bbcb4f365354 tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:41 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-da14ab22-8ed2-4d8e-b1f6-bbcb4f365354 tempest-CreateVolumesFromSnapshotTest-998218628 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:03:41 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-da14ab22-8ed2-4d8e-b1f6-bbcb4f365354 tempest-CreateVolumesFromSnapshotTest-998218628 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:03:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-da14ab22-8ed2-4d8e-b1f6-bbcb4f365354 tempest-CreateVolumesFromSnapshotTest-998218628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-67586f51-4385-48d9-ab10-7bd2fd87a397 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:41 devstack sudo[108019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-67586f51-4385-48d9-ab10-7bd2fd87a397 1073741824
Nov 06 12:03:41 devstack sudo[108019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:41 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c83395e0-be0c-421a-ab58-9bdf673214e4 tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dda23391-96d5-45fa-9353-1a501f475484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-365041ff-1929-4030-85ad-fd232d27cd4a', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:41 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c83395e0-be0c-421a-ab58-9bdf673214e4 tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b177254-455c-4294-8ed5-582022e2f3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:41 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-c83395e0-be0c-421a-ab58-9bdf673214e4 tempest-CreateVolumesFromSnapshotTest-998218628 None] Volume volume-365041ff-1929-4030-85ad-fd232d27cd4a (365041ff-1929-4030-85ad-fd232d27cd4a): created successfully
Nov 06 12:03:41 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c83395e0-be0c-421a-ab58-9bdf673214e4 tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b177254-455c-4294-8ed5-582022e2f3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:41 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c83395e0-be0c-421a-ab58-9bdf673214e4 tempest-CreateVolumesFromSnapshotTest-998218628 None] Flow 'volume_create_manager' (08dc7ac1-c696-4e6b-96d6-b0f4f56c6880) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:03:41 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-c83395e0-be0c-421a-ab58-9bdf673214e4 tempest-CreateVolumesFromSnapshotTest-998218628 None] Created volume successfully.
Nov 06 12:03:42 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-05b60728-e251-461c-9117-d94990326ad5 tempest-ProjectReaderTests-1552493067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:03:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-05b60728-e251-461c-9117-d94990326ad5 tempest-ProjectReaderTests-1552493067 None] Flow 'volume_create_manager' (0d2dd104-db13-4c55-a846-902312ede476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:03:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-05b60728-e251-461c-9117-d94990326ad5 tempest-ProjectReaderTests-1552493067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adb894dd-f976-4bdc-9deb-12e271f3fc8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-05b60728-e251-461c-9117-d94990326ad5 tempest-ProjectReaderTests-1552493067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adb894dd-f976-4bdc-9deb-12e271f3fc8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:03:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1320602516',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=395fb6cb-b77d-41ce-8b40-18aeefaafead,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81ff2452065c4d4aa8f435415e360d34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:42Z,use_quota=True,user_id='1765484364934062a96eaf46228bca63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-05b60728-e251-461c-9117-d94990326ad5 tempest-ProjectReaderTests-1552493067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6c6238f-eee8-4f8c-965d-507fdcc88d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-05b60728-e251-461c-9117-d94990326ad5 tempest-ProjectReaderTests-1552493067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6c6238f-eee8-4f8c-965d-507fdcc88d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-05b60728-e251-461c-9117-d94990326ad5 tempest-ProjectReaderTests-1552493067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb73bec8-6713-42fb-af4e-6b8fd14d8622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-05b60728-e251-461c-9117-d94990326ad5 tempest-ProjectReaderTests-1552493067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb73bec8-6713-42fb-af4e-6b8fd14d8622) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '395fb6cb-b77d-41ce-8b40-18aeefaafead', 'volume_name': 'volume-395fb6cb-b77d-41ce-8b40-18aeefaafead', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-05b60728-e251-461c-9117-d94990326ad5 tempest-ProjectReaderTests-1552493067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (994881d3-c0c9-486b-a8db-86d216ad16cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-05b60728-e251-461c-9117-d94990326ad5 tempest-ProjectReaderTests-1552493067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (994881d3-c0c9-486b-a8db-86d216ad16cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-05b60728-e251-461c-9117-d94990326ad5 tempest-ProjectReaderTests-1552493067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02b5234f-7cd8-43d6-b873-b5359d77ca66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:42 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-05b60728-e251-461c-9117-d94990326ad5 tempest-ProjectReaderTests-1552493067 None] Volume 395fb6cb-b77d-41ce-8b40-18aeefaafead: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-395fb6cb-b77d-41ce-8b40-18aeefaafead', 'volume_size': 1}
Nov 06 12:03:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-05b60728-e251-461c-9117-d94990326ad5 tempest-ProjectReaderTests-1552493067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:42 devstack sudo[108019]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-da14ab22-8ed2-4d8e-b1f6-bbcb4f365354 tempest-CreateVolumesFromSnapshotTest-998218628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-67586f51-4385-48d9-ab10-7bd2fd87a397 1073741824" returned: 0 in 0.549s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-da14ab22-8ed2-4d8e-b1f6-bbcb4f365354 tempest-CreateVolumesFromSnapshotTest-998218628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-67586f51-4385-48d9-ab10-7bd2fd87a397 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:42 devstack sudo[108025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-67586f51-4385-48d9-ab10-7bd2fd87a397
Nov 06 12:03:42 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:42 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-da14ab22-8ed2-4d8e-b1f6-bbcb4f365354 tempest-CreateVolumesFromSnapshotTest-998218628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-67586f51-4385-48d9-ab10-7bd2fd87a397" returned: 0 in 0.261s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:42 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-da14ab22-8ed2-4d8e-b1f6-bbcb4f365354 tempest-CreateVolumesFromSnapshotTest-998218628 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:03:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-da14ab22-8ed2-4d8e-b1f6-bbcb4f365354 tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6e5856dd-088d-4a43-9c7f-bb36e02759a9 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.780s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:42 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-6e5856dd-088d-4a43-9c7f-bb36e02759a9 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:03:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-596155101',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b306f2e-0bc5-4e99-88a0-4e723ab7f3b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da410887685d462a87549836b08a546c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:38Z,use_quota=True,user_id='62a0bda5ea9349baa1f40d765c852d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:03:42 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-6e5856dd-088d-4a43-9c7f-bb36e02759a9 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Creating volume 8b306f2e-0bc5-4e99-88a0-4e723ab7f3b8 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:03:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6e5856dd-088d-4a43-9c7f-bb36e02759a9 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6e5856dd-088d-4a43-9c7f-bb36e02759a9 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:42 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-6e5856dd-088d-4a43-9c7f-bb36e02759a9 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:42 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-6e5856dd-088d-4a43-9c7f-bb36e02759a9 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6e5856dd-088d-4a43-9c7f-bb36e02759a9 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:42 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-6e5856dd-088d-4a43-9c7f-bb36e02759a9 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:03:42 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-6e5856dd-088d-4a43-9c7f-bb36e02759a9 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:03:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6e5856dd-088d-4a43-9c7f-bb36e02759a9 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b306f2e-0bc5-4e99-88a0-4e723ab7f3b8 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:42 devstack sudo[108028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b306f2e-0bc5-4e99-88a0-4e723ab7f3b8 1073741824
Nov 06 12:03:42 devstack sudo[108028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-da14ab22-8ed2-4d8e-b1f6-bbcb4f365354 tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e61f44c-fe38-4b39-bcc3-3538b965fcca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67586f51-4385-48d9-ab10-7bd2fd87a397', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-da14ab22-8ed2-4d8e-b1f6-bbcb4f365354 tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5551c809-5f1d-4f92-b2f6-7f4bb0d2cd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:42 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-da14ab22-8ed2-4d8e-b1f6-bbcb4f365354 tempest-CreateVolumesFromSnapshotTest-998218628 None] Volume volume-67586f51-4385-48d9-ab10-7bd2fd87a397 (67586f51-4385-48d9-ab10-7bd2fd87a397): created successfully
Nov 06 12:03:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-da14ab22-8ed2-4d8e-b1f6-bbcb4f365354 tempest-CreateVolumesFromSnapshotTest-998218628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5551c809-5f1d-4f92-b2f6-7f4bb0d2cd5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:42 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-da14ab22-8ed2-4d8e-b1f6-bbcb4f365354 tempest-CreateVolumesFromSnapshotTest-998218628 None] Flow 'volume_create_manager' (9f81607d-091e-4678-a593-a5e544a29a1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:03:42 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-da14ab22-8ed2-4d8e-b1f6-bbcb4f365354 tempest-CreateVolumesFromSnapshotTest-998218628 None] Created volume successfully.
Nov 06 12:03:42 devstack sudo[108028]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6e5856dd-088d-4a43-9c7f-bb36e02759a9 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b306f2e-0bc5-4e99-88a0-4e723ab7f3b8 1073741824" returned: 0 in 0.439s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6e5856dd-088d-4a43-9c7f-bb36e02759a9 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b306f2e-0bc5-4e99-88a0-4e723ab7f3b8 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:43 devstack sudo[108035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b306f2e-0bc5-4e99-88a0-4e723ab7f3b8
Nov 06 12:03:43 devstack sudo[108035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:43 devstack sudo[108035]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6e5856dd-088d-4a43-9c7f-bb36e02759a9 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b306f2e-0bc5-4e99-88a0-4e723ab7f3b8" returned: 0 in 0.261s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:43 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-6e5856dd-088d-4a43-9c7f-bb36e02759a9 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:03:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6e5856dd-088d-4a43-9c7f-bb36e02759a9 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9fea9c6d-151c-4094-80cb-27ca288dd201 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.488s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:43 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-9fea9c6d-151c-4094-80cb-27ca288dd201 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:03:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1761260677',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e466a146-6d4a-4e15-9f24-99d8817227e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da410887685d462a87549836b08a546c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:38Z,use_quota=True,user_id='62a0bda5ea9349baa1f40d765c852d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:03:43 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-9fea9c6d-151c-4094-80cb-27ca288dd201 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Creating volume e466a146-6d4a-4e15-9f24-99d8817227e0 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:03:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9fea9c6d-151c-4094-80cb-27ca288dd201 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9fea9c6d-151c-4094-80cb-27ca288dd201 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:43 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-9fea9c6d-151c-4094-80cb-27ca288dd201 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:43 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-9fea9c6d-151c-4094-80cb-27ca288dd201 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9fea9c6d-151c-4094-80cb-27ca288dd201 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:43 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-9fea9c6d-151c-4094-80cb-27ca288dd201 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:03:43 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-9fea9c6d-151c-4094-80cb-27ca288dd201 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:03:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9fea9c6d-151c-4094-80cb-27ca288dd201 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e466a146-6d4a-4e15-9f24-99d8817227e0 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:43 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6e5856dd-088d-4a43-9c7f-bb36e02759a9 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e412db6-9c85-4689-ad5d-0e6a53225769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b306f2e-0bc5-4e99-88a0-4e723ab7f3b8', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:43 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6e5856dd-088d-4a43-9c7f-bb36e02759a9 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d55ebc78-5560-4b4e-a669-8d6e680696c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:43 devstack sudo[108038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e466a146-6d4a-4e15-9f24-99d8817227e0 1073741824
Nov 06 12:03:43 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:43 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-6e5856dd-088d-4a43-9c7f-bb36e02759a9 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Volume volume-8b306f2e-0bc5-4e99-88a0-4e723ab7f3b8 (8b306f2e-0bc5-4e99-88a0-4e723ab7f3b8): created successfully
Nov 06 12:03:43 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6e5856dd-088d-4a43-9c7f-bb36e02759a9 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d55ebc78-5560-4b4e-a669-8d6e680696c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:43 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6e5856dd-088d-4a43-9c7f-bb36e02759a9 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Flow 'volume_create_manager' (62893260-78a9-435d-84b3-01fb0cb0484b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:03:43 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-6e5856dd-088d-4a43-9c7f-bb36e02759a9 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Created volume successfully.
Nov 06 12:03:43 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-326a1892-744e-487f-a463-faf3a9982340 tempest-CreateVolumesFromSnapshotTest-998218628 None] Acquiring lock "cinder-365041ff-1929-4030-85ad-fd232d27cd4a-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:43 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-326a1892-744e-487f-a463-faf3a9982340 tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "cinder-365041ff-1929-4030-85ad-fd232d27cd4a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:43 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-326a1892-744e-487f-a463-faf3a9982340 tempest-CreateVolumesFromSnapshotTest-998218628 None] Acquiring lock "cinder-quobyte-365041ff-1929-4030-85ad-fd232d27cd4a" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:43 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-326a1892-744e-487f-a463-faf3a9982340 tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "cinder-quobyte-365041ff-1929-4030-85ad-fd232d27cd4a" acquired by "delete_volume" :: waited 0.018s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:43 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb80cc1-9f33-4fa4-a900-d9998073ce97]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:03:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-326a1892-744e-487f-a463-faf3a9982340 tempest-CreateVolumesFromSnapshotTest-998218628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-365041ff-1929-4030-85ad-fd232d27cd4a {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:43 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9fea9c6d-151c-4094-80cb-27ca288dd201 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e466a146-6d4a-4e15-9f24-99d8817227e0 1073741824" returned: 0 in 0.542s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:43 devstack sudo[108044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-365041ff-1929-4030-85ad-fd232d27cd4a
Nov 06 12:03:43 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9fea9c6d-151c-4094-80cb-27ca288dd201 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e466a146-6d4a-4e15-9f24-99d8817227e0 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:43 devstack sudo[108046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e466a146-6d4a-4e15-9f24-99d8817227e0
Nov 06 12:03:43 devstack sudo[108046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:44 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-326a1892-744e-487f-a463-faf3a9982340 tempest-CreateVolumesFromSnapshotTest-998218628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-365041ff-1929-4030-85ad-fd232d27cd4a" returned: 0 in 0.442s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-326a1892-744e-487f-a463-faf3a9982340 tempest-CreateVolumesFromSnapshotTest-998218628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-365041ff-1929-4030-85ad-fd232d27cd4a {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:44 devstack sudo[108052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-365041ff-1929-4030-85ad-fd232d27cd4a
Nov 06 12:03:44 devstack sudo[108052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:44 devstack sudo[108046]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9fea9c6d-151c-4094-80cb-27ca288dd201 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e466a146-6d4a-4e15-9f24-99d8817227e0" returned: 0 in 0.304s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:44 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-9fea9c6d-151c-4094-80cb-27ca288dd201 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:03:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9fea9c6d-151c-4094-80cb-27ca288dd201 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-05b60728-e251-461c-9117-d94990326ad5 tempest-ProjectReaderTests-1552493067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.060s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:44 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-05b60728-e251-461c-9117-d94990326ad5 tempest-ProjectReaderTests-1552493067 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:03:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1320602516',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=395fb6cb-b77d-41ce-8b40-18aeefaafead,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81ff2452065c4d4aa8f435415e360d34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:42Z,use_quota=True,user_id='1765484364934062a96eaf46228bca63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:03:44 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-05b60728-e251-461c-9117-d94990326ad5 tempest-ProjectReaderTests-1552493067 None] Creating volume 395fb6cb-b77d-41ce-8b40-18aeefaafead {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:03:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-05b60728-e251-461c-9117-d94990326ad5 tempest-ProjectReaderTests-1552493067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-05b60728-e251-461c-9117-d94990326ad5 tempest-ProjectReaderTests-1552493067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:44 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-05b60728-e251-461c-9117-d94990326ad5 tempest-ProjectReaderTests-1552493067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:44 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-05b60728-e251-461c-9117-d94990326ad5 tempest-ProjectReaderTests-1552493067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-05b60728-e251-461c-9117-d94990326ad5 tempest-ProjectReaderTests-1552493067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:44 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-05b60728-e251-461c-9117-d94990326ad5 tempest-ProjectReaderTests-1552493067 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:03:44 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-05b60728-e251-461c-9117-d94990326ad5 tempest-ProjectReaderTests-1552493067 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:03:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-05b60728-e251-461c-9117-d94990326ad5 tempest-ProjectReaderTests-1552493067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-395fb6cb-b77d-41ce-8b40-18aeefaafead 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:44 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9fea9c6d-151c-4094-80cb-27ca288dd201 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe4fe443-2a14-4d14-859d-77251b3785df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e466a146-6d4a-4e15-9f24-99d8817227e0', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:44 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9fea9c6d-151c-4094-80cb-27ca288dd201 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (336b4776-f728-49e1-99cf-963d004fe304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:44 devstack sudo[108054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-395fb6cb-b77d-41ce-8b40-18aeefaafead 1073741824
Nov 06 12:03:44 devstack sudo[108054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:44 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-9fea9c6d-151c-4094-80cb-27ca288dd201 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Volume volume-e466a146-6d4a-4e15-9f24-99d8817227e0 (e466a146-6d4a-4e15-9f24-99d8817227e0): created successfully
Nov 06 12:03:44 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9fea9c6d-151c-4094-80cb-27ca288dd201 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (336b4776-f728-49e1-99cf-963d004fe304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:44 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9fea9c6d-151c-4094-80cb-27ca288dd201 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Flow 'volume_create_manager' (0c997ffa-ae25-453c-a2c9-5f8060769337) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:03:44 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-9fea9c6d-151c-4094-80cb-27ca288dd201 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Created volume successfully.
Nov 06 12:03:44 devstack sudo[108052]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-326a1892-744e-487f-a463-faf3a9982340 tempest-CreateVolumesFromSnapshotTest-998218628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-365041ff-1929-4030-85ad-fd232d27cd4a" returned: 0 in 0.310s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:44 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-326a1892-744e-487f-a463-faf3a9982340 tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "cinder-quobyte-365041ff-1929-4030-85ad-fd232d27cd4a" released by "delete_volume" :: held 0.816s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:44 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-59bacd39-633d-45cb-9d2d-d0189a18dc53 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Acquiring lock "cinder-e466a146-6d4a-4e15-9f24-99d8817227e0-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:44 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-326a1892-744e-487f-a463-faf3a9982340 tempest-CreateVolumesFromSnapshotTest-998218628 None] Created reservations ['40ea19f4-23d7-4e4a-ac75-bbbe87a843fc', '647369cf-9f4e-4d39-80f6-d276a65d408b', 'd6b20c82-0702-4e58-9f3f-bd5368cb4c45', '11b06567-293b-4a4e-a75b-99fa81b4f7e1'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:03:44 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-59bacd39-633d-45cb-9d2d-d0189a18dc53 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "cinder-e466a146-6d4a-4e15-9f24-99d8817227e0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:44 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-59bacd39-633d-45cb-9d2d-d0189a18dc53 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Acquiring lock "cinder-quobyte-e466a146-6d4a-4e15-9f24-99d8817227e0" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:44 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-59bacd39-633d-45cb-9d2d-d0189a18dc53 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "cinder-quobyte-e466a146-6d4a-4e15-9f24-99d8817227e0" acquired by "delete_volume" :: waited 0.032s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-326a1892-744e-487f-a463-faf3a9982340 tempest-CreateVolumesFromSnapshotTest-998218628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-326a1892-744e-487f-a463-faf3a9982340 tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:44 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-326a1892-744e-487f-a463-faf3a9982340 tempest-CreateVolumesFromSnapshotTest-998218628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:44 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-326a1892-744e-487f-a463-faf3a9982340 tempest-CreateVolumesFromSnapshotTest-998218628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-326a1892-744e-487f-a463-faf3a9982340 tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-326a1892-744e-487f-a463-faf3a9982340 tempest-CreateVolumesFromSnapshotTest-998218628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:44 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f89a27-1633-4431-bcb9-eae4c88ebd3f]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:03:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-59bacd39-633d-45cb-9d2d-d0189a18dc53 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e466a146-6d4a-4e15-9f24-99d8817227e0 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:44 devstack sudo[108060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:03:44 devstack sudo[108060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:44 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e2ad51d0-3a18-4f15-ac7d-e3331fd5fd9a tempest-CreateVolumesFromSnapshotTest-998218628 None] Acquiring lock "cinder-67586f51-4385-48d9-ab10-7bd2fd87a397-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:44 devstack sudo[108054]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:44 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e2ad51d0-3a18-4f15-ac7d-e3331fd5fd9a tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "cinder-67586f51-4385-48d9-ab10-7bd2fd87a397-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-05b60728-e251-461c-9117-d94990326ad5 tempest-ProjectReaderTests-1552493067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-395fb6cb-b77d-41ce-8b40-18aeefaafead 1073741824" returned: 0 in 0.651s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:44 devstack sudo[108063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e466a146-6d4a-4e15-9f24-99d8817227e0
Nov 06 12:03:44 devstack sudo[108063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:44 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e2ad51d0-3a18-4f15-ac7d-e3331fd5fd9a tempest-CreateVolumesFromSnapshotTest-998218628 None] Acquiring lock "cinder-quobyte-67586f51-4385-48d9-ab10-7bd2fd87a397" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-05b60728-e251-461c-9117-d94990326ad5 tempest-ProjectReaderTests-1552493067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-395fb6cb-b77d-41ce-8b40-18aeefaafead {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:44 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e2ad51d0-3a18-4f15-ac7d-e3331fd5fd9a tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "cinder-quobyte-67586f51-4385-48d9-ab10-7bd2fd87a397" acquired by "delete_volume" :: waited 0.032s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:44 devstack sudo[108066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-395fb6cb-b77d-41ce-8b40-18aeefaafead
Nov 06 12:03:44 devstack sudo[108066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:44 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f877690-e8f2-4471-81f3-e88e9a101004]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:03:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e2ad51d0-3a18-4f15-ac7d-e3331fd5fd9a tempest-CreateVolumesFromSnapshotTest-998218628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-67586f51-4385-48d9-ab10-7bd2fd87a397 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:45 devstack sudo[108060]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-326a1892-744e-487f-a463-faf3a9982340 tempest-CreateVolumesFromSnapshotTest-998218628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.413s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:45 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-326a1892-744e-487f-a463-faf3a9982340 tempest-CreateVolumesFromSnapshotTest-998218628 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:03:45 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-326a1892-744e-487f-a463-faf3a9982340 tempest-CreateVolumesFromSnapshotTest-998218628 None] Deleted volume successfully.
Nov 06 12:03:45 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-326a1892-744e-487f-a463-faf3a9982340 tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "cinder-365041ff-1929-4030-85ad-fd232d27cd4a-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:45 devstack sudo[108068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-67586f51-4385-48d9-ab10-7bd2fd87a397
Nov 06 12:03:45 devstack sudo[108068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:45 devstack sudo[108063]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-59bacd39-633d-45cb-9d2d-d0189a18dc53 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e466a146-6d4a-4e15-9f24-99d8817227e0" returned: 0 in 0.522s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-59bacd39-633d-45cb-9d2d-d0189a18dc53 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e466a146-6d4a-4e15-9f24-99d8817227e0 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:45 devstack sudo[108066]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-05b60728-e251-461c-9117-d94990326ad5 tempest-ProjectReaderTests-1552493067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-395fb6cb-b77d-41ce-8b40-18aeefaafead" returned: 0 in 0.327s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:45 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-05b60728-e251-461c-9117-d94990326ad5 tempest-ProjectReaderTests-1552493067 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:03:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-05b60728-e251-461c-9117-d94990326ad5 tempest-ProjectReaderTests-1552493067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:45 devstack sudo[108075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e466a146-6d4a-4e15-9f24-99d8817227e0
Nov 06 12:03:45 devstack sudo[108075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:45 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-05b60728-e251-461c-9117-d94990326ad5 tempest-ProjectReaderTests-1552493067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02b5234f-7cd8-43d6-b873-b5359d77ca66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-395fb6cb-b77d-41ce-8b40-18aeefaafead', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:45 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-05b60728-e251-461c-9117-d94990326ad5 tempest-ProjectReaderTests-1552493067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37bd5fe1-4e44-4409-b892-237974a4fec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:45 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-05b60728-e251-461c-9117-d94990326ad5 tempest-ProjectReaderTests-1552493067 None] Volume volume-395fb6cb-b77d-41ce-8b40-18aeefaafead (395fb6cb-b77d-41ce-8b40-18aeefaafead): created successfully
Nov 06 12:03:45 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-05b60728-e251-461c-9117-d94990326ad5 tempest-ProjectReaderTests-1552493067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37bd5fe1-4e44-4409-b892-237974a4fec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:45 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-05b60728-e251-461c-9117-d94990326ad5 tempest-ProjectReaderTests-1552493067 None] Flow 'volume_create_manager' (0d2dd104-db13-4c55-a846-902312ede476) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:03:45 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-05b60728-e251-461c-9117-d94990326ad5 tempest-ProjectReaderTests-1552493067 None] Created volume successfully.
Nov 06 12:03:45 devstack sudo[108075]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-59bacd39-633d-45cb-9d2d-d0189a18dc53 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e466a146-6d4a-4e15-9f24-99d8817227e0" returned: 0 in 0.283s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:45 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-59bacd39-633d-45cb-9d2d-d0189a18dc53 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "cinder-quobyte-e466a146-6d4a-4e15-9f24-99d8817227e0" released by "delete_volume" :: held 0.885s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:45 devstack sudo[108068]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e2ad51d0-3a18-4f15-ac7d-e3331fd5fd9a tempest-CreateVolumesFromSnapshotTest-998218628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-67586f51-4385-48d9-ab10-7bd2fd87a397" returned: 0 in 0.544s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e2ad51d0-3a18-4f15-ac7d-e3331fd5fd9a tempest-CreateVolumesFromSnapshotTest-998218628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-67586f51-4385-48d9-ab10-7bd2fd87a397 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:45 devstack sudo[108083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-67586f51-4385-48d9-ab10-7bd2fd87a397
Nov 06 12:03:45 devstack sudo[108083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:45 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-59bacd39-633d-45cb-9d2d-d0189a18dc53 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Created reservations ['e66703d0-da49-4743-be45-99135cff2e85', 'f5454768-64a4-44fb-8ce8-3fba3e2acca0', '76c12d38-fd94-4c3c-9bdf-48b9d11f7821', '2f8525b9-71a8-44b9-b65b-eecf0fd1e70e'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:03:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-59bacd39-633d-45cb-9d2d-d0189a18dc53 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-59bacd39-633d-45cb-9d2d-d0189a18dc53 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:45 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-59bacd39-633d-45cb-9d2d-d0189a18dc53 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:45 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-59bacd39-633d-45cb-9d2d-d0189a18dc53 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-59bacd39-633d-45cb-9d2d-d0189a18dc53 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-59bacd39-633d-45cb-9d2d-d0189a18dc53 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:45 devstack sudo[108085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:03:45 devstack sudo[108085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:45 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-83345174-9a40-4f20-822d-a35544ad8ce3 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Acquiring lock "cinder-8b306f2e-0bc5-4e99-88a0-4e723ab7f3b8-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:45 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-83345174-9a40-4f20-822d-a35544ad8ce3 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "cinder-8b306f2e-0bc5-4e99-88a0-4e723ab7f3b8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:45 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-83345174-9a40-4f20-822d-a35544ad8ce3 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Acquiring lock "cinder-quobyte-8b306f2e-0bc5-4e99-88a0-4e723ab7f3b8" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:45 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-83345174-9a40-4f20-822d-a35544ad8ce3 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "cinder-quobyte-8b306f2e-0bc5-4e99-88a0-4e723ab7f3b8" acquired by "delete_volume" :: waited 0.017s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:45 devstack sudo[108083]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e2ad51d0-3a18-4f15-ac7d-e3331fd5fd9a tempest-CreateVolumesFromSnapshotTest-998218628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-67586f51-4385-48d9-ab10-7bd2fd87a397" returned: 0 in 0.313s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:45 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e2ad51d0-3a18-4f15-ac7d-e3331fd5fd9a tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "cinder-quobyte-67586f51-4385-48d9-ab10-7bd2fd87a397" released by "delete_volume" :: held 0.922s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:45 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2530682c-a79b-4131-b5d3-2817330af61a]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:03:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-83345174-9a40-4f20-822d-a35544ad8ce3 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b306f2e-0bc5-4e99-88a0-4e723ab7f3b8 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:45 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-e2ad51d0-3a18-4f15-ac7d-e3331fd5fd9a tempest-CreateVolumesFromSnapshotTest-998218628 None] Created reservations ['f6b91620-b3c2-4e64-9bc2-927c4cc0bbc8', '84b25cb8-256e-4975-b96e-db946e5fe7b8', '4d73b0a6-d698-4644-9534-96022e43cc56', '4bb6eca5-e501-4dfe-ae7b-d6e331e94b6f'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:03:46 devstack sudo[108088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b306f2e-0bc5-4e99-88a0-4e723ab7f3b8
Nov 06 12:03:46 devstack sudo[108088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e2ad51d0-3a18-4f15-ac7d-e3331fd5fd9a tempest-CreateVolumesFromSnapshotTest-998218628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e2ad51d0-3a18-4f15-ac7d-e3331fd5fd9a tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:46 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-e2ad51d0-3a18-4f15-ac7d-e3331fd5fd9a tempest-CreateVolumesFromSnapshotTest-998218628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:46 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-e2ad51d0-3a18-4f15-ac7d-e3331fd5fd9a tempest-CreateVolumesFromSnapshotTest-998218628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e2ad51d0-3a18-4f15-ac7d-e3331fd5fd9a tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e2ad51d0-3a18-4f15-ac7d-e3331fd5fd9a tempest-CreateVolumesFromSnapshotTest-998218628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:46 devstack sudo[108085]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-59bacd39-633d-45cb-9d2d-d0189a18dc53 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.383s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:46 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-59bacd39-633d-45cb-9d2d-d0189a18dc53 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:03:46 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-59bacd39-633d-45cb-9d2d-d0189a18dc53 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Deleted volume successfully.
Nov 06 12:03:46 devstack sudo[108091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:03:46 devstack sudo[108091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:46 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-59bacd39-633d-45cb-9d2d-d0189a18dc53 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "cinder-e466a146-6d4a-4e15-9f24-99d8817227e0-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:46 devstack sudo[108091]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e2ad51d0-3a18-4f15-ac7d-e3331fd5fd9a tempest-CreateVolumesFromSnapshotTest-998218628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.324s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:46 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-e2ad51d0-3a18-4f15-ac7d-e3331fd5fd9a tempest-CreateVolumesFromSnapshotTest-998218628 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:03:46 devstack sudo[108088]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-83345174-9a40-4f20-822d-a35544ad8ce3 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b306f2e-0bc5-4e99-88a0-4e723ab7f3b8" returned: 0 in 0.543s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-83345174-9a40-4f20-822d-a35544ad8ce3 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b306f2e-0bc5-4e99-88a0-4e723ab7f3b8 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:46 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-e2ad51d0-3a18-4f15-ac7d-e3331fd5fd9a tempest-CreateVolumesFromSnapshotTest-998218628 None] Deleted volume successfully.
Nov 06 12:03:46 devstack sudo[108097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b306f2e-0bc5-4e99-88a0-4e723ab7f3b8
Nov 06 12:03:46 devstack sudo[108097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:46 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e2ad51d0-3a18-4f15-ac7d-e3331fd5fd9a tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "cinder-67586f51-4385-48d9-ab10-7bd2fd87a397-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:46 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-8429516b-4eac-4968-804e-0e8371f347ba tempest-ProjectReaderTests-1552493067 None] Acquiring lock "cinder-395fb6cb-b77d-41ce-8b40-18aeefaafead-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:46 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-8429516b-4eac-4968-804e-0e8371f347ba tempest-ProjectReaderTests-1552493067 None] Lock "cinder-395fb6cb-b77d-41ce-8b40-18aeefaafead-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:46 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-8429516b-4eac-4968-804e-0e8371f347ba tempest-ProjectReaderTests-1552493067 None] Acquiring lock "cinder-quobyte-395fb6cb-b77d-41ce-8b40-18aeefaafead" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:46 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-8429516b-4eac-4968-804e-0e8371f347ba tempest-ProjectReaderTests-1552493067 None] Lock "cinder-quobyte-395fb6cb-b77d-41ce-8b40-18aeefaafead" acquired by "delete_volume" :: waited 0.021s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:46 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92958db-f221-4ac3-9a02-eb265fa03e8e]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:03:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-8429516b-4eac-4968-804e-0e8371f347ba tempest-ProjectReaderTests-1552493067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-395fb6cb-b77d-41ce-8b40-18aeefaafead {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:46 devstack sudo[108097]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-83345174-9a40-4f20-822d-a35544ad8ce3 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b306f2e-0bc5-4e99-88a0-4e723ab7f3b8" returned: 0 in 0.328s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:46 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-83345174-9a40-4f20-822d-a35544ad8ce3 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "cinder-quobyte-8b306f2e-0bc5-4e99-88a0-4e723ab7f3b8" released by "delete_volume" :: held 0.933s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:46 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-83345174-9a40-4f20-822d-a35544ad8ce3 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Created reservations ['14a79999-7d6f-4809-8539-0f34c5d01eb4', '106bcac5-578b-478b-bbc9-2edb4c5f7932', '11606916-413b-46a0-a914-0e3856d1475f', '88e38f34-0217-403b-8878-ca3c55c873e7'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:03:46 devstack sudo[108100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-395fb6cb-b77d-41ce-8b40-18aeefaafead
Nov 06 12:03:46 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-83345174-9a40-4f20-822d-a35544ad8ce3 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-83345174-9a40-4f20-822d-a35544ad8ce3 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:46 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-83345174-9a40-4f20-822d-a35544ad8ce3 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:46 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-83345174-9a40-4f20-822d-a35544ad8ce3 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-83345174-9a40-4f20-822d-a35544ad8ce3 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-83345174-9a40-4f20-822d-a35544ad8ce3 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:46 devstack sudo[108102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:03:46 devstack sudo[108102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:46 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-18bb7136-ed55-4a06-8bfa-09e867a6c34e tempest-ProjectReaderTests-1672117553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-18bb7136-ed55-4a06-8bfa-09e867a6c34e tempest-ProjectReaderTests-1672117553 None] Flow 'volume_create_manager' (3307e177-c032-4630-aaf0-bbf8c53f4e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-18bb7136-ed55-4a06-8bfa-09e867a6c34e tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (984ce702-dba3-46a3-9a02-1feaab4cd1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-587cb499-7b2f-41ed-9c84-3f678e8694bb tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Acquiring lock "cinder-36ca2b62-a646-487a-ac9e-d33ebe53aadb-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-18bb7136-ed55-4a06-8bfa-09e867a6c34e tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (984ce702-dba3-46a3-9a02-1feaab4cd1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1404871799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25b7a7cf-c261-460b-8861-ffafca7d0784,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c737f6ee48a4d11a061314cd20da265',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:47Z,use_quota=True,user_id='7695e7d99bd24749a219f86885bd0d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-18bb7136-ed55-4a06-8bfa-09e867a6c34e tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c15b4c0-952b-4957-afe6-a659b9dfc6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-18bb7136-ed55-4a06-8bfa-09e867a6c34e tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c15b4c0-952b-4957-afe6-a659b9dfc6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-18bb7136-ed55-4a06-8bfa-09e867a6c34e tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d11b851-9ea1-4e81-a3fa-2744c8607841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-18bb7136-ed55-4a06-8bfa-09e867a6c34e tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d11b851-9ea1-4e81-a3fa-2744c8607841) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25b7a7cf-c261-460b-8861-ffafca7d0784', 'volume_name': 'volume-25b7a7cf-c261-460b-8861-ffafca7d0784', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-18bb7136-ed55-4a06-8bfa-09e867a6c34e tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a19b7520-1d15-463f-850b-f93c0565826b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-18bb7136-ed55-4a06-8bfa-09e867a6c34e tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a19b7520-1d15-463f-850b-f93c0565826b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-18bb7136-ed55-4a06-8bfa-09e867a6c34e tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6321ab6-75a9-4b76-9743-bd5cdc558fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:47 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-18bb7136-ed55-4a06-8bfa-09e867a6c34e tempest-ProjectReaderTests-1672117553 None] Volume 25b7a7cf-c261-460b-8861-ffafca7d0784: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25b7a7cf-c261-460b-8861-ffafca7d0784', 'volume_size': 1}
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-18bb7136-ed55-4a06-8bfa-09e867a6c34e tempest-ProjectReaderTests-1672117553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-18bb7136-ed55-4a06-8bfa-09e867a6c34e tempest-ProjectReaderTests-1672117553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-18bb7136-ed55-4a06-8bfa-09e867a6c34e tempest-ProjectReaderTests-1672117553 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1404871799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25b7a7cf-c261-460b-8861-ffafca7d0784,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c737f6ee48a4d11a061314cd20da265',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:47Z,use_quota=True,user_id='7695e7d99bd24749a219f86885bd0d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-18bb7136-ed55-4a06-8bfa-09e867a6c34e tempest-ProjectReaderTests-1672117553 None] Creating volume 25b7a7cf-c261-460b-8861-ffafca7d0784 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-18bb7136-ed55-4a06-8bfa-09e867a6c34e tempest-ProjectReaderTests-1672117553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-18bb7136-ed55-4a06-8bfa-09e867a6c34e tempest-ProjectReaderTests-1672117553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-18bb7136-ed55-4a06-8bfa-09e867a6c34e tempest-ProjectReaderTests-1672117553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-18bb7136-ed55-4a06-8bfa-09e867a6c34e tempest-ProjectReaderTests-1672117553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-18bb7136-ed55-4a06-8bfa-09e867a6c34e tempest-ProjectReaderTests-1672117553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-18bb7136-ed55-4a06-8bfa-09e867a6c34e tempest-ProjectReaderTests-1672117553 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:03:47 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-18bb7136-ed55-4a06-8bfa-09e867a6c34e tempest-ProjectReaderTests-1672117553 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-18bb7136-ed55-4a06-8bfa-09e867a6c34e tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25b7a7cf-c261-460b-8861-ffafca7d0784 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-587cb499-7b2f-41ed-9c84-3f678e8694bb tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "cinder-36ca2b62-a646-487a-ac9e-d33ebe53aadb-delete_volume" acquired by "delete_volume" :: waited 0.109s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:47 devstack sudo[108106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25b7a7cf-c261-460b-8861-ffafca7d0784 1073741824
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5cade9bc-2a8e-46cd-891c-32770040a085 tempest-CreateVolumesFromSnapshotTest-998218628 None] Acquiring lock "cinder-e8679eae-e1c6-4227-8f45-52975039c1b7-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:47 devstack sudo[108106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5cade9bc-2a8e-46cd-891c-32770040a085 tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "cinder-e8679eae-e1c6-4227-8f45-52975039c1b7-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:47 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:47 devstack sudo[108102]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-8429516b-4eac-4968-804e-0e8371f347ba tempest-ProjectReaderTests-1552493067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-395fb6cb-b77d-41ce-8b40-18aeefaafead" returned: 0 in 0.560s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-8429516b-4eac-4968-804e-0e8371f347ba tempest-ProjectReaderTests-1552493067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-395fb6cb-b77d-41ce-8b40-18aeefaafead {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-83345174-9a40-4f20-822d-a35544ad8ce3 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.367s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-83345174-9a40-4f20-822d-a35544ad8ce3 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-587cb499-7b2f-41ed-9c84-3f678e8694bb tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Acquiring lock "cinder-quobyte-36ca2b62-a646-487a-ac9e-d33ebe53aadb" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:47 devstack sudo[108110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-395fb6cb-b77d-41ce-8b40-18aeefaafead
Nov 06 12:03:47 devstack sudo[108110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:47 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-83345174-9a40-4f20-822d-a35544ad8ce3 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Deleted volume successfully.
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5cade9bc-2a8e-46cd-891c-32770040a085 tempest-CreateVolumesFromSnapshotTest-998218628 None] Acquiring lock "cinder-quobyte-e8679eae-e1c6-4227-8f45-52975039c1b7" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-587cb499-7b2f-41ed-9c84-3f678e8694bb tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "cinder-quobyte-36ca2b62-a646-487a-ac9e-d33ebe53aadb" acquired by "delete_volume" :: waited 0.039s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5cade9bc-2a8e-46cd-891c-32770040a085 tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "cinder-quobyte-e8679eae-e1c6-4227-8f45-52975039c1b7" acquired by "delete_volume" :: waited 0.049s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-83345174-9a40-4f20-822d-a35544ad8ce3 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "cinder-8b306f2e-0bc5-4e99-88a0-4e723ab7f3b8-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5277198-86e7-4b6b-a8ef-5e7cbbe41c78]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-587cb499-7b2f-41ed-9c84-3f678e8694bb tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-36ca2b62-a646-487a-ac9e-d33ebe53aadb {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f089bd61-9a2b-4eb3-b17b-da08deeb3d19]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5cade9bc-2a8e-46cd-891c-32770040a085 tempest-CreateVolumesFromSnapshotTest-998218628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e8679eae-e1c6-4227-8f45-52975039c1b7 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:47 devstack sudo[108115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-36ca2b62-a646-487a-ac9e-d33ebe53aadb
Nov 06 12:03:47 devstack sudo[108115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:47 devstack sudo[108110]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-8429516b-4eac-4968-804e-0e8371f347ba tempest-ProjectReaderTests-1552493067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-395fb6cb-b77d-41ce-8b40-18aeefaafead" returned: 0 in 0.268s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:47 devstack sudo[108116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e8679eae-e1c6-4227-8f45-52975039c1b7
Nov 06 12:03:47 devstack sudo[108116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-8429516b-4eac-4968-804e-0e8371f347ba tempest-ProjectReaderTests-1552493067 None] Lock "cinder-quobyte-395fb6cb-b77d-41ce-8b40-18aeefaafead" released by "delete_volume" :: held 0.897s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-8429516b-4eac-4968-804e-0e8371f347ba tempest-ProjectReaderTests-1552493067 None] Created reservations ['e76de0b1-688b-4c4e-9ac4-89262e890110', '9736d159-f9b5-43e6-98a3-9eaf987b44e0', '61a41fa6-820e-4519-ab64-8c8b29b37f60', 'e8d78a72-fcb5-4829-bcdb-b2548c441d3b'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:03:47 devstack sudo[108106]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-18bb7136-ed55-4a06-8bfa-09e867a6c34e tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25b7a7cf-c261-460b-8861-ffafca7d0784 1073741824" returned: 0 in 0.582s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-18bb7136-ed55-4a06-8bfa-09e867a6c34e tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25b7a7cf-c261-460b-8861-ffafca7d0784 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:47 devstack sudo[108123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25b7a7cf-c261-460b-8861-ffafca7d0784
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-8429516b-4eac-4968-804e-0e8371f347ba tempest-ProjectReaderTests-1552493067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-8429516b-4eac-4968-804e-0e8371f347ba tempest-ProjectReaderTests-1552493067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:47 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-8429516b-4eac-4968-804e-0e8371f347ba tempest-ProjectReaderTests-1552493067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-8429516b-4eac-4968-804e-0e8371f347ba tempest-ProjectReaderTests-1552493067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-8429516b-4eac-4968-804e-0e8371f347ba tempest-ProjectReaderTests-1552493067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-8429516b-4eac-4968-804e-0e8371f347ba tempest-ProjectReaderTests-1552493067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:47 devstack sudo[108128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:03:47 devstack sudo[108128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:47 devstack sudo[108115]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-587cb499-7b2f-41ed-9c84-3f678e8694bb tempest-CreateVolumesFromSourceVolumeTest-889966002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-36ca2b62-a646-487a-ac9e-d33ebe53aadb" returned: 0 in 0.491s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-587cb499-7b2f-41ed-9c84-3f678e8694bb tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-36ca2b62-a646-487a-ac9e-d33ebe53aadb {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:47 devstack sudo[108116]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5cade9bc-2a8e-46cd-891c-32770040a085 tempest-CreateVolumesFromSnapshotTest-998218628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e8679eae-e1c6-4227-8f45-52975039c1b7" returned: 0 in 0.497s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5cade9bc-2a8e-46cd-891c-32770040a085 tempest-CreateVolumesFromSnapshotTest-998218628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e8679eae-e1c6-4227-8f45-52975039c1b7 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:47 devstack sudo[108132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-36ca2b62-a646-487a-ac9e-d33ebe53aadb
Nov 06 12:03:47 devstack sudo[108132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:47 devstack sudo[108133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e8679eae-e1c6-4227-8f45-52975039c1b7
Nov 06 12:03:47 devstack sudo[108133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:48 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-18bb7136-ed55-4a06-8bfa-09e867a6c34e tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25b7a7cf-c261-460b-8861-ffafca7d0784" returned: 0 in 0.285s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:48 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-18bb7136-ed55-4a06-8bfa-09e867a6c34e tempest-ProjectReaderTests-1672117553 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:03:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-18bb7136-ed55-4a06-8bfa-09e867a6c34e tempest-ProjectReaderTests-1672117553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:48 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-18bb7136-ed55-4a06-8bfa-09e867a6c34e tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6321ab6-75a9-4b76-9743-bd5cdc558fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25b7a7cf-c261-460b-8861-ffafca7d0784', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:48 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-18bb7136-ed55-4a06-8bfa-09e867a6c34e tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c1a6aa3-49fe-4eb9-a0d9-a0c2d6baac1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:48 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-18bb7136-ed55-4a06-8bfa-09e867a6c34e tempest-ProjectReaderTests-1672117553 None] Volume volume-25b7a7cf-c261-460b-8861-ffafca7d0784 (25b7a7cf-c261-460b-8861-ffafca7d0784): created successfully
Nov 06 12:03:48 devstack sudo[108128]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:48 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-18bb7136-ed55-4a06-8bfa-09e867a6c34e tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c1a6aa3-49fe-4eb9-a0d9-a0c2d6baac1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:48 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-18bb7136-ed55-4a06-8bfa-09e867a6c34e tempest-ProjectReaderTests-1672117553 None] Flow 'volume_create_manager' (3307e177-c032-4630-aaf0-bbf8c53f4e0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:03:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-8429516b-4eac-4968-804e-0e8371f347ba tempest-ProjectReaderTests-1552493067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.319s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:48 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-8429516b-4eac-4968-804e-0e8371f347ba tempest-ProjectReaderTests-1552493067 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:03:48 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-8429516b-4eac-4968-804e-0e8371f347ba tempest-ProjectReaderTests-1552493067 None] Deleted volume successfully.
Nov 06 12:03:48 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-18bb7136-ed55-4a06-8bfa-09e867a6c34e tempest-ProjectReaderTests-1672117553 None] Created volume successfully.
Nov 06 12:03:48 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-8429516b-4eac-4968-804e-0e8371f347ba tempest-ProjectReaderTests-1552493067 None] Lock "cinder-395fb6cb-b77d-41ce-8b40-18aeefaafead-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:48 devstack sudo[108133]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5cade9bc-2a8e-46cd-891c-32770040a085 tempest-CreateVolumesFromSnapshotTest-998218628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-e8679eae-e1c6-4227-8f45-52975039c1b7" returned: 0 in 0.290s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:48 devstack sudo[108132]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-587cb499-7b2f-41ed-9c84-3f678e8694bb tempest-CreateVolumesFromSourceVolumeTest-889966002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-36ca2b62-a646-487a-ac9e-d33ebe53aadb" returned: 0 in 0.322s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:48 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5cade9bc-2a8e-46cd-891c-32770040a085 tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "cinder-quobyte-e8679eae-e1c6-4227-8f45-52975039c1b7" released by "delete_volume" :: held 0.851s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:48 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-587cb499-7b2f-41ed-9c84-3f678e8694bb tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "cinder-quobyte-36ca2b62-a646-487a-ac9e-d33ebe53aadb" released by "delete_volume" :: held 0.904s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:48 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-587cb499-7b2f-41ed-9c84-3f678e8694bb tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Created reservations ['2ac51562-bc53-4bfc-a6c5-a582cda8fd35', '60eaa8a3-3779-4616-93a3-3f9c59b27260', '87df9252-9390-4dfd-81fe-a805b280e0f3', '2ab59357-0d90-4a80-9c08-5d354c544da4'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:03:48 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-5cade9bc-2a8e-46cd-891c-32770040a085 tempest-CreateVolumesFromSnapshotTest-998218628 None] Created reservations ['0bf27fc8-f286-4306-aa5f-97070f9bec93', '990a254c-73ab-417e-952c-cb668fb8f790', '68f2ea7f-9401-4a73-ba82-4859d396e150', '76101c74-72db-4b70-acc0-95017d225ef8'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:03:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-587cb499-7b2f-41ed-9c84-3f678e8694bb tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-587cb499-7b2f-41ed-9c84-3f678e8694bb tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:48 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-587cb499-7b2f-41ed-9c84-3f678e8694bb tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:48 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-587cb499-7b2f-41ed-9c84-3f678e8694bb tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-587cb499-7b2f-41ed-9c84-3f678e8694bb tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-587cb499-7b2f-41ed-9c84-3f678e8694bb tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:48 devstack sudo[108140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:03:48 devstack sudo[108140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5cade9bc-2a8e-46cd-891c-32770040a085 tempest-CreateVolumesFromSnapshotTest-998218628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5cade9bc-2a8e-46cd-891c-32770040a085 tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:48 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5cade9bc-2a8e-46cd-891c-32770040a085 tempest-CreateVolumesFromSnapshotTest-998218628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:48 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5cade9bc-2a8e-46cd-891c-32770040a085 tempest-CreateVolumesFromSnapshotTest-998218628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5cade9bc-2a8e-46cd-891c-32770040a085 tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5cade9bc-2a8e-46cd-891c-32770040a085 tempest-CreateVolumesFromSnapshotTest-998218628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:48 devstack sudo[108142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:03:48 devstack sudo[108142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:48 devstack sudo[108140]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-587cb499-7b2f-41ed-9c84-3f678e8694bb tempest-CreateVolumesFromSourceVolumeTest-889966002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.268s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:48 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-587cb499-7b2f-41ed-9c84-3f678e8694bb tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:03:48 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-587cb499-7b2f-41ed-9c84-3f678e8694bb tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Deleted volume successfully.
Nov 06 12:03:48 devstack sudo[108142]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5cade9bc-2a8e-46cd-891c-32770040a085 tempest-CreateVolumesFromSnapshotTest-998218628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.252s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:48 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-5cade9bc-2a8e-46cd-891c-32770040a085 tempest-CreateVolumesFromSnapshotTest-998218628 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:03:48 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-587cb499-7b2f-41ed-9c84-3f678e8694bb tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "cinder-36ca2b62-a646-487a-ac9e-d33ebe53aadb-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:48 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-5cade9bc-2a8e-46cd-891c-32770040a085 tempest-CreateVolumesFromSnapshotTest-998218628 None] Deleted volume successfully.
Nov 06 12:03:48 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-5cade9bc-2a8e-46cd-891c-32770040a085 tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "cinder-e8679eae-e1c6-4227-8f45-52975039c1b7-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:49 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-9959d585-09cc-4b4a-998e-7116d50e6e54 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Acquiring lock "cinder-4b8c6773-5b7a-49fe-bb09-d3cb117e5fc0-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:49 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-9959d585-09cc-4b4a-998e-7116d50e6e54 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "cinder-4b8c6773-5b7a-49fe-bb09-d3cb117e5fc0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:49 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-9959d585-09cc-4b4a-998e-7116d50e6e54 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Acquiring lock "cinder-quobyte-4b8c6773-5b7a-49fe-bb09-d3cb117e5fc0" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:49 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-9959d585-09cc-4b4a-998e-7116d50e6e54 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "cinder-quobyte-4b8c6773-5b7a-49fe-bb09-d3cb117e5fc0" acquired by "delete_volume" :: waited 0.028s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:49 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[59adc982-9ded-4dcc-b486-9a151674fb45]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:03:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9959d585-09cc-4b4a-998e-7116d50e6e54 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4b8c6773-5b7a-49fe-bb09-d3cb117e5fc0 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-081c2c4c-dd96-4a1b-94b6-4dd4b3f6e8a7 tempest-ProjectReaderTests-1672117553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-081c2c4c-dd96-4a1b-94b6-4dd4b3f6e8a7 tempest-ProjectReaderTests-1672117553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:49 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3a35ade-65d4-4da8-a766-f1410da6952a tempest-ProjectReaderTests-1552493067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:03:49 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e3a35ade-65d4-4da8-a766-f1410da6952a tempest-ProjectReaderTests-1552493067 None] Flow 'volume_create_manager' (f4de437b-72db-493d-ac25-c20b4e92da63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:03:49 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e3a35ade-65d4-4da8-a766-f1410da6952a tempest-ProjectReaderTests-1552493067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cc70955-a8b2-4901-8e0e-68263168121d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:49 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-30aaa476-2b3d-4dcb-93db-1f90d7e68c2d tempest-CreateVolumesFromSnapshotTest-998218628 None] Acquiring lock "cinder-aab28781-ccaa-4125-9104-c4acd286e668-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:49 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-081c2c4c-dd96-4a1b-94b6-4dd4b3f6e8a7 tempest-ProjectReaderTests-1672117553 None] Creating offline snapshot d970a9bb-51ea-4454-9b1e-bc2f9441f24d of volume 25b7a7cf-c261-460b-8861-ffafca7d0784 {{(pid=87165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 12:03:49 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e3a35ade-65d4-4da8-a766-f1410da6952a tempest-ProjectReaderTests-1552493067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cc70955-a8b2-4901-8e0e-68263168121d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2028611516',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeba08f7-e190-4234-86e3-e29eea6d6bef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81ff2452065c4d4aa8f435415e360d34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:49Z,use_quota=True,user_id='1765484364934062a96eaf46228bca63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:49 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e3a35ade-65d4-4da8-a766-f1410da6952a tempest-ProjectReaderTests-1552493067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a12f416a-8c2d-41e8-89a3-b3b3bfcd63d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:49 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e3a35ade-65d4-4da8-a766-f1410da6952a tempest-ProjectReaderTests-1552493067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a12f416a-8c2d-41e8-89a3-b3b3bfcd63d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:49 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e3a35ade-65d4-4da8-a766-f1410da6952a tempest-ProjectReaderTests-1552493067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5435b97-839c-40e0-8dc6-d1aa65f22da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:49 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e3a35ade-65d4-4da8-a766-f1410da6952a tempest-ProjectReaderTests-1552493067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5435b97-839c-40e0-8dc6-d1aa65f22da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aeba08f7-e190-4234-86e3-e29eea6d6bef', 'volume_name': 'volume-aeba08f7-e190-4234-86e3-e29eea6d6bef', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:49 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e3a35ade-65d4-4da8-a766-f1410da6952a tempest-ProjectReaderTests-1552493067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34cbcf87-1162-46ea-b6a6-2b4ca7772461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:49 devstack sudo[108146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4b8c6773-5b7a-49fe-bb09-d3cb117e5fc0
Nov 06 12:03:49 devstack sudo[108146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:49 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e3a35ade-65d4-4da8-a766-f1410da6952a tempest-ProjectReaderTests-1552493067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34cbcf87-1162-46ea-b6a6-2b4ca7772461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:49 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e3a35ade-65d4-4da8-a766-f1410da6952a tempest-ProjectReaderTests-1552493067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c621f465-19aa-4efc-86f0-abec25c9cbc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:49 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-e3a35ade-65d4-4da8-a766-f1410da6952a tempest-ProjectReaderTests-1552493067 None] Volume aeba08f7-e190-4234-86e3-e29eea6d6bef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aeba08f7-e190-4234-86e3-e29eea6d6bef', 'volume_size': 1}
Nov 06 12:03:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e3a35ade-65d4-4da8-a766-f1410da6952a tempest-ProjectReaderTests-1552493067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:49 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[341b2c08-a768-48e4-be39-3c5611e5ad64]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:03:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-081c2c4c-dd96-4a1b-94b6-4dd4b3f6e8a7 tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25b7a7cf-c261-460b-8861-ffafca7d0784 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:49 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-30aaa476-2b3d-4dcb-93db-1f90d7e68c2d tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "cinder-aab28781-ccaa-4125-9104-c4acd286e668-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:49 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-30aaa476-2b3d-4dcb-93db-1f90d7e68c2d tempest-CreateVolumesFromSnapshotTest-998218628 None] Acquiring lock "cinder-quobyte-aab28781-ccaa-4125-9104-c4acd286e668" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:49 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-30aaa476-2b3d-4dcb-93db-1f90d7e68c2d tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "cinder-quobyte-aab28781-ccaa-4125-9104-c4acd286e668" acquired by "delete_volume" :: waited 0.017s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:49 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[575b04b5-4b84-4224-9f18-ba940082076c]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:03:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-30aaa476-2b3d-4dcb-93db-1f90d7e68c2d tempest-CreateVolumesFromSnapshotTest-998218628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-aab28781-ccaa-4125-9104-c4acd286e668 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:49 devstack sudo[108148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25b7a7cf-c261-460b-8861-ffafca7d0784
Nov 06 12:03:49 devstack sudo[108148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:49 devstack sudo[108149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-aab28781-ccaa-4125-9104-c4acd286e668
Nov 06 12:03:49 devstack sudo[108149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:49 devstack sudo[108146]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9959d585-09cc-4b4a-998e-7116d50e6e54 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4b8c6773-5b7a-49fe-bb09-d3cb117e5fc0" returned: 0 in 0.393s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9959d585-09cc-4b4a-998e-7116d50e6e54 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4b8c6773-5b7a-49fe-bb09-d3cb117e5fc0 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:49 devstack sudo[108155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4b8c6773-5b7a-49fe-bb09-d3cb117e5fc0
Nov 06 12:03:49 devstack sudo[108155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:49 devstack sudo[108148]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-081c2c4c-dd96-4a1b-94b6-4dd4b3f6e8a7 tempest-ProjectReaderTests-1672117553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25b7a7cf-c261-460b-8861-ffafca7d0784" returned: 0 in 0.391s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-081c2c4c-dd96-4a1b-94b6-4dd4b3f6e8a7 tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25b7a7cf-c261-460b-8861-ffafca7d0784,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25b7a7cf-c261-460b-8861-ffafca7d0784.d970a9bb-51ea-4454-9b1e-bc2f9441f24d 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:49 devstack sudo[108161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25b7a7cf-c261-460b-8861-ffafca7d0784,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25b7a7cf-c261-460b-8861-ffafca7d0784.d970a9bb-51ea-4454-9b1e-bc2f9441f24d 1G
Nov 06 12:03:49 devstack sudo[108161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:50 devstack sudo[108149]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-30aaa476-2b3d-4dcb-93db-1f90d7e68c2d tempest-CreateVolumesFromSnapshotTest-998218628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-aab28781-ccaa-4125-9104-c4acd286e668" returned: 0 in 0.394s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-30aaa476-2b3d-4dcb-93db-1f90d7e68c2d tempest-CreateVolumesFromSnapshotTest-998218628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-aab28781-ccaa-4125-9104-c4acd286e668 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:50 devstack sudo[108167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-aab28781-ccaa-4125-9104-c4acd286e668
Nov 06 12:03:50 devstack sudo[108167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:50 devstack sudo[108155]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9959d585-09cc-4b4a-998e-7116d50e6e54 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-4b8c6773-5b7a-49fe-bb09-d3cb117e5fc0" returned: 0 in 0.293s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:50 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-9959d585-09cc-4b4a-998e-7116d50e6e54 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "cinder-quobyte-4b8c6773-5b7a-49fe-bb09-d3cb117e5fc0" released by "delete_volume" :: held 0.737s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:50 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-9959d585-09cc-4b4a-998e-7116d50e6e54 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Created reservations ['c6d0db89-7186-4109-9b5d-e9ee5a0bfd81', 'e20b96d9-ed29-44f7-8b39-47679544fd79', '07507ea4-acc6-4a84-9d23-4a1f9f69c541', '9aad19f8-91f0-4c6d-91c6-c234789770ea'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:03:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9959d585-09cc-4b4a-998e-7116d50e6e54 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9959d585-09cc-4b4a-998e-7116d50e6e54 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:50 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-9959d585-09cc-4b4a-998e-7116d50e6e54 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:50 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-9959d585-09cc-4b4a-998e-7116d50e6e54 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9959d585-09cc-4b4a-998e-7116d50e6e54 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9959d585-09cc-4b4a-998e-7116d50e6e54 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:50 devstack sudo[108172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:03:50 devstack sudo[108172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:50 devstack sudo[108167]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-30aaa476-2b3d-4dcb-93db-1f90d7e68c2d tempest-CreateVolumesFromSnapshotTest-998218628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-aab28781-ccaa-4125-9104-c4acd286e668" returned: 0 in 0.303s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:50 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-30aaa476-2b3d-4dcb-93db-1f90d7e68c2d tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "cinder-quobyte-aab28781-ccaa-4125-9104-c4acd286e668" released by "delete_volume" :: held 0.749s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:50 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-30aaa476-2b3d-4dcb-93db-1f90d7e68c2d tempest-CreateVolumesFromSnapshotTest-998218628 None] Created reservations ['6021a19c-a33b-4fb9-8398-c1e4657f8f59', '26847d26-5ff9-43ff-8b1a-2c1c70d0b212', '87baad9f-ca91-4c40-b956-04e595044baa', 'cc2399a4-24b9-4791-abae-d191a7445c49'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:03:50 devstack sudo[108161]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-081c2c4c-dd96-4a1b-94b6-4dd4b3f6e8a7 tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25b7a7cf-c261-460b-8861-ffafca7d0784,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25b7a7cf-c261-460b-8861-ffafca7d0784.d970a9bb-51ea-4454-9b1e-bc2f9441f24d 1G" returned: 0 in 0.502s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-081c2c4c-dd96-4a1b-94b6-4dd4b3f6e8a7 tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25b7a7cf-c261-460b-8861-ffafca7d0784 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25b7a7cf-c261-460b-8861-ffafca7d0784.d970a9bb-51ea-4454-9b1e-bc2f9441f24d {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:50 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-2ff27f8c-2b33-4c77-aec5-89b1ac07b514 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Acquiring lock "cinder-35c3b300-a218-4dd2-ba8e-14b24bf88b5d-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:50 devstack sudo[108175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25b7a7cf-c261-460b-8861-ffafca7d0784 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25b7a7cf-c261-460b-8861-ffafca7d0784.d970a9bb-51ea-4454-9b1e-bc2f9441f24d
Nov 06 12:03:50 devstack sudo[108175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:50 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-2ff27f8c-2b33-4c77-aec5-89b1ac07b514 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "cinder-35c3b300-a218-4dd2-ba8e-14b24bf88b5d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:50 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-2ff27f8c-2b33-4c77-aec5-89b1ac07b514 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Acquiring lock "cinder-quobyte-35c3b300-a218-4dd2-ba8e-14b24bf88b5d" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-30aaa476-2b3d-4dcb-93db-1f90d7e68c2d tempest-CreateVolumesFromSnapshotTest-998218628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-30aaa476-2b3d-4dcb-93db-1f90d7e68c2d tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:50 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-30aaa476-2b3d-4dcb-93db-1f90d7e68c2d tempest-CreateVolumesFromSnapshotTest-998218628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:50 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-30aaa476-2b3d-4dcb-93db-1f90d7e68c2d tempest-CreateVolumesFromSnapshotTest-998218628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-30aaa476-2b3d-4dcb-93db-1f90d7e68c2d tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-30aaa476-2b3d-4dcb-93db-1f90d7e68c2d tempest-CreateVolumesFromSnapshotTest-998218628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:50 devstack sudo[108172]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:50 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-2ff27f8c-2b33-4c77-aec5-89b1ac07b514 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "cinder-quobyte-35c3b300-a218-4dd2-ba8e-14b24bf88b5d" acquired by "delete_volume" :: waited 0.050s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:50 devstack sudo[108178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:03:50 devstack sudo[108178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9959d585-09cc-4b4a-998e-7116d50e6e54 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.341s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:50 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-9959d585-09cc-4b4a-998e-7116d50e6e54 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:03:50 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-9959d585-09cc-4b4a-998e-7116d50e6e54 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Deleted volume successfully.
Nov 06 12:03:50 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e300a124-22d5-4872-bd2f-daaf6a66a842]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:03:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2ff27f8c-2b33-4c77-aec5-89b1ac07b514 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35c3b300-a218-4dd2-ba8e-14b24bf88b5d {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:50 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-9959d585-09cc-4b4a-998e-7116d50e6e54 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "cinder-4b8c6773-5b7a-49fe-bb09-d3cb117e5fc0-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:50 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-22d428da-7546-4387-aef3-fdb0b914a0a1 tempest-CreateVolumesFromSnapshotTest-998218628 None] Acquiring lock "cinder-970c1f71-7258-487b-a300-d9a4262915c0-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:50 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-22d428da-7546-4387-aef3-fdb0b914a0a1 tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "cinder-970c1f71-7258-487b-a300-d9a4262915c0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:50 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-22d428da-7546-4387-aef3-fdb0b914a0a1 tempest-CreateVolumesFromSnapshotTest-998218628 None] Acquiring lock "cinder-quobyte-970c1f71-7258-487b-a300-d9a4262915c0" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:50 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-22d428da-7546-4387-aef3-fdb0b914a0a1 tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "cinder-quobyte-970c1f71-7258-487b-a300-d9a4262915c0" acquired by "delete_volume" :: waited 0.016s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:50 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db91c9d-9fa6-4e5f-9f64-7368d1f8628f]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:03:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-22d428da-7546-4387-aef3-fdb0b914a0a1 tempest-CreateVolumesFromSnapshotTest-998218628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-970c1f71-7258-487b-a300-d9a4262915c0 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:50 devstack sudo[108180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35c3b300-a218-4dd2-ba8e-14b24bf88b5d
Nov 06 12:03:50 devstack sudo[108180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:50 devstack sudo[108175]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-081c2c4c-dd96-4a1b-94b6-4dd4b3f6e8a7 tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25b7a7cf-c261-460b-8861-ffafca7d0784 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25b7a7cf-c261-460b-8861-ffafca7d0784.d970a9bb-51ea-4454-9b1e-bc2f9441f24d" returned: 0 in 0.423s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:50 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-081c2c4c-dd96-4a1b-94b6-4dd4b3f6e8a7 tempest-ProjectReaderTests-1672117553 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25b7a7cf-c261-460b-8861-ffafca7d0784.d970a9bb-51ea-4454-9b1e-bc2f9441f24d is being set with open permissions: ugo+rw
Nov 06 12:03:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-081c2c4c-dd96-4a1b-94b6-4dd4b3f6e8a7 tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25b7a7cf-c261-460b-8861-ffafca7d0784.d970a9bb-51ea-4454-9b1e-bc2f9441f24d {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:50 devstack sudo[108188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25b7a7cf-c261-460b-8861-ffafca7d0784.d970a9bb-51ea-4454-9b1e-bc2f9441f24d
Nov 06 12:03:50 devstack sudo[108188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:50 devstack sudo[108178]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:50 devstack sudo[108185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-970c1f71-7258-487b-a300-d9a4262915c0
Nov 06 12:03:50 devstack sudo[108185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-30aaa476-2b3d-4dcb-93db-1f90d7e68c2d tempest-CreateVolumesFromSnapshotTest-998218628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.340s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:50 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-30aaa476-2b3d-4dcb-93db-1f90d7e68c2d tempest-CreateVolumesFromSnapshotTest-998218628 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:03:50 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-30aaa476-2b3d-4dcb-93db-1f90d7e68c2d tempest-CreateVolumesFromSnapshotTest-998218628 None] Deleted volume successfully.
Nov 06 12:03:50 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-30aaa476-2b3d-4dcb-93db-1f90d7e68c2d tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "cinder-aab28781-ccaa-4125-9104-c4acd286e668-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:51 devstack sudo[108180]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2ff27f8c-2b33-4c77-aec5-89b1ac07b514 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35c3b300-a218-4dd2-ba8e-14b24bf88b5d" returned: 0 in 0.476s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2ff27f8c-2b33-4c77-aec5-89b1ac07b514 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35c3b300-a218-4dd2-ba8e-14b24bf88b5d {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:51 devstack sudo[108194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35c3b300-a218-4dd2-ba8e-14b24bf88b5d
Nov 06 12:03:51 devstack sudo[108194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:51 devstack sudo[108188]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-081c2c4c-dd96-4a1b-94b6-4dd4b3f6e8a7 tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25b7a7cf-c261-460b-8861-ffafca7d0784.d970a9bb-51ea-4454-9b1e-bc2f9441f24d" returned: 0 in 0.311s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:51 devstack sudo[108185]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-22d428da-7546-4387-aef3-fdb0b914a0a1 tempest-CreateVolumesFromSnapshotTest-998218628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-970c1f71-7258-487b-a300-d9a4262915c0" returned: 0 in 0.412s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-22d428da-7546-4387-aef3-fdb0b914a0a1 tempest-CreateVolumesFromSnapshotTest-998218628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-970c1f71-7258-487b-a300-d9a4262915c0 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-081c2c4c-dd96-4a1b-94b6-4dd4b3f6e8a7 tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25b7a7cf-c261-460b-8861-ffafca7d0784.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:51 devstack sudo[108200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-970c1f71-7258-487b-a300-d9a4262915c0
Nov 06 12:03:51 devstack sudo[108200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:51 devstack sudo[108201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25b7a7cf-c261-460b-8861-ffafca7d0784.info
Nov 06 12:03:51 devstack sudo[108201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:51 devstack sudo[108194]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2ff27f8c-2b33-4c77-aec5-89b1ac07b514 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35c3b300-a218-4dd2-ba8e-14b24bf88b5d" returned: 0 in 0.264s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:51 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-2ff27f8c-2b33-4c77-aec5-89b1ac07b514 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "cinder-quobyte-35c3b300-a218-4dd2-ba8e-14b24bf88b5d" released by "delete_volume" :: held 0.799s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:51 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-2ff27f8c-2b33-4c77-aec5-89b1ac07b514 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Created reservations ['ae7e9828-63b7-4c30-9a8e-3e4a079a604e', '5642b81e-63da-4da6-b821-73cc031e00bd', 'dbe2a460-493c-4c0c-9335-b5752e296f5f', '1600290c-87c3-495b-bc93-dadebe030ed8'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:03:51 devstack sudo[108201]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:51 devstack sudo[108200]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-081c2c4c-dd96-4a1b-94b6-4dd4b3f6e8a7 tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25b7a7cf-c261-460b-8861-ffafca7d0784.info" returned: 0 in 0.267s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:51 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-081c2c4c-dd96-4a1b-94b6-4dd4b3f6e8a7 tempest-ProjectReaderTests-1672117553 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25b7a7cf-c261-460b-8861-ffafca7d0784.info is being set with open permissions: ugo+rw
Nov 06 12:03:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-081c2c4c-dd96-4a1b-94b6-4dd4b3f6e8a7 tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25b7a7cf-c261-460b-8861-ffafca7d0784.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-22d428da-7546-4387-aef3-fdb0b914a0a1 tempest-CreateVolumesFromSnapshotTest-998218628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-970c1f71-7258-487b-a300-d9a4262915c0" returned: 0 in 0.301s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:51 devstack sudo[108207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25b7a7cf-c261-460b-8861-ffafca7d0784.info
Nov 06 12:03:51 devstack sudo[108207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:51 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-22d428da-7546-4387-aef3-fdb0b914a0a1 tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "cinder-quobyte-970c1f71-7258-487b-a300-d9a4262915c0" released by "delete_volume" :: held 0.765s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-2ff27f8c-2b33-4c77-aec5-89b1ac07b514 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-2ff27f8c-2b33-4c77-aec5-89b1ac07b514 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:51 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-2ff27f8c-2b33-4c77-aec5-89b1ac07b514 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:51 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-2ff27f8c-2b33-4c77-aec5-89b1ac07b514 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-2ff27f8c-2b33-4c77-aec5-89b1ac07b514 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2ff27f8c-2b33-4c77-aec5-89b1ac07b514 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:51 devstack sudo[108209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:03:51 devstack sudo[108209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:51 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-22d428da-7546-4387-aef3-fdb0b914a0a1 tempest-CreateVolumesFromSnapshotTest-998218628 None] Created reservations ['4b03b505-f5b9-4665-a8b1-b86954b1037f', '55225f54-a787-455b-929a-4d6c5914b5e3', 'b6b99372-119a-43ec-b095-a9af0a04f228', '1b343478-da4f-4fa0-bdb4-582c59e50ef8'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:03:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-22d428da-7546-4387-aef3-fdb0b914a0a1 tempest-CreateVolumesFromSnapshotTest-998218628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-22d428da-7546-4387-aef3-fdb0b914a0a1 tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:51 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-22d428da-7546-4387-aef3-fdb0b914a0a1 tempest-CreateVolumesFromSnapshotTest-998218628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:51 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-22d428da-7546-4387-aef3-fdb0b914a0a1 tempest-CreateVolumesFromSnapshotTest-998218628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-22d428da-7546-4387-aef3-fdb0b914a0a1 tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-22d428da-7546-4387-aef3-fdb0b914a0a1 tempest-CreateVolumesFromSnapshotTest-998218628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:51 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-66dfb30f-bd24-496f-91b2-17a7de92480e tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Acquiring lock "cinder-64186387-a895-4ffd-a6cb-d6daf1b74cf9-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:51 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-66dfb30f-bd24-496f-91b2-17a7de92480e tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "cinder-64186387-a895-4ffd-a6cb-d6daf1b74cf9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:51 devstack sudo[108211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:03:51 devstack sudo[108211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:51 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-66dfb30f-bd24-496f-91b2-17a7de92480e tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Acquiring lock "cinder-quobyte-64186387-a895-4ffd-a6cb-d6daf1b74cf9" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:51 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-66dfb30f-bd24-496f-91b2-17a7de92480e tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "cinder-quobyte-64186387-a895-4ffd-a6cb-d6daf1b74cf9" acquired by "delete_volume" :: waited 0.028s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:51 devstack sudo[108209]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:51 devstack sudo[108207]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:51 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a383dd50-a2ec-41c1-b458-24f888ba6c54 tempest-CreateVolumesFromSnapshotTest-998218628 None] Acquiring lock "cinder-fecb6ef2-3bb3-4d41-b986-fc40834b3753-delete_snapshot" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-081c2c4c-dd96-4a1b-94b6-4dd4b3f6e8a7 tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25b7a7cf-c261-460b-8861-ffafca7d0784.info" returned: 0 in 0.404s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2ff27f8c-2b33-4c77-aec5-89b1ac07b514 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.350s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-081c2c4c-dd96-4a1b-94b6-4dd4b3f6e8a7 tempest-ProjectReaderTests-1672117553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.498s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:51 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-2ff27f8c-2b33-4c77-aec5-89b1ac07b514 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:03:51 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbcad65-8e2a-4355-92cd-d96c89d2c897]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:03:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e3a35ade-65d4-4da8-a766-f1410da6952a tempest-ProjectReaderTests-1552493067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.390s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:51 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-e3a35ade-65d4-4da8-a766-f1410da6952a tempest-ProjectReaderTests-1552493067 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2028611516',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeba08f7-e190-4234-86e3-e29eea6d6bef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81ff2452065c4d4aa8f435415e360d34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:49Z,use_quota=True,user_id='1765484364934062a96eaf46228bca63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:03:51 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-e3a35ade-65d4-4da8-a766-f1410da6952a tempest-ProjectReaderTests-1552493067 None] Creating volume aeba08f7-e190-4234-86e3-e29eea6d6bef {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:03:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e3a35ade-65d4-4da8-a766-f1410da6952a tempest-ProjectReaderTests-1552493067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e3a35ade-65d4-4da8-a766-f1410da6952a tempest-ProjectReaderTests-1552493067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:51 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-e3a35ade-65d4-4da8-a766-f1410da6952a tempest-ProjectReaderTests-1552493067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:51 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-e3a35ade-65d4-4da8-a766-f1410da6952a tempest-ProjectReaderTests-1552493067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e3a35ade-65d4-4da8-a766-f1410da6952a tempest-ProjectReaderTests-1552493067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:51 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-e3a35ade-65d4-4da8-a766-f1410da6952a tempest-ProjectReaderTests-1552493067 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:03:51 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-e3a35ade-65d4-4da8-a766-f1410da6952a tempest-ProjectReaderTests-1552493067 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:03:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e3a35ade-65d4-4da8-a766-f1410da6952a tempest-ProjectReaderTests-1552493067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-aeba08f7-e190-4234-86e3-e29eea6d6bef 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:51 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-66dfb30f-bd24-496f-91b2-17a7de92480e tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-64186387-a895-4ffd-a6cb-d6daf1b74cf9 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:51 devstack sudo[108215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-aeba08f7-e190-4234-86e3-e29eea6d6bef 1073741824
Nov 06 12:03:51 devstack sudo[108215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:51 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-2ff27f8c-2b33-4c77-aec5-89b1ac07b514 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Deleted volume successfully.
Nov 06 12:03:51 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a383dd50-a2ec-41c1-b458-24f888ba6c54 tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "cinder-fecb6ef2-3bb3-4d41-b986-fc40834b3753-delete_snapshot" acquired by "delete_snapshot" :: waited 0.117s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:51 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a383dd50-a2ec-41c1-b458-24f888ba6c54 tempest-CreateVolumesFromSnapshotTest-998218628 None] Acquiring lock "cinder-quobyte-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:52 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-2ff27f8c-2b33-4c77-aec5-89b1ac07b514 tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "cinder-35c3b300-a218-4dd2-ba8e-14b24bf88b5d-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:52 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-081c2c4c-dd96-4a1b-94b6-4dd4b3f6e8a7 tempest-ProjectReaderTests-1672117553 None] Create snapshot completed successfully
Nov 06 12:03:52 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a383dd50-a2ec-41c1-b458-24f888ba6c54 tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "cinder-quobyte-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:52 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a383dd50-a2ec-41c1-b458-24f888ba6c54 tempest-CreateVolumesFromSnapshotTest-998218628 None] Acquiring lock "cinder-quobyte-fecb6ef2-3bb3-4d41-b986-fc40834b3753" by "_delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:52 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a383dd50-a2ec-41c1-b458-24f888ba6c54 tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "cinder-quobyte-fecb6ef2-3bb3-4d41-b986-fc40834b3753" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:52 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-a383dd50-a2ec-41c1-b458-24f888ba6c54 tempest-CreateVolumesFromSnapshotTest-998218628 None] Deleting offline snapshot fecb6ef2-3bb3-4d41-b986-fc40834b3753 of volume 3b500dc8-e60a-4c01-a3cc-d9c4de537d4f {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 12:03:52 devstack sudo[108211]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:52 devstack sudo[108216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-64186387-a895-4ffd-a6cb-d6daf1b74cf9
Nov 06 12:03:52 devstack sudo[108216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:52 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-a383dd50-a2ec-41c1-b458-24f888ba6c54 tempest-CreateVolumesFromSnapshotTest-998218628 None] snapshot_file for this snap is: volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f.fecb6ef2-3bb3-4d41-b986-fc40834b3753 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 12:03:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-22d428da-7546-4387-aef3-fdb0b914a0a1 tempest-CreateVolumesFromSnapshotTest-998218628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.397s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:52 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-22d428da-7546-4387-aef3-fdb0b914a0a1 tempest-CreateVolumesFromSnapshotTest-998218628 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:03:52 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-22d428da-7546-4387-aef3-fdb0b914a0a1 tempest-CreateVolumesFromSnapshotTest-998218628 None] Deleted volume successfully.
Nov 06 12:03:52 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fe5f59-e5c4-45ad-9612-1f27bb6d99d8]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:03:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a383dd50-a2ec-41c1-b458-24f888ba6c54 tempest-CreateVolumesFromSnapshotTest-998218628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f.fecb6ef2-3bb3-4d41-b986-fc40834b3753 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:52 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-22d428da-7546-4387-aef3-fdb0b914a0a1 tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "cinder-970c1f71-7258-487b-a300-d9a4262915c0-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:52 devstack sudo[108220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f.fecb6ef2-3bb3-4d41-b986-fc40834b3753
Nov 06 12:03:52 devstack sudo[108220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:52 devstack sudo[108216]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-66dfb30f-bd24-496f-91b2-17a7de92480e tempest-CreateVolumesFromSourceVolumeTest-889966002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-64186387-a895-4ffd-a6cb-d6daf1b74cf9" returned: 0 in 0.513s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-66dfb30f-bd24-496f-91b2-17a7de92480e tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-64186387-a895-4ffd-a6cb-d6daf1b74cf9 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:52 devstack sudo[108229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-64186387-a895-4ffd-a6cb-d6daf1b74cf9
Nov 06 12:03:52 devstack sudo[108229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:52 devstack sudo[108215]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e3a35ade-65d4-4da8-a766-f1410da6952a tempest-ProjectReaderTests-1552493067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-aeba08f7-e190-4234-86e3-e29eea6d6bef 1073741824" returned: 0 in 0.620s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e3a35ade-65d4-4da8-a766-f1410da6952a tempest-ProjectReaderTests-1552493067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-aeba08f7-e190-4234-86e3-e29eea6d6bef {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:52 devstack sudo[108220]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:52 devstack sudo[108234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-aeba08f7-e190-4234-86e3-e29eea6d6bef
Nov 06 12:03:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a383dd50-a2ec-41c1-b458-24f888ba6c54 tempest-CreateVolumesFromSnapshotTest-998218628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f.fecb6ef2-3bb3-4d41-b986-fc40834b3753" returned: 0 in 0.517s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:52 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-a383dd50-a2ec-41c1-b458-24f888ba6c54 tempest-CreateVolumesFromSnapshotTest-998218628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 12:03:52 devstack sudo[108234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:52 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ee2cdac2-691b-4015-a06a-21605f4dcff6 tempest-ProjectReaderTests-1672117553 None] Acquiring lock "cinder-d970a9bb-51ea-4454-9b1e-bc2f9441f24d-delete_snapshot" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:52 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4caeb6-fb24-480c-bbc5-e7ca45d238e1]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:03:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a383dd50-a2ec-41c1-b458-24f888ba6c54 tempest-CreateVolumesFromSnapshotTest-998218628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:52 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ee2cdac2-691b-4015-a06a-21605f4dcff6 tempest-ProjectReaderTests-1672117553 None] Lock "cinder-d970a9bb-51ea-4454-9b1e-bc2f9441f24d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:52 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ee2cdac2-691b-4015-a06a-21605f4dcff6 tempest-ProjectReaderTests-1672117553 None] Acquiring lock "cinder-quobyte-25b7a7cf-c261-460b-8861-ffafca7d0784" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:52 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ee2cdac2-691b-4015-a06a-21605f4dcff6 tempest-ProjectReaderTests-1672117553 None] Lock "cinder-quobyte-25b7a7cf-c261-460b-8861-ffafca7d0784" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:52 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ee2cdac2-691b-4015-a06a-21605f4dcff6 tempest-ProjectReaderTests-1672117553 None] Acquiring lock "cinder-quobyte-d970a9bb-51ea-4454-9b1e-bc2f9441f24d" by "_delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:52 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ee2cdac2-691b-4015-a06a-21605f4dcff6 tempest-ProjectReaderTests-1672117553 None] Lock "cinder-quobyte-d970a9bb-51ea-4454-9b1e-bc2f9441f24d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:52 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-ee2cdac2-691b-4015-a06a-21605f4dcff6 tempest-ProjectReaderTests-1672117553 None] Deleting offline snapshot d970a9bb-51ea-4454-9b1e-bc2f9441f24d of volume 25b7a7cf-c261-460b-8861-ffafca7d0784 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 12:03:52 devstack sudo[108229]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:52 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-ee2cdac2-691b-4015-a06a-21605f4dcff6 tempest-ProjectReaderTests-1672117553 None] snapshot_file for this snap is: volume-25b7a7cf-c261-460b-8861-ffafca7d0784.d970a9bb-51ea-4454-9b1e-bc2f9441f24d {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 12:03:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-66dfb30f-bd24-496f-91b2-17a7de92480e tempest-CreateVolumesFromSourceVolumeTest-889966002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-64186387-a895-4ffd-a6cb-d6daf1b74cf9" returned: 0 in 0.352s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:52 devstack sudo[108236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f
Nov 06 12:03:52 devstack sudo[108236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:52 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-66dfb30f-bd24-496f-91b2-17a7de92480e tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "cinder-quobyte-64186387-a895-4ffd-a6cb-d6daf1b74cf9" released by "delete_volume" :: held 0.983s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:52 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed28750b-eda0-4282-a7aa-34017ae638e8]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:03:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ee2cdac2-691b-4015-a06a-21605f4dcff6 tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25b7a7cf-c261-460b-8861-ffafca7d0784.d970a9bb-51ea-4454-9b1e-bc2f9441f24d {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:52 devstack sudo[108234]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e3a35ade-65d4-4da8-a766-f1410da6952a tempest-ProjectReaderTests-1552493067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-aeba08f7-e190-4234-86e3-e29eea6d6bef" returned: 0 in 0.300s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:52 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-e3a35ade-65d4-4da8-a766-f1410da6952a tempest-ProjectReaderTests-1552493067 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:03:52 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e3a35ade-65d4-4da8-a766-f1410da6952a tempest-ProjectReaderTests-1552493067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:52 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-66dfb30f-bd24-496f-91b2-17a7de92480e tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Created reservations ['69ca015a-e36e-4a2b-a64e-430343a10caa', '712a0010-9d2b-4e32-bb3a-0fb31763095b', '344c0bec-77c9-4f0b-85ae-c3a505bbe638', '88beb1e6-f948-42da-8832-b56f173bdd6f'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:03:52 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e3a35ade-65d4-4da8-a766-f1410da6952a tempest-ProjectReaderTests-1552493067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c621f465-19aa-4efc-86f0-abec25c9cbc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aeba08f7-e190-4234-86e3-e29eea6d6bef', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:52 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e3a35ade-65d4-4da8-a766-f1410da6952a tempest-ProjectReaderTests-1552493067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12b84112-9f07-472a-b699-110f5b17d4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:52 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-e3a35ade-65d4-4da8-a766-f1410da6952a tempest-ProjectReaderTests-1552493067 None] Volume volume-aeba08f7-e190-4234-86e3-e29eea6d6bef (aeba08f7-e190-4234-86e3-e29eea6d6bef): created successfully
Nov 06 12:03:52 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e3a35ade-65d4-4da8-a766-f1410da6952a tempest-ProjectReaderTests-1552493067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12b84112-9f07-472a-b699-110f5b17d4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:52 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e3a35ade-65d4-4da8-a766-f1410da6952a tempest-ProjectReaderTests-1552493067 None] Flow 'volume_create_manager' (f4de437b-72db-493d-ac25-c20b4e92da63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:03:52 devstack sudo[108239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25b7a7cf-c261-460b-8861-ffafca7d0784.d970a9bb-51ea-4454-9b1e-bc2f9441f24d
Nov 06 12:03:52 devstack sudo[108239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:52 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-e3a35ade-65d4-4da8-a766-f1410da6952a tempest-ProjectReaderTests-1552493067 None] Created volume successfully.
Nov 06 12:03:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-66dfb30f-bd24-496f-91b2-17a7de92480e tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-66dfb30f-bd24-496f-91b2-17a7de92480e tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:53 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-66dfb30f-bd24-496f-91b2-17a7de92480e tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:53 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-66dfb30f-bd24-496f-91b2-17a7de92480e tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-66dfb30f-bd24-496f-91b2-17a7de92480e tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-66dfb30f-bd24-496f-91b2-17a7de92480e tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:53 devstack sudo[108243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:03:53 devstack sudo[108243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:53 devstack sudo[108236]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a383dd50-a2ec-41c1-b458-24f888ba6c54 tempest-CreateVolumesFromSnapshotTest-998218628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f" returned: 0 in 0.429s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a383dd50-a2ec-41c1-b458-24f888ba6c54 tempest-CreateVolumesFromSnapshotTest-998218628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f.fecb6ef2-3bb3-4d41-b986-fc40834b3753 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:53 devstack sudo[108247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f.fecb6ef2-3bb3-4d41-b986-fc40834b3753
Nov 06 12:03:53 devstack sudo[108247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:53 devstack sudo[108239]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ee2cdac2-691b-4015-a06a-21605f4dcff6 tempest-ProjectReaderTests-1672117553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25b7a7cf-c261-460b-8861-ffafca7d0784.d970a9bb-51ea-4454-9b1e-bc2f9441f24d" returned: 0 in 0.425s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:53 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-ee2cdac2-691b-4015-a06a-21605f4dcff6 tempest-ProjectReaderTests-1672117553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25b7a7cf-c261-460b-8861-ffafca7d0784(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 12:03:53 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[98655e07-93e2-4fbe-a75e-c847d0bfcbe1]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:03:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ee2cdac2-691b-4015-a06a-21605f4dcff6 tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25b7a7cf-c261-460b-8861-ffafca7d0784 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:53 devstack sudo[108243]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-66dfb30f-bd24-496f-91b2-17a7de92480e tempest-CreateVolumesFromSourceVolumeTest-889966002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.270s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:53 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-66dfb30f-bd24-496f-91b2-17a7de92480e tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:03:53 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-66dfb30f-bd24-496f-91b2-17a7de92480e tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Deleted volume successfully.
Nov 06 12:03:53 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-66dfb30f-bd24-496f-91b2-17a7de92480e tempest-CreateVolumesFromSourceVolumeTest-889966002 None] Lock "cinder-64186387-a895-4ffd-a6cb-d6daf1b74cf9-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:53 devstack sudo[108253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25b7a7cf-c261-460b-8861-ffafca7d0784
Nov 06 12:03:53 devstack sudo[108253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:53 devstack sudo[108247]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a383dd50-a2ec-41c1-b458-24f888ba6c54 tempest-CreateVolumesFromSnapshotTest-998218628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f.fecb6ef2-3bb3-4d41-b986-fc40834b3753" returned: 0 in 0.336s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a383dd50-a2ec-41c1-b458-24f888ba6c54 tempest-CreateVolumesFromSnapshotTest-998218628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f.fecb6ef2-3bb3-4d41-b986-fc40834b3753 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:53 devstack sudo[108258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f.fecb6ef2-3bb3-4d41-b986-fc40834b3753
Nov 06 12:03:53 devstack sudo[108258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:53 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d2330906-2a98-4711-b405-85c2cd5c7175 tempest-ProjectReaderTests-1552493067 None] Acquiring lock "cinder-aeba08f7-e190-4234-86e3-e29eea6d6bef-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:53 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d2330906-2a98-4711-b405-85c2cd5c7175 tempest-ProjectReaderTests-1552493067 None] Lock "cinder-aeba08f7-e190-4234-86e3-e29eea6d6bef-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:53 devstack sudo[108253]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:53 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d2330906-2a98-4711-b405-85c2cd5c7175 tempest-ProjectReaderTests-1552493067 None] Acquiring lock "cinder-quobyte-aeba08f7-e190-4234-86e3-e29eea6d6bef" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ee2cdac2-691b-4015-a06a-21605f4dcff6 tempest-ProjectReaderTests-1672117553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25b7a7cf-c261-460b-8861-ffafca7d0784" returned: 0 in 0.436s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ee2cdac2-691b-4015-a06a-21605f4dcff6 tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25b7a7cf-c261-460b-8861-ffafca7d0784.d970a9bb-51ea-4454-9b1e-bc2f9441f24d {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:53 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d2330906-2a98-4711-b405-85c2cd5c7175 tempest-ProjectReaderTests-1552493067 None] Lock "cinder-quobyte-aeba08f7-e190-4234-86e3-e29eea6d6bef" acquired by "delete_volume" :: waited 0.030s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:53 devstack sudo[108264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25b7a7cf-c261-460b-8861-ffafca7d0784.d970a9bb-51ea-4454-9b1e-bc2f9441f24d
Nov 06 12:03:53 devstack sudo[108264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:53 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[768b6caa-0a40-47b5-b910-4ce0d3ca1df0]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:03:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d2330906-2a98-4711-b405-85c2cd5c7175 tempest-ProjectReaderTests-1552493067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-aeba08f7-e190-4234-86e3-e29eea6d6bef {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:53 devstack sudo[108258]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a383dd50-a2ec-41c1-b458-24f888ba6c54 tempest-CreateVolumesFromSnapshotTest-998218628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f.fecb6ef2-3bb3-4d41-b986-fc40834b3753" returned: 0 in 0.330s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:53 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a383dd50-a2ec-41c1-b458-24f888ba6c54 tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "cinder-quobyte-fecb6ef2-3bb3-4d41-b986-fc40834b3753" released by "_delete_snapshot" :: held 1.778s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:53 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a383dd50-a2ec-41c1-b458-24f888ba6c54 tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "cinder-quobyte-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f" released by "delete_snapshot" :: held 1.815s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:53 devstack sudo[108267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-aeba08f7-e190-4234-86e3-e29eea6d6bef
Nov 06 12:03:53 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:53 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-a383dd50-a2ec-41c1-b458-24f888ba6c54 tempest-CreateVolumesFromSnapshotTest-998218628 None] Created reservations ['806f06c3-57f2-436d-93ed-e231799064c6', '78621337-9d24-44a0-8fa8-1be6ba742c64', 'b31880f3-8c81-45cc-bd24-eec24d495080', 'b7a83861-fcaa-41f8-b70c-f836a711a8a4'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:03:54 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-a383dd50-a2ec-41c1-b458-24f888ba6c54 tempest-CreateVolumesFromSnapshotTest-998218628 None] Delete snapshot completed successfully.
Nov 06 12:03:54 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a383dd50-a2ec-41c1-b458-24f888ba6c54 tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "cinder-fecb6ef2-3bb3-4d41-b986-fc40834b3753-delete_snapshot" released by "delete_snapshot" :: held 2.057s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:54 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-7391e4b8-65b1-41ed-82f3-a001f130446c tempest-CreateVolumesFromSnapshotTest-998218628 None] Acquiring lock "cinder-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:54 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-7391e4b8-65b1-41ed-82f3-a001f130446c tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "cinder-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:54 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-7391e4b8-65b1-41ed-82f3-a001f130446c tempest-CreateVolumesFromSnapshotTest-998218628 None] Acquiring lock "cinder-quobyte-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:54 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-7391e4b8-65b1-41ed-82f3-a001f130446c tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "cinder-quobyte-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f" acquired by "delete_volume" :: waited 0.033s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:54 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:54 devstack sudo[108264]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ee2cdac2-691b-4015-a06a-21605f4dcff6 tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25b7a7cf-c261-460b-8861-ffafca7d0784.d970a9bb-51ea-4454-9b1e-bc2f9441f24d" returned: 0 in 0.585s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d2330906-2a98-4711-b405-85c2cd5c7175 tempest-ProjectReaderTests-1552493067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-aeba08f7-e190-4234-86e3-e29eea6d6bef" returned: 0 in 0.530s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ee2cdac2-691b-4015-a06a-21605f4dcff6 tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25b7a7cf-c261-460b-8861-ffafca7d0784.d970a9bb-51ea-4454-9b1e-bc2f9441f24d {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d2330906-2a98-4711-b405-85c2cd5c7175 tempest-ProjectReaderTests-1552493067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-aeba08f7-e190-4234-86e3-e29eea6d6bef {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:54 devstack sudo[108275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25b7a7cf-c261-460b-8861-ffafca7d0784.d970a9bb-51ea-4454-9b1e-bc2f9441f24d
Nov 06 12:03:54 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca5fbd8-02bf-4cda-b2dc-8343a9dfc456]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:03:54 devstack sudo[108275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7391e4b8-65b1-41ed-82f3-a001f130446c tempest-CreateVolumesFromSnapshotTest-998218628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:54 devstack sudo[108276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-aeba08f7-e190-4234-86e3-e29eea6d6bef
Nov 06 12:03:54 devstack sudo[108276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:54 devstack sudo[108278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f
Nov 06 12:03:54 devstack sudo[108278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:54 devstack sudo[108275]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ee2cdac2-691b-4015-a06a-21605f4dcff6 tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25b7a7cf-c261-460b-8861-ffafca7d0784.d970a9bb-51ea-4454-9b1e-bc2f9441f24d" returned: 0 in 0.275s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:54 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ee2cdac2-691b-4015-a06a-21605f4dcff6 tempest-ProjectReaderTests-1672117553 None] Lock "cinder-quobyte-d970a9bb-51ea-4454-9b1e-bc2f9441f24d" released by "_delete_snapshot" :: held 1.866s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:54 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ee2cdac2-691b-4015-a06a-21605f4dcff6 tempest-ProjectReaderTests-1672117553 None] Lock "cinder-quobyte-25b7a7cf-c261-460b-8861-ffafca7d0784" released by "delete_snapshot" :: held 1.907s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:54 devstack sudo[108276]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d2330906-2a98-4711-b405-85c2cd5c7175 tempest-ProjectReaderTests-1552493067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-aeba08f7-e190-4234-86e3-e29eea6d6bef" returned: 0 in 0.340s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:54 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d2330906-2a98-4711-b405-85c2cd5c7175 tempest-ProjectReaderTests-1552493067 None] Lock "cinder-quobyte-aeba08f7-e190-4234-86e3-e29eea6d6bef" released by "delete_volume" :: held 0.955s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:54 devstack sudo[108278]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7391e4b8-65b1-41ed-82f3-a001f130446c tempest-CreateVolumesFromSnapshotTest-998218628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f" returned: 0 in 0.501s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7391e4b8-65b1-41ed-82f3-a001f130446c tempest-CreateVolumesFromSnapshotTest-998218628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:54 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-d2330906-2a98-4711-b405-85c2cd5c7175 tempest-ProjectReaderTests-1552493067 None] Created reservations ['6c41b9c5-f35b-4a95-8a1a-f8d6b2a313f2', '2253968c-26cc-4d51-8158-3d30a0001e2b', '8bdf32e7-b7af-4318-aba9-0eb1446d97a0', '6881d396-9c58-49ea-905e-ed5d5c420fdd'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:03:54 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-ee2cdac2-691b-4015-a06a-21605f4dcff6 tempest-ProjectReaderTests-1672117553 None] Created reservations ['249acf55-d8dc-414d-809d-33a621b6bc60', '4e52af7a-22fc-422d-a7be-fdb8a69447fc', '49970cd5-862e-48fa-a72a-55b7c8147161', 'dcd5c3e8-2f4e-4e9e-89d7-e99cdc6210bd'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:03:54 devstack sudo[108286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f
Nov 06 12:03:54 devstack sudo[108286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d2330906-2a98-4711-b405-85c2cd5c7175 tempest-ProjectReaderTests-1552493067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d2330906-2a98-4711-b405-85c2cd5c7175 tempest-ProjectReaderTests-1552493067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:54 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-d2330906-2a98-4711-b405-85c2cd5c7175 tempest-ProjectReaderTests-1552493067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:54 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-d2330906-2a98-4711-b405-85c2cd5c7175 tempest-ProjectReaderTests-1552493067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d2330906-2a98-4711-b405-85c2cd5c7175 tempest-ProjectReaderTests-1552493067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d2330906-2a98-4711-b405-85c2cd5c7175 tempest-ProjectReaderTests-1552493067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:54 devstack sudo[108289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:03:54 devstack sudo[108289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:55 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-ee2cdac2-691b-4015-a06a-21605f4dcff6 tempest-ProjectReaderTests-1672117553 None] Delete snapshot completed successfully.
Nov 06 12:03:55 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ee2cdac2-691b-4015-a06a-21605f4dcff6 tempest-ProjectReaderTests-1672117553 None] Lock "cinder-d970a9bb-51ea-4454-9b1e-bc2f9441f24d-delete_snapshot" released by "delete_snapshot" :: held 2.307s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:55 devstack sudo[108286]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7391e4b8-65b1-41ed-82f3-a001f130446c tempest-CreateVolumesFromSnapshotTest-998218628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f" returned: 0 in 0.279s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:55 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-7391e4b8-65b1-41ed-82f3-a001f130446c tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "cinder-quobyte-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f" released by "delete_volume" :: held 0.893s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:55 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-7391e4b8-65b1-41ed-82f3-a001f130446c tempest-CreateVolumesFromSnapshotTest-998218628 None] Created reservations ['52cf72ff-26b5-4571-8231-a9c4af975821', 'c68e40a9-72d1-4520-a0d8-6675cae2d852', '2a065b1f-9766-49a8-8102-a08e7258636d', '90b88942-3610-46c4-8e95-52a6d5466567'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:03:55 devstack sudo[108289]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d2330906-2a98-4711-b405-85c2cd5c7175 tempest-ProjectReaderTests-1552493067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.297s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:55 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-d2330906-2a98-4711-b405-85c2cd5c7175 tempest-ProjectReaderTests-1552493067 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:03:55 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-d2330906-2a98-4711-b405-85c2cd5c7175 tempest-ProjectReaderTests-1552493067 None] Deleted volume successfully.
Nov 06 12:03:55 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d2330906-2a98-4711-b405-85c2cd5c7175 tempest-ProjectReaderTests-1552493067 None] Lock "cinder-aeba08f7-e190-4234-86e3-e29eea6d6bef-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-7391e4b8-65b1-41ed-82f3-a001f130446c tempest-CreateVolumesFromSnapshotTest-998218628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-7391e4b8-65b1-41ed-82f3-a001f130446c tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:55 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-7391e4b8-65b1-41ed-82f3-a001f130446c tempest-CreateVolumesFromSnapshotTest-998218628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:55 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-7391e4b8-65b1-41ed-82f3-a001f130446c tempest-CreateVolumesFromSnapshotTest-998218628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-7391e4b8-65b1-41ed-82f3-a001f130446c tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7391e4b8-65b1-41ed-82f3-a001f130446c tempest-CreateVolumesFromSnapshotTest-998218628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:55 devstack sudo[108293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:03:55 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:55 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7391e4b8-65b1-41ed-82f3-a001f130446c tempest-CreateVolumesFromSnapshotTest-998218628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.287s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:55 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-7391e4b8-65b1-41ed-82f3-a001f130446c tempest-CreateVolumesFromSnapshotTest-998218628 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:03:55 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-7391e4b8-65b1-41ed-82f3-a001f130446c tempest-CreateVolumesFromSnapshotTest-998218628 None] Deleted volume successfully.
Nov 06 12:03:55 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-7391e4b8-65b1-41ed-82f3-a001f130446c tempest-CreateVolumesFromSnapshotTest-998218628 None] Lock "cinder-3b500dc8-e60a-4c01-a3cc-d9c4de537d4f-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:55 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-dc38d7fc-4f08-4a11-8bf8-9b47c81d77b8 tempest-ProjectReaderTests-1672117553 None] Acquiring lock "cinder-25b7a7cf-c261-460b-8861-ffafca7d0784-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:55 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-dc38d7fc-4f08-4a11-8bf8-9b47c81d77b8 tempest-ProjectReaderTests-1672117553 None] Lock "cinder-25b7a7cf-c261-460b-8861-ffafca7d0784-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:55 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-dc38d7fc-4f08-4a11-8bf8-9b47c81d77b8 tempest-ProjectReaderTests-1672117553 None] Acquiring lock "cinder-quobyte-25b7a7cf-c261-460b-8861-ffafca7d0784" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:03:55 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-dc38d7fc-4f08-4a11-8bf8-9b47c81d77b8 tempest-ProjectReaderTests-1672117553 None] Lock "cinder-quobyte-25b7a7cf-c261-460b-8861-ffafca7d0784" acquired by "delete_volume" :: waited 0.018s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:03:56 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc570ba4-f202-481e-97c7-74f989d35723]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:03:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-dc38d7fc-4f08-4a11-8bf8-9b47c81d77b8 tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25b7a7cf-c261-460b-8861-ffafca7d0784 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:56 devstack sudo[108296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25b7a7cf-c261-460b-8861-ffafca7d0784
Nov 06 12:03:56 devstack sudo[108296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:56 devstack sudo[108296]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-dc38d7fc-4f08-4a11-8bf8-9b47c81d77b8 tempest-ProjectReaderTests-1672117553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25b7a7cf-c261-460b-8861-ffafca7d0784" returned: 0 in 0.429s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-dc38d7fc-4f08-4a11-8bf8-9b47c81d77b8 tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25b7a7cf-c261-460b-8861-ffafca7d0784 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:56 devstack sudo[108301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25b7a7cf-c261-460b-8861-ffafca7d0784
Nov 06 12:03:56 devstack sudo[108301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:56 devstack sudo[108301]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-dc38d7fc-4f08-4a11-8bf8-9b47c81d77b8 tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25b7a7cf-c261-460b-8861-ffafca7d0784" returned: 0 in 0.325s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:56 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-dc38d7fc-4f08-4a11-8bf8-9b47c81d77b8 tempest-ProjectReaderTests-1672117553 None] Lock "cinder-quobyte-25b7a7cf-c261-460b-8861-ffafca7d0784" released by "delete_volume" :: held 0.831s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:56 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-dc38d7fc-4f08-4a11-8bf8-9b47c81d77b8 tempest-ProjectReaderTests-1672117553 None] Created reservations ['512ef670-a2ac-497c-b524-e26380d8ab3b', 'a29dcf8c-4a51-4f6b-a61d-e42655fdaf8b', 'c4ef3b54-4609-40d6-bac3-e989e2885cd1', 'bf1dee82-d60c-4d4f-bb3e-2e47e95af4af'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:03:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-dc38d7fc-4f08-4a11-8bf8-9b47c81d77b8 tempest-ProjectReaderTests-1672117553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-dc38d7fc-4f08-4a11-8bf8-9b47c81d77b8 tempest-ProjectReaderTests-1672117553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:56 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-dc38d7fc-4f08-4a11-8bf8-9b47c81d77b8 tempest-ProjectReaderTests-1672117553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:56 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-dc38d7fc-4f08-4a11-8bf8-9b47c81d77b8 tempest-ProjectReaderTests-1672117553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-dc38d7fc-4f08-4a11-8bf8-9b47c81d77b8 tempest-ProjectReaderTests-1672117553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-dc38d7fc-4f08-4a11-8bf8-9b47c81d77b8 tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:56 devstack sudo[108304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:03:56 devstack sudo[108304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:57 devstack sudo[108304]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-dc38d7fc-4f08-4a11-8bf8-9b47c81d77b8 tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.427s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:57 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-dc38d7fc-4f08-4a11-8bf8-9b47c81d77b8 tempest-ProjectReaderTests-1672117553 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:03:57 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-dc38d7fc-4f08-4a11-8bf8-9b47c81d77b8 tempest-ProjectReaderTests-1672117553 None] Deleted volume successfully.
Nov 06 12:03:57 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-dc38d7fc-4f08-4a11-8bf8-9b47c81d77b8 tempest-ProjectReaderTests-1672117553 None] Lock "cinder-25b7a7cf-c261-460b-8861-ffafca7d0784-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:03:57 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-b471a651-da20-4a6f-8448-2e5d84044eb9 tempest-ProjectReaderTests-1672117553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:03:57 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b471a651-da20-4a6f-8448-2e5d84044eb9 tempest-ProjectReaderTests-1672117553 None] Flow 'volume_create_manager' (4c0b31fd-c677-43a5-b184-031e73b833bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:03:57 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b471a651-da20-4a6f-8448-2e5d84044eb9 tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (100e36b4-e84d-4d25-a4a3-0f24a90aa175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:57 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b471a651-da20-4a6f-8448-2e5d84044eb9 tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (100e36b4-e84d-4d25-a4a3-0f24a90aa175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-250072535',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fd7b759-7e6d-43ef-8fcb-666feb240708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c737f6ee48a4d11a061314cd20da265',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:58Z,use_quota=True,user_id='7695e7d99bd24749a219f86885bd0d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:57 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b471a651-da20-4a6f-8448-2e5d84044eb9 tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abb2a51f-0739-4636-aa90-e0d8b5216822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:57 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b471a651-da20-4a6f-8448-2e5d84044eb9 tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abb2a51f-0739-4636-aa90-e0d8b5216822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:57 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b471a651-da20-4a6f-8448-2e5d84044eb9 tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9874e08e-2e60-4e48-8e71-d94aa694f9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:57 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b471a651-da20-4a6f-8448-2e5d84044eb9 tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9874e08e-2e60-4e48-8e71-d94aa694f9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fd7b759-7e6d-43ef-8fcb-666feb240708', 'volume_name': 'volume-7fd7b759-7e6d-43ef-8fcb-666feb240708', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:57 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b471a651-da20-4a6f-8448-2e5d84044eb9 tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f22347b-6393-4925-8f13-42911c5b50fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:57 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b471a651-da20-4a6f-8448-2e5d84044eb9 tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f22347b-6393-4925-8f13-42911c5b50fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:57 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b471a651-da20-4a6f-8448-2e5d84044eb9 tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23e6e21b-751e-4ff1-80b3-52d5a975d32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:57 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-b471a651-da20-4a6f-8448-2e5d84044eb9 tempest-ProjectReaderTests-1672117553 None] Volume 7fd7b759-7e6d-43ef-8fcb-666feb240708: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fd7b759-7e6d-43ef-8fcb-666feb240708', 'volume_size': 1}
Nov 06 12:03:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b471a651-da20-4a6f-8448-2e5d84044eb9 tempest-ProjectReaderTests-1672117553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b471a651-da20-4a6f-8448-2e5d84044eb9 tempest-ProjectReaderTests-1672117553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:57 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b471a651-da20-4a6f-8448-2e5d84044eb9 tempest-ProjectReaderTests-1672117553 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-250072535',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fd7b759-7e6d-43ef-8fcb-666feb240708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c737f6ee48a4d11a061314cd20da265',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:58Z,use_quota=True,user_id='7695e7d99bd24749a219f86885bd0d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:03:57 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-b471a651-da20-4a6f-8448-2e5d84044eb9 tempest-ProjectReaderTests-1672117553 None] Creating volume 7fd7b759-7e6d-43ef-8fcb-666feb240708 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:03:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b471a651-da20-4a6f-8448-2e5d84044eb9 tempest-ProjectReaderTests-1672117553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:03:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b471a651-da20-4a6f-8448-2e5d84044eb9 tempest-ProjectReaderTests-1672117553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:03:57 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b471a651-da20-4a6f-8448-2e5d84044eb9 tempest-ProjectReaderTests-1672117553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:03:57 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b471a651-da20-4a6f-8448-2e5d84044eb9 tempest-ProjectReaderTests-1672117553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:03:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b471a651-da20-4a6f-8448-2e5d84044eb9 tempest-ProjectReaderTests-1672117553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:57 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b471a651-da20-4a6f-8448-2e5d84044eb9 tempest-ProjectReaderTests-1672117553 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:03:57 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-b471a651-da20-4a6f-8448-2e5d84044eb9 tempest-ProjectReaderTests-1672117553 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:03:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b471a651-da20-4a6f-8448-2e5d84044eb9 tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fd7b759-7e6d-43ef-8fcb-666feb240708 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:57 devstack sudo[108308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fd7b759-7e6d-43ef-8fcb-666feb240708 1073741824
Nov 06 12:03:57 devstack sudo[108308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:58 devstack sudo[108308]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b471a651-da20-4a6f-8448-2e5d84044eb9 tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fd7b759-7e6d-43ef-8fcb-666feb240708 1073741824" returned: 0 in 0.635s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b471a651-da20-4a6f-8448-2e5d84044eb9 tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fd7b759-7e6d-43ef-8fcb-666feb240708 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:03:58 devstack sudo[108315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fd7b759-7e6d-43ef-8fcb-666feb240708
Nov 06 12:03:58 devstack sudo[108315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:03:58 devstack sudo[108315]: pam_unix(sudo:session): session closed for user root
Nov 06 12:03:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b471a651-da20-4a6f-8448-2e5d84044eb9 tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fd7b759-7e6d-43ef-8fcb-666feb240708" returned: 0 in 0.338s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:03:58 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b471a651-da20-4a6f-8448-2e5d84044eb9 tempest-ProjectReaderTests-1672117553 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:03:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b471a651-da20-4a6f-8448-2e5d84044eb9 tempest-ProjectReaderTests-1672117553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:03:58 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b471a651-da20-4a6f-8448-2e5d84044eb9 tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23e6e21b-751e-4ff1-80b3-52d5a975d32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fd7b759-7e6d-43ef-8fcb-666feb240708', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:58 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b471a651-da20-4a6f-8448-2e5d84044eb9 tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2bb02d5-0512-4961-a413-f0f37a6eabb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:03:59 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-b471a651-da20-4a6f-8448-2e5d84044eb9 tempest-ProjectReaderTests-1672117553 None] Volume volume-7fd7b759-7e6d-43ef-8fcb-666feb240708 (7fd7b759-7e6d-43ef-8fcb-666feb240708): created successfully
Nov 06 12:03:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b471a651-da20-4a6f-8448-2e5d84044eb9 tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2bb02d5-0512-4961-a413-f0f37a6eabb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:03:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-b471a651-da20-4a6f-8448-2e5d84044eb9 tempest-ProjectReaderTests-1672117553 None] Flow 'volume_create_manager' (4c0b31fd-c677-43a5-b184-031e73b833bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:03:59 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-b471a651-da20-4a6f-8448-2e5d84044eb9 tempest-ProjectReaderTests-1672117553 None] Created volume successfully.
Nov 06 12:04:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-33250899-4bc8-462c-a94a-3d76f23885bd tempest-ProjectReaderTests-1672117553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-33250899-4bc8-462c-a94a-3d76f23885bd tempest-ProjectReaderTests-1672117553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:00 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-33250899-4bc8-462c-a94a-3d76f23885bd tempest-ProjectReaderTests-1672117553 None] Creating offline snapshot e154f7c5-eb08-49e0-8b09-4f874890e0cb of volume 7fd7b759-7e6d-43ef-8fcb-666feb240708 {{(pid=87165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 12:04:00 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e268ee4-db94-4bec-9026-4713529f8660]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:04:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-33250899-4bc8-462c-a94a-3d76f23885bd tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fd7b759-7e6d-43ef-8fcb-666feb240708 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:00 devstack sudo[108318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fd7b759-7e6d-43ef-8fcb-666feb240708
Nov 06 12:04:00 devstack sudo[108318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:00 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-82be6907-cac9-4071-8528-2318cc3a9d5b tempest-CinderUnicodeTest-1590578926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:04:00 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-82be6907-cac9-4071-8528-2318cc3a9d5b tempest-CinderUnicodeTest-1590578926 None] Flow 'volume_create_manager' (4f4cb880-237f-474a-8515-9b48f915269c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:04:00 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-82be6907-cac9-4071-8528-2318cc3a9d5b tempest-CinderUnicodeTest-1590578926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8de44ae-8ef8-41a8-bed2-940efc46a12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:00 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-82be6907-cac9-4071-8528-2318cc3a9d5b tempest-CinderUnicodeTest-1590578926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8de44ae-8ef8-41a8-bed2-940efc46a12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:04:00Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c16a7a7c-40d3-4939-ac9e-05476518bdef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fde5802760a412fbe0554cc44c48f1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:04:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:04:00Z,use_quota=True,user_id='436c3a19d1f74c8ebd382ad1567371c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:00 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-82be6907-cac9-4071-8528-2318cc3a9d5b tempest-CinderUnicodeTest-1590578926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b3bf139-c1d8-45d6-ba2a-ed23421be187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:00 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-82be6907-cac9-4071-8528-2318cc3a9d5b tempest-CinderUnicodeTest-1590578926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b3bf139-c1d8-45d6-ba2a-ed23421be187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:00 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-82be6907-cac9-4071-8528-2318cc3a9d5b tempest-CinderUnicodeTest-1590578926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (540a2c69-9e7e-44b0-8a26-617a3d942606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:00 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-82be6907-cac9-4071-8528-2318cc3a9d5b tempest-CinderUnicodeTest-1590578926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (540a2c69-9e7e-44b0-8a26-617a3d942606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c16a7a7c-40d3-4939-ac9e-05476518bdef', 'volume_name': 'volume-c16a7a7c-40d3-4939-ac9e-05476518bdef', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:00 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-82be6907-cac9-4071-8528-2318cc3a9d5b tempest-CinderUnicodeTest-1590578926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (934fd29c-2ddc-446e-990b-d72548b0424c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:00 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-82be6907-cac9-4071-8528-2318cc3a9d5b tempest-CinderUnicodeTest-1590578926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (934fd29c-2ddc-446e-990b-d72548b0424c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:00 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-82be6907-cac9-4071-8528-2318cc3a9d5b tempest-CinderUnicodeTest-1590578926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36c8fff6-07fa-45c3-a1bd-efa6bf950e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:00 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-82be6907-cac9-4071-8528-2318cc3a9d5b tempest-CinderUnicodeTest-1590578926 None] Volume c16a7a7c-40d3-4939-ac9e-05476518bdef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c16a7a7c-40d3-4939-ac9e-05476518bdef', 'volume_size': 1}
Nov 06 12:04:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-82be6907-cac9-4071-8528-2318cc3a9d5b tempest-CinderUnicodeTest-1590578926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:00 devstack sudo[108318]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-33250899-4bc8-462c-a94a-3d76f23885bd tempest-ProjectReaderTests-1672117553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fd7b759-7e6d-43ef-8fcb-666feb240708" returned: 0 in 0.399s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-33250899-4bc8-462c-a94a-3d76f23885bd tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fd7b759-7e6d-43ef-8fcb-666feb240708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fd7b759-7e6d-43ef-8fcb-666feb240708.e154f7c5-eb08-49e0-8b09-4f874890e0cb 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:00 devstack sudo[108323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fd7b759-7e6d-43ef-8fcb-666feb240708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fd7b759-7e6d-43ef-8fcb-666feb240708.e154f7c5-eb08-49e0-8b09-4f874890e0cb 1G
Nov 06 12:04:00 devstack sudo[108323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:01 devstack sudo[108323]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-33250899-4bc8-462c-a94a-3d76f23885bd tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fd7b759-7e6d-43ef-8fcb-666feb240708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fd7b759-7e6d-43ef-8fcb-666feb240708.e154f7c5-eb08-49e0-8b09-4f874890e0cb 1G" returned: 0 in 0.480s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-33250899-4bc8-462c-a94a-3d76f23885bd tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fd7b759-7e6d-43ef-8fcb-666feb240708 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fd7b759-7e6d-43ef-8fcb-666feb240708.e154f7c5-eb08-49e0-8b09-4f874890e0cb {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:01 devstack sudo[108329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fd7b759-7e6d-43ef-8fcb-666feb240708 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fd7b759-7e6d-43ef-8fcb-666feb240708.e154f7c5-eb08-49e0-8b09-4f874890e0cb
Nov 06 12:04:01 devstack sudo[108329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:01 devstack sudo[108329]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-33250899-4bc8-462c-a94a-3d76f23885bd tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fd7b759-7e6d-43ef-8fcb-666feb240708 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fd7b759-7e6d-43ef-8fcb-666feb240708.e154f7c5-eb08-49e0-8b09-4f874890e0cb" returned: 0 in 0.338s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:01 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-33250899-4bc8-462c-a94a-3d76f23885bd tempest-ProjectReaderTests-1672117553 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fd7b759-7e6d-43ef-8fcb-666feb240708.e154f7c5-eb08-49e0-8b09-4f874890e0cb is being set with open permissions: ugo+rw
Nov 06 12:04:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-33250899-4bc8-462c-a94a-3d76f23885bd tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fd7b759-7e6d-43ef-8fcb-666feb240708.e154f7c5-eb08-49e0-8b09-4f874890e0cb {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:01 devstack sudo[108334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fd7b759-7e6d-43ef-8fcb-666feb240708.e154f7c5-eb08-49e0-8b09-4f874890e0cb
Nov 06 12:04:01 devstack sudo[108334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:01 devstack sudo[108334]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-33250899-4bc8-462c-a94a-3d76f23885bd tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fd7b759-7e6d-43ef-8fcb-666feb240708.e154f7c5-eb08-49e0-8b09-4f874890e0cb" returned: 0 in 0.263s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-33250899-4bc8-462c-a94a-3d76f23885bd tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fd7b759-7e6d-43ef-8fcb-666feb240708.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:01 devstack sudo[108337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fd7b759-7e6d-43ef-8fcb-666feb240708.info
Nov 06 12:04:01 devstack sudo[108337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:02 devstack sudo[108337]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-33250899-4bc8-462c-a94a-3d76f23885bd tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fd7b759-7e6d-43ef-8fcb-666feb240708.info" returned: 0 in 0.298s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:02 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-33250899-4bc8-462c-a94a-3d76f23885bd tempest-ProjectReaderTests-1672117553 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fd7b759-7e6d-43ef-8fcb-666feb240708.info is being set with open permissions: ugo+rw
Nov 06 12:04:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-33250899-4bc8-462c-a94a-3d76f23885bd tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fd7b759-7e6d-43ef-8fcb-666feb240708.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:02 devstack sudo[108340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fd7b759-7e6d-43ef-8fcb-666feb240708.info
Nov 06 12:04:02 devstack sudo[108340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:02 devstack sudo[108340]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-33250899-4bc8-462c-a94a-3d76f23885bd tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fd7b759-7e6d-43ef-8fcb-666feb240708.info" returned: 0 in 0.353s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-33250899-4bc8-462c-a94a-3d76f23885bd tempest-ProjectReaderTests-1672117553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.252s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-82be6907-cac9-4071-8528-2318cc3a9d5b tempest-CinderUnicodeTest-1590578926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.930s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:02 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-82be6907-cac9-4071-8528-2318cc3a9d5b tempest-CinderUnicodeTest-1590578926 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:04:00Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c16a7a7c-40d3-4939-ac9e-05476518bdef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fde5802760a412fbe0554cc44c48f1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:04:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:04:00Z,use_quota=True,user_id='436c3a19d1f74c8ebd382ad1567371c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:04:02 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-82be6907-cac9-4071-8528-2318cc3a9d5b tempest-CinderUnicodeTest-1590578926 None] Creating volume c16a7a7c-40d3-4939-ac9e-05476518bdef {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:04:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-82be6907-cac9-4071-8528-2318cc3a9d5b tempest-CinderUnicodeTest-1590578926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-82be6907-cac9-4071-8528-2318cc3a9d5b tempest-CinderUnicodeTest-1590578926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:02 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-82be6907-cac9-4071-8528-2318cc3a9d5b tempest-CinderUnicodeTest-1590578926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:04:02 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-82be6907-cac9-4071-8528-2318cc3a9d5b tempest-CinderUnicodeTest-1590578926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:04:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-82be6907-cac9-4071-8528-2318cc3a9d5b tempest-CinderUnicodeTest-1590578926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:02 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-82be6907-cac9-4071-8528-2318cc3a9d5b tempest-CinderUnicodeTest-1590578926 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:04:02 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-82be6907-cac9-4071-8528-2318cc3a9d5b tempest-CinderUnicodeTest-1590578926 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:04:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-82be6907-cac9-4071-8528-2318cc3a9d5b tempest-CinderUnicodeTest-1590578926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c16a7a7c-40d3-4939-ac9e-05476518bdef 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:02 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-33250899-4bc8-462c-a94a-3d76f23885bd tempest-ProjectReaderTests-1672117553 None] Create snapshot completed successfully
Nov 06 12:04:02 devstack sudo[108344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c16a7a7c-40d3-4939-ac9e-05476518bdef 1073741824
Nov 06 12:04:02 devstack sudo[108344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:03 devstack sudo[108344]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-82be6907-cac9-4071-8528-2318cc3a9d5b tempest-CinderUnicodeTest-1590578926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c16a7a7c-40d3-4939-ac9e-05476518bdef 1073741824" returned: 0 in 0.579s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-82be6907-cac9-4071-8528-2318cc3a9d5b tempest-CinderUnicodeTest-1590578926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c16a7a7c-40d3-4939-ac9e-05476518bdef {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:03 devstack sudo[108350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c16a7a7c-40d3-4939-ac9e-05476518bdef
Nov 06 12:04:03 devstack sudo[108350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:03 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-dcf9ebd4-fe1d-4c4f-885a-426b47294e5a tempest-ProjectReaderTests-1672117553 None] Acquiring lock "cinder-e154f7c5-eb08-49e0-8b09-4f874890e0cb-delete_snapshot" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:03 devstack sudo[108350]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-82be6907-cac9-4071-8528-2318cc3a9d5b tempest-CinderUnicodeTest-1590578926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c16a7a7c-40d3-4939-ac9e-05476518bdef" returned: 0 in 0.343s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:03 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-82be6907-cac9-4071-8528-2318cc3a9d5b tempest-CinderUnicodeTest-1590578926 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:04:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-82be6907-cac9-4071-8528-2318cc3a9d5b tempest-CinderUnicodeTest-1590578926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:03 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-dcf9ebd4-fe1d-4c4f-885a-426b47294e5a tempest-ProjectReaderTests-1672117553 None] Lock "cinder-e154f7c5-eb08-49e0-8b09-4f874890e0cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:03 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-dcf9ebd4-fe1d-4c4f-885a-426b47294e5a tempest-ProjectReaderTests-1672117553 None] Acquiring lock "cinder-quobyte-7fd7b759-7e6d-43ef-8fcb-666feb240708" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-82be6907-cac9-4071-8528-2318cc3a9d5b tempest-CinderUnicodeTest-1590578926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36c8fff6-07fa-45c3-a1bd-efa6bf950e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c16a7a7c-40d3-4939-ac9e-05476518bdef', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-82be6907-cac9-4071-8528-2318cc3a9d5b tempest-CinderUnicodeTest-1590578926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24ba76fd-9627-47eb-8ca6-d227b84bca44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:03 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-dcf9ebd4-fe1d-4c4f-885a-426b47294e5a tempest-ProjectReaderTests-1672117553 None] Lock "cinder-quobyte-7fd7b759-7e6d-43ef-8fcb-666feb240708" acquired by "delete_snapshot" :: waited 0.063s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:03 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-dcf9ebd4-fe1d-4c4f-885a-426b47294e5a tempest-ProjectReaderTests-1672117553 None] Acquiring lock "cinder-quobyte-e154f7c5-eb08-49e0-8b09-4f874890e0cb" by "_delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:03 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-dcf9ebd4-fe1d-4c4f-885a-426b47294e5a tempest-ProjectReaderTests-1672117553 None] Lock "cinder-quobyte-e154f7c5-eb08-49e0-8b09-4f874890e0cb" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:03 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-dcf9ebd4-fe1d-4c4f-885a-426b47294e5a tempest-ProjectReaderTests-1672117553 None] Deleting offline snapshot e154f7c5-eb08-49e0-8b09-4f874890e0cb of volume 7fd7b759-7e6d-43ef-8fcb-666feb240708 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 12:04:03 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-dcf9ebd4-fe1d-4c4f-885a-426b47294e5a tempest-ProjectReaderTests-1672117553 None] snapshot_file for this snap is: volume-7fd7b759-7e6d-43ef-8fcb-666feb240708.e154f7c5-eb08-49e0-8b09-4f874890e0cb {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 12:04:03 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-82be6907-cac9-4071-8528-2318cc3a9d5b tempest-CinderUnicodeTest-1590578926 None] Volume volume-c16a7a7c-40d3-4939-ac9e-05476518bdef (c16a7a7c-40d3-4939-ac9e-05476518bdef): created successfully
Nov 06 12:04:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-82be6907-cac9-4071-8528-2318cc3a9d5b tempest-CinderUnicodeTest-1590578926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24ba76fd-9627-47eb-8ca6-d227b84bca44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:03 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-82be6907-cac9-4071-8528-2318cc3a9d5b tempest-CinderUnicodeTest-1590578926 None] Flow 'volume_create_manager' (4f4cb880-237f-474a-8515-9b48f915269c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:04:03 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cac4624-be0e-44b8-b0cf-23cf9208d08d]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:04:03 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-dcf9ebd4-fe1d-4c4f-885a-426b47294e5a tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fd7b759-7e6d-43ef-8fcb-666feb240708.e154f7c5-eb08-49e0-8b09-4f874890e0cb {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:03 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-82be6907-cac9-4071-8528-2318cc3a9d5b tempest-CinderUnicodeTest-1590578926 None] Created volume successfully.
Nov 06 12:04:03 devstack sudo[108353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fd7b759-7e6d-43ef-8fcb-666feb240708.e154f7c5-eb08-49e0-8b09-4f874890e0cb
Nov 06 12:04:03 devstack sudo[108353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:03 devstack sudo[108353]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-dcf9ebd4-fe1d-4c4f-885a-426b47294e5a tempest-ProjectReaderTests-1672117553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fd7b759-7e6d-43ef-8fcb-666feb240708.e154f7c5-eb08-49e0-8b09-4f874890e0cb" returned: 0 in 0.428s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:04 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-dcf9ebd4-fe1d-4c4f-885a-426b47294e5a tempest-ProjectReaderTests-1672117553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fd7b759-7e6d-43ef-8fcb-666feb240708(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 12:04:04 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc815f9e-fc76-4fd3-969a-25496c4e9c82]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:04:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-dcf9ebd4-fe1d-4c4f-885a-426b47294e5a tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fd7b759-7e6d-43ef-8fcb-666feb240708 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:04 devstack sudo[108358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fd7b759-7e6d-43ef-8fcb-666feb240708
Nov 06 12:04:04 devstack sudo[108358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:04 devstack sudo[108358]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-dcf9ebd4-fe1d-4c4f-885a-426b47294e5a tempest-ProjectReaderTests-1672117553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fd7b759-7e6d-43ef-8fcb-666feb240708" returned: 0 in 0.375s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-dcf9ebd4-fe1d-4c4f-885a-426b47294e5a tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fd7b759-7e6d-43ef-8fcb-666feb240708.e154f7c5-eb08-49e0-8b09-4f874890e0cb {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:04 devstack sudo[108363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fd7b759-7e6d-43ef-8fcb-666feb240708.e154f7c5-eb08-49e0-8b09-4f874890e0cb
Nov 06 12:04:04 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:04 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-dcf9ebd4-fe1d-4c4f-885a-426b47294e5a tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fd7b759-7e6d-43ef-8fcb-666feb240708.e154f7c5-eb08-49e0-8b09-4f874890e0cb" returned: 0 in 0.450s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-dcf9ebd4-fe1d-4c4f-885a-426b47294e5a tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fd7b759-7e6d-43ef-8fcb-666feb240708.e154f7c5-eb08-49e0-8b09-4f874890e0cb {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:04 devstack sudo[108369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fd7b759-7e6d-43ef-8fcb-666feb240708.e154f7c5-eb08-49e0-8b09-4f874890e0cb
Nov 06 12:04:04 devstack sudo[108369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:05 devstack sudo[108369]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-dcf9ebd4-fe1d-4c4f-885a-426b47294e5a tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fd7b759-7e6d-43ef-8fcb-666feb240708.e154f7c5-eb08-49e0-8b09-4f874890e0cb" returned: 0 in 0.409s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:05 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:UPDATE=294,cinder:SELECT=213,cinder:INSERT=83,cinder:DELETE=28 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 12:04:05 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-dcf9ebd4-fe1d-4c4f-885a-426b47294e5a tempest-ProjectReaderTests-1672117553 None] Lock "cinder-quobyte-e154f7c5-eb08-49e0-8b09-4f874890e0cb" released by "_delete_snapshot" :: held 1.811s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:05 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-dcf9ebd4-fe1d-4c4f-885a-426b47294e5a tempest-ProjectReaderTests-1672117553 None] Lock "cinder-quobyte-7fd7b759-7e6d-43ef-8fcb-666feb240708" released by "delete_snapshot" :: held 1.846s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:05 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:SELECT=214,cinder:UPDATE=299,cinder:DELETE=26,cinder:INSERT=74 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 12:04:05 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6b51c68-51d0-4e22-bb11-18a92fc3eb03 tempest-CinderUnicodeTest-1590578926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:04:05 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a6b51c68-51d0-4e22-bb11-18a92fc3eb03 tempest-CinderUnicodeTest-1590578926 None] Flow 'volume_create_manager' (f8cc265d-2ece-48da-bff6-d07b384e8e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:04:05 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a6b51c68-51d0-4e22-bb11-18a92fc3eb03 tempest-CinderUnicodeTest-1590578926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dda9dd9-db54-4057-b174-961483e6cd85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:05 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a6b51c68-51d0-4e22-bb11-18a92fc3eb03 tempest-CinderUnicodeTest-1590578926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dda9dd9-db54-4057-b174-961483e6cd85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:04:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-710704028',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fff7d340-173f-47db-89ec-6e76eaed85c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fde5802760a412fbe0554cc44c48f1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:04:05Z,use_quota=True,user_id='436c3a19d1f74c8ebd382ad1567371c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:05 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a6b51c68-51d0-4e22-bb11-18a92fc3eb03 tempest-CinderUnicodeTest-1590578926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ccaf854-2d02-4e30-8606-624d4fa33b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:05 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a6b51c68-51d0-4e22-bb11-18a92fc3eb03 tempest-CinderUnicodeTest-1590578926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ccaf854-2d02-4e30-8606-624d4fa33b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:05 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a6b51c68-51d0-4e22-bb11-18a92fc3eb03 tempest-CinderUnicodeTest-1590578926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51bf456a-580b-416f-9f62-03fcdfc36f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:05 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a6b51c68-51d0-4e22-bb11-18a92fc3eb03 tempest-CinderUnicodeTest-1590578926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51bf456a-580b-416f-9f62-03fcdfc36f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fff7d340-173f-47db-89ec-6e76eaed85c0', 'volume_name': 'volume-fff7d340-173f-47db-89ec-6e76eaed85c0', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:05 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a6b51c68-51d0-4e22-bb11-18a92fc3eb03 tempest-CinderUnicodeTest-1590578926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f1a6163-0397-42b2-9294-fa992c7f19d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:05 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a6b51c68-51d0-4e22-bb11-18a92fc3eb03 tempest-CinderUnicodeTest-1590578926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f1a6163-0397-42b2-9294-fa992c7f19d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:05 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a6b51c68-51d0-4e22-bb11-18a92fc3eb03 tempest-CinderUnicodeTest-1590578926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (304ede6e-80a7-4277-b009-9f57547c55d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:05 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-a6b51c68-51d0-4e22-bb11-18a92fc3eb03 tempest-CinderUnicodeTest-1590578926 None] Volume fff7d340-173f-47db-89ec-6e76eaed85c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fff7d340-173f-47db-89ec-6e76eaed85c0', 'volume_size': 1}
Nov 06 12:04:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a6b51c68-51d0-4e22-bb11-18a92fc3eb03 tempest-CinderUnicodeTest-1590578926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a6b51c68-51d0-4e22-bb11-18a92fc3eb03 tempest-CinderUnicodeTest-1590578926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:05 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a6b51c68-51d0-4e22-bb11-18a92fc3eb03 tempest-CinderUnicodeTest-1590578926 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:04:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-710704028',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fff7d340-173f-47db-89ec-6e76eaed85c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fde5802760a412fbe0554cc44c48f1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:04:05Z,use_quota=True,user_id='436c3a19d1f74c8ebd382ad1567371c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:04:05 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-a6b51c68-51d0-4e22-bb11-18a92fc3eb03 tempest-CinderUnicodeTest-1590578926 None] Creating volume fff7d340-173f-47db-89ec-6e76eaed85c0 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:04:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a6b51c68-51d0-4e22-bb11-18a92fc3eb03 tempest-CinderUnicodeTest-1590578926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a6b51c68-51d0-4e22-bb11-18a92fc3eb03 tempest-CinderUnicodeTest-1590578926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:05 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a6b51c68-51d0-4e22-bb11-18a92fc3eb03 tempest-CinderUnicodeTest-1590578926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:04:05 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a6b51c68-51d0-4e22-bb11-18a92fc3eb03 tempest-CinderUnicodeTest-1590578926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:04:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a6b51c68-51d0-4e22-bb11-18a92fc3eb03 tempest-CinderUnicodeTest-1590578926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:05 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a6b51c68-51d0-4e22-bb11-18a92fc3eb03 tempest-CinderUnicodeTest-1590578926 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:04:05 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-a6b51c68-51d0-4e22-bb11-18a92fc3eb03 tempest-CinderUnicodeTest-1590578926 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:04:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a6b51c68-51d0-4e22-bb11-18a92fc3eb03 tempest-CinderUnicodeTest-1590578926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fff7d340-173f-47db-89ec-6e76eaed85c0 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:05 devstack sudo[108373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fff7d340-173f-47db-89ec-6e76eaed85c0 1073741824
Nov 06 12:04:05 devstack sudo[108373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:05 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-dcf9ebd4-fe1d-4c4f-885a-426b47294e5a tempest-ProjectReaderTests-1672117553 None] Created reservations ['394e740e-eccd-4862-82a7-dcdd7b121e9f', 'fd4863e5-595e-4658-9f0a-06d2e5434bb2', 'ad7a9c4f-3c7b-4509-8144-8ed668beb39e', '7157df9a-d6a5-4daf-bbe1-2ae580c5be7a'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:04:05 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-dcf9ebd4-fe1d-4c4f-885a-426b47294e5a tempest-ProjectReaderTests-1672117553 None] Delete snapshot completed successfully.
Nov 06 12:04:05 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-dcf9ebd4-fe1d-4c4f-885a-426b47294e5a tempest-ProjectReaderTests-1672117553 None] Lock "cinder-e154f7c5-eb08-49e0-8b09-4f874890e0cb-delete_snapshot" released by "delete_snapshot" :: held 2.227s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:06 devstack sudo[108373]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a6b51c68-51d0-4e22-bb11-18a92fc3eb03 tempest-CinderUnicodeTest-1590578926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fff7d340-173f-47db-89ec-6e76eaed85c0 1073741824" returned: 0 in 0.555s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a6b51c68-51d0-4e22-bb11-18a92fc3eb03 tempest-CinderUnicodeTest-1590578926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fff7d340-173f-47db-89ec-6e76eaed85c0 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:06 devstack sudo[108379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fff7d340-173f-47db-89ec-6e76eaed85c0
Nov 06 12:04:06 devstack sudo[108379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:06 devstack sudo[108379]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a6b51c68-51d0-4e22-bb11-18a92fc3eb03 tempest-CinderUnicodeTest-1590578926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fff7d340-173f-47db-89ec-6e76eaed85c0" returned: 0 in 0.273s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:06 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a6b51c68-51d0-4e22-bb11-18a92fc3eb03 tempest-CinderUnicodeTest-1590578926 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:04:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a6b51c68-51d0-4e22-bb11-18a92fc3eb03 tempest-CinderUnicodeTest-1590578926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:06 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a6b51c68-51d0-4e22-bb11-18a92fc3eb03 tempest-CinderUnicodeTest-1590578926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (304ede6e-80a7-4277-b009-9f57547c55d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fff7d340-173f-47db-89ec-6e76eaed85c0', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:06 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a6b51c68-51d0-4e22-bb11-18a92fc3eb03 tempest-CinderUnicodeTest-1590578926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b211172f-93a4-4e51-bf48-12bb787f8f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:06 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-a6b51c68-51d0-4e22-bb11-18a92fc3eb03 tempest-CinderUnicodeTest-1590578926 None] Volume volume-fff7d340-173f-47db-89ec-6e76eaed85c0 (fff7d340-173f-47db-89ec-6e76eaed85c0): created successfully
Nov 06 12:04:06 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a6b51c68-51d0-4e22-bb11-18a92fc3eb03 tempest-CinderUnicodeTest-1590578926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b211172f-93a4-4e51-bf48-12bb787f8f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:06 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a6b51c68-51d0-4e22-bb11-18a92fc3eb03 tempest-CinderUnicodeTest-1590578926 None] Flow 'volume_create_manager' (f8cc265d-2ece-48da-bff6-d07b384e8e87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:04:06 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-a6b51c68-51d0-4e22-bb11-18a92fc3eb03 tempest-CinderUnicodeTest-1590578926 None] Created volume successfully.
Nov 06 12:04:06 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-4b616079-5e21-42e7-9481-7c8b3c1f6f48 tempest-ProjectReaderTests-1672117553 None] Acquiring lock "cinder-7fd7b759-7e6d-43ef-8fcb-666feb240708-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:06 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-4b616079-5e21-42e7-9481-7c8b3c1f6f48 tempest-ProjectReaderTests-1672117553 None] Lock "cinder-7fd7b759-7e6d-43ef-8fcb-666feb240708-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:06 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-4b616079-5e21-42e7-9481-7c8b3c1f6f48 tempest-ProjectReaderTests-1672117553 None] Acquiring lock "cinder-quobyte-7fd7b759-7e6d-43ef-8fcb-666feb240708" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:06 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-4b616079-5e21-42e7-9481-7c8b3c1f6f48 tempest-ProjectReaderTests-1672117553 None] Lock "cinder-quobyte-7fd7b759-7e6d-43ef-8fcb-666feb240708" acquired by "delete_volume" :: waited 0.025s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:06 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-5193858a-0b1e-42fa-9518-00446964241a tempest-ProjectReaderTests-1070449080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:04:06 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5193858a-0b1e-42fa-9518-00446964241a tempest-ProjectReaderTests-1070449080 None] Flow 'volume_create_manager' (b6a2d4b1-fa33-41f2-a811-e570dcfe4ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:04:06 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5193858a-0b1e-42fa-9518-00446964241a tempest-ProjectReaderTests-1070449080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3040ef76-4932-4b0e-ab9a-246f6f6c375c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:06 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b666832a-c6e7-4ff4-ac8f-40460d472427]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:04:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4b616079-5e21-42e7-9481-7c8b3c1f6f48 tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fd7b759-7e6d-43ef-8fcb-666feb240708 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:06 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5193858a-0b1e-42fa-9518-00446964241a tempest-ProjectReaderTests-1070449080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3040ef76-4932-4b0e-ab9a-246f6f6c375c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-820658844',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb793203-f84d-4e4b-8aa2-f51d0aaa7046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c13e3cc25924935a60f5a96ce9b3eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:04:07Z,use_quota=True,user_id='18a7d2dabd13418f829055cfd8f03f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:06 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5193858a-0b1e-42fa-9518-00446964241a tempest-ProjectReaderTests-1070449080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19207985-63fe-45c4-8ae4-bb6b7d6d1cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:06 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5193858a-0b1e-42fa-9518-00446964241a tempest-ProjectReaderTests-1070449080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19207985-63fe-45c4-8ae4-bb6b7d6d1cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:06 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5193858a-0b1e-42fa-9518-00446964241a tempest-ProjectReaderTests-1070449080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62afc1fc-ddd0-438c-a92d-04b1176b6066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:06 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5193858a-0b1e-42fa-9518-00446964241a tempest-ProjectReaderTests-1070449080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62afc1fc-ddd0-438c-a92d-04b1176b6066) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb793203-f84d-4e4b-8aa2-f51d0aaa7046', 'volume_name': 'volume-eb793203-f84d-4e4b-8aa2-f51d0aaa7046', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:06 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5193858a-0b1e-42fa-9518-00446964241a tempest-ProjectReaderTests-1070449080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (228817aa-32e8-46c8-b305-6cea0c5746a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:06 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5193858a-0b1e-42fa-9518-00446964241a tempest-ProjectReaderTests-1070449080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (228817aa-32e8-46c8-b305-6cea0c5746a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:06 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5193858a-0b1e-42fa-9518-00446964241a tempest-ProjectReaderTests-1070449080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2f23c33-1783-42c9-885c-fac8b941e010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:06 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-5193858a-0b1e-42fa-9518-00446964241a tempest-ProjectReaderTests-1070449080 None] Volume eb793203-f84d-4e4b-8aa2-f51d0aaa7046: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb793203-f84d-4e4b-8aa2-f51d0aaa7046', 'volume_size': 1}
Nov 06 12:04:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5193858a-0b1e-42fa-9518-00446964241a tempest-ProjectReaderTests-1070449080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5193858a-0b1e-42fa-9518-00446964241a tempest-ProjectReaderTests-1070449080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:06 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5193858a-0b1e-42fa-9518-00446964241a tempest-ProjectReaderTests-1070449080 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-820658844',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb793203-f84d-4e4b-8aa2-f51d0aaa7046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c13e3cc25924935a60f5a96ce9b3eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:04:07Z,use_quota=True,user_id='18a7d2dabd13418f829055cfd8f03f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:04:06 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-5193858a-0b1e-42fa-9518-00446964241a tempest-ProjectReaderTests-1070449080 None] Creating volume eb793203-f84d-4e4b-8aa2-f51d0aaa7046 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:04:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5193858a-0b1e-42fa-9518-00446964241a tempest-ProjectReaderTests-1070449080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5193858a-0b1e-42fa-9518-00446964241a tempest-ProjectReaderTests-1070449080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:06 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5193858a-0b1e-42fa-9518-00446964241a tempest-ProjectReaderTests-1070449080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:04:06 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5193858a-0b1e-42fa-9518-00446964241a tempest-ProjectReaderTests-1070449080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:04:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5193858a-0b1e-42fa-9518-00446964241a tempest-ProjectReaderTests-1070449080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:06 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5193858a-0b1e-42fa-9518-00446964241a tempest-ProjectReaderTests-1070449080 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:04:06 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-5193858a-0b1e-42fa-9518-00446964241a tempest-ProjectReaderTests-1070449080 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:04:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5193858a-0b1e-42fa-9518-00446964241a tempest-ProjectReaderTests-1070449080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-eb793203-f84d-4e4b-8aa2-f51d0aaa7046 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:07 devstack sudo[108383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-eb793203-f84d-4e4b-8aa2-f51d0aaa7046 1073741824
Nov 06 12:04:07 devstack sudo[108383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:07 devstack sudo[108382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fd7b759-7e6d-43ef-8fcb-666feb240708
Nov 06 12:04:07 devstack sudo[108382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:07 devstack sudo[108382]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4b616079-5e21-42e7-9481-7c8b3c1f6f48 tempest-ProjectReaderTests-1672117553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fd7b759-7e6d-43ef-8fcb-666feb240708" returned: 0 in 0.392s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4b616079-5e21-42e7-9481-7c8b3c1f6f48 tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fd7b759-7e6d-43ef-8fcb-666feb240708 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:07 devstack sudo[108392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fd7b759-7e6d-43ef-8fcb-666feb240708
Nov 06 12:04:07 devstack sudo[108392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:07 devstack sudo[108383]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5193858a-0b1e-42fa-9518-00446964241a tempest-ProjectReaderTests-1070449080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-eb793203-f84d-4e4b-8aa2-f51d0aaa7046 1073741824" returned: 0 in 0.535s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:07 devstack sudo[108392]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5193858a-0b1e-42fa-9518-00446964241a tempest-ProjectReaderTests-1070449080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-eb793203-f84d-4e4b-8aa2-f51d0aaa7046 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4b616079-5e21-42e7-9481-7c8b3c1f6f48 tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-7fd7b759-7e6d-43ef-8fcb-666feb240708" returned: 0 in 0.296s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:07 devstack sudo[108396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-eb793203-f84d-4e4b-8aa2-f51d0aaa7046
Nov 06 12:04:07 devstack sudo[108396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:07 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-4b616079-5e21-42e7-9481-7c8b3c1f6f48 tempest-ProjectReaderTests-1672117553 None] Lock "cinder-quobyte-7fd7b759-7e6d-43ef-8fcb-666feb240708" released by "delete_volume" :: held 0.815s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:07 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-4b616079-5e21-42e7-9481-7c8b3c1f6f48 tempest-ProjectReaderTests-1672117553 None] Created reservations ['d979b5a9-6eec-44f7-a0a4-4ac4cda887d1', 'ad23ee9b-269d-4b9d-8754-76ed2ad602e5', '7a94a37b-dcfb-4758-a6a8-d2df0b17080f', '4dfd59a1-8771-46ed-b0a4-65763a8cfc5b'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:04:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d920f28f-8aad-4231-9c45-766c55746cfe tempest-CinderUnicodeTest-1590578926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4b616079-5e21-42e7-9481-7c8b3c1f6f48 tempest-ProjectReaderTests-1672117553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4b616079-5e21-42e7-9481-7c8b3c1f6f48 tempest-ProjectReaderTests-1672117553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:07 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-4b616079-5e21-42e7-9481-7c8b3c1f6f48 tempest-ProjectReaderTests-1672117553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:04:07 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-4b616079-5e21-42e7-9481-7c8b3c1f6f48 tempest-ProjectReaderTests-1672117553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:04:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4b616079-5e21-42e7-9481-7c8b3c1f6f48 tempest-ProjectReaderTests-1672117553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4b616079-5e21-42e7-9481-7c8b3c1f6f48 tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:07 devstack sudo[108399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:04:07 devstack sudo[108399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:07 devstack sudo[108396]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5193858a-0b1e-42fa-9518-00446964241a tempest-ProjectReaderTests-1070449080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-eb793203-f84d-4e4b-8aa2-f51d0aaa7046" returned: 0 in 0.384s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:07 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-5193858a-0b1e-42fa-9518-00446964241a tempest-ProjectReaderTests-1070449080 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:04:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5193858a-0b1e-42fa-9518-00446964241a tempest-ProjectReaderTests-1070449080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d920f28f-8aad-4231-9c45-766c55746cfe tempest-CinderUnicodeTest-1590578926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.193s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:07 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5193858a-0b1e-42fa-9518-00446964241a tempest-ProjectReaderTests-1070449080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2f23c33-1783-42c9-885c-fac8b941e010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb793203-f84d-4e4b-8aa2-f51d0aaa7046', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5193858a-0b1e-42fa-9518-00446964241a tempest-ProjectReaderTests-1070449080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9553fb8b-70fe-4869-b1f1-968b441129c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:08 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-d920f28f-8aad-4231-9c45-766c55746cfe tempest-CinderUnicodeTest-1590578926 None] Creating offline snapshot 9af18404-1c4f-4329-ab93-252d56e2d024 of volume fff7d340-173f-47db-89ec-6e76eaed85c0 {{(pid=87165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 12:04:08 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-5193858a-0b1e-42fa-9518-00446964241a tempest-ProjectReaderTests-1070449080 None] Volume volume-eb793203-f84d-4e4b-8aa2-f51d0aaa7046 (eb793203-f84d-4e4b-8aa2-f51d0aaa7046): created successfully
Nov 06 12:04:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5193858a-0b1e-42fa-9518-00446964241a tempest-ProjectReaderTests-1070449080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9553fb8b-70fe-4869-b1f1-968b441129c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-5193858a-0b1e-42fa-9518-00446964241a tempest-ProjectReaderTests-1070449080 None] Flow 'volume_create_manager' (b6a2d4b1-fa33-41f2-a811-e570dcfe4ebf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:04:08 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd78a64-68d8-486b-b0ec-24f8a5fb6bc3]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:04:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d920f28f-8aad-4231-9c45-766c55746cfe tempest-CinderUnicodeTest-1590578926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fff7d340-173f-47db-89ec-6e76eaed85c0 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:08 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-5193858a-0b1e-42fa-9518-00446964241a tempest-ProjectReaderTests-1070449080 None] Created volume successfully.
Nov 06 12:04:08 devstack sudo[108399]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4b616079-5e21-42e7-9481-7c8b3c1f6f48 tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.287s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:08 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-4b616079-5e21-42e7-9481-7c8b3c1f6f48 tempest-ProjectReaderTests-1672117553 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:04:08 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-4b616079-5e21-42e7-9481-7c8b3c1f6f48 tempest-ProjectReaderTests-1672117553 None] Deleted volume successfully.
Nov 06 12:04:08 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-4b616079-5e21-42e7-9481-7c8b3c1f6f48 tempest-ProjectReaderTests-1672117553 None] Lock "cinder-7fd7b759-7e6d-43ef-8fcb-666feb240708-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:08 devstack sudo[108407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fff7d340-173f-47db-89ec-6e76eaed85c0
Nov 06 12:04:08 devstack sudo[108407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:08 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-9592e558-40c6-4847-81d1-5b05420f6db2 tempest-ProjectReaderTests-1672117553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:04:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9592e558-40c6-4847-81d1-5b05420f6db2 tempest-ProjectReaderTests-1672117553 None] Flow 'volume_create_manager' (480c109c-d20d-4b19-82c9-4227a63c781f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:04:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9592e558-40c6-4847-81d1-5b05420f6db2 tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47999a50-bc7d-4473-98e5-620dd6f19f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:08 devstack sudo[108407]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d920f28f-8aad-4231-9c45-766c55746cfe tempest-CinderUnicodeTest-1590578926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fff7d340-173f-47db-89ec-6e76eaed85c0" returned: 0 in 0.510s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d920f28f-8aad-4231-9c45-766c55746cfe tempest-CinderUnicodeTest-1590578926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fff7d340-173f-47db-89ec-6e76eaed85c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fff7d340-173f-47db-89ec-6e76eaed85c0.9af18404-1c4f-4329-ab93-252d56e2d024 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9592e558-40c6-4847-81d1-5b05420f6db2 tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47999a50-bc7d-4473-98e5-620dd6f19f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1701904602',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a98cdff-0626-4dfd-a398-da334d11c547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c737f6ee48a4d11a061314cd20da265',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:04:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:04:08Z,use_quota=True,user_id='7695e7d99bd24749a219f86885bd0d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9592e558-40c6-4847-81d1-5b05420f6db2 tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce417dba-631c-4b45-a314-d15c81373ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:08 devstack sudo[108413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fff7d340-173f-47db-89ec-6e76eaed85c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fff7d340-173f-47db-89ec-6e76eaed85c0.9af18404-1c4f-4329-ab93-252d56e2d024 1G
Nov 06 12:04:08 devstack sudo[108413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9592e558-40c6-4847-81d1-5b05420f6db2 tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce417dba-631c-4b45-a314-d15c81373ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9592e558-40c6-4847-81d1-5b05420f6db2 tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d56548c6-e356-41d2-bb1a-bcee9d40cd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9592e558-40c6-4847-81d1-5b05420f6db2 tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d56548c6-e356-41d2-bb1a-bcee9d40cd01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a98cdff-0626-4dfd-a398-da334d11c547', 'volume_name': 'volume-2a98cdff-0626-4dfd-a398-da334d11c547', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9592e558-40c6-4847-81d1-5b05420f6db2 tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa3dc5a1-f3dd-4623-bdce-fc300373b821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9592e558-40c6-4847-81d1-5b05420f6db2 tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa3dc5a1-f3dd-4623-bdce-fc300373b821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9592e558-40c6-4847-81d1-5b05420f6db2 tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd567253-6d3c-481d-853e-d78bc3ddca02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:08 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-9592e558-40c6-4847-81d1-5b05420f6db2 tempest-ProjectReaderTests-1672117553 None] Volume 2a98cdff-0626-4dfd-a398-da334d11c547: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a98cdff-0626-4dfd-a398-da334d11c547', 'volume_size': 1}
Nov 06 12:04:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9592e558-40c6-4847-81d1-5b05420f6db2 tempest-ProjectReaderTests-1672117553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:09 devstack sudo[108413]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:09 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d920f28f-8aad-4231-9c45-766c55746cfe tempest-CinderUnicodeTest-1590578926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fff7d340-173f-47db-89ec-6e76eaed85c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fff7d340-173f-47db-89ec-6e76eaed85c0.9af18404-1c4f-4329-ab93-252d56e2d024 1G" returned: 0 in 0.492s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:09 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d920f28f-8aad-4231-9c45-766c55746cfe tempest-CinderUnicodeTest-1590578926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fff7d340-173f-47db-89ec-6e76eaed85c0 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fff7d340-173f-47db-89ec-6e76eaed85c0.9af18404-1c4f-4329-ab93-252d56e2d024 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:09 devstack sudo[108419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fff7d340-173f-47db-89ec-6e76eaed85c0 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fff7d340-173f-47db-89ec-6e76eaed85c0.9af18404-1c4f-4329-ab93-252d56e2d024
Nov 06 12:04:09 devstack sudo[108419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:09 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-713a99fd-9b77-4129-be1f-c0023ab03ce0 tempest-ProjectReaderTests-1070449080 None] Acquiring lock "cinder-eb793203-f84d-4e4b-8aa2-f51d0aaa7046-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:09 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-713a99fd-9b77-4129-be1f-c0023ab03ce0 tempest-ProjectReaderTests-1070449080 None] Lock "cinder-eb793203-f84d-4e4b-8aa2-f51d0aaa7046-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:09 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-713a99fd-9b77-4129-be1f-c0023ab03ce0 tempest-ProjectReaderTests-1070449080 None] Acquiring lock "cinder-quobyte-eb793203-f84d-4e4b-8aa2-f51d0aaa7046" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:09 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-713a99fd-9b77-4129-be1f-c0023ab03ce0 tempest-ProjectReaderTests-1070449080 None] Lock "cinder-quobyte-eb793203-f84d-4e4b-8aa2-f51d0aaa7046" acquired by "delete_volume" :: waited 0.016s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:09 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a32cfa-5e3d-4e09-ba79-58b01bd1bcd7]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:04:09 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-713a99fd-9b77-4129-be1f-c0023ab03ce0 tempest-ProjectReaderTests-1070449080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-eb793203-f84d-4e4b-8aa2-f51d0aaa7046 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:09 devstack sudo[108421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-eb793203-f84d-4e4b-8aa2-f51d0aaa7046
Nov 06 12:04:09 devstack sudo[108421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:09 devstack sudo[108419]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:09 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d920f28f-8aad-4231-9c45-766c55746cfe tempest-CinderUnicodeTest-1590578926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fff7d340-173f-47db-89ec-6e76eaed85c0 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fff7d340-173f-47db-89ec-6e76eaed85c0.9af18404-1c4f-4329-ab93-252d56e2d024" returned: 0 in 0.408s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:09 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-d920f28f-8aad-4231-9c45-766c55746cfe tempest-CinderUnicodeTest-1590578926 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fff7d340-173f-47db-89ec-6e76eaed85c0.9af18404-1c4f-4329-ab93-252d56e2d024 is being set with open permissions: ugo+rw
Nov 06 12:04:09 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d920f28f-8aad-4231-9c45-766c55746cfe tempest-CinderUnicodeTest-1590578926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fff7d340-173f-47db-89ec-6e76eaed85c0.9af18404-1c4f-4329-ab93-252d56e2d024 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:09 devstack sudo[108426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fff7d340-173f-47db-89ec-6e76eaed85c0.9af18404-1c4f-4329-ab93-252d56e2d024
Nov 06 12:04:09 devstack sudo[108426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:09 devstack sudo[108421]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:09 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-713a99fd-9b77-4129-be1f-c0023ab03ce0 tempest-ProjectReaderTests-1070449080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-eb793203-f84d-4e4b-8aa2-f51d0aaa7046" returned: 0 in 0.410s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:09 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-713a99fd-9b77-4129-be1f-c0023ab03ce0 tempest-ProjectReaderTests-1070449080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-eb793203-f84d-4e4b-8aa2-f51d0aaa7046 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:09 devstack sudo[108432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-eb793203-f84d-4e4b-8aa2-f51d0aaa7046
Nov 06 12:04:09 devstack sudo[108432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:09 devstack sudo[108426]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:09 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d920f28f-8aad-4231-9c45-766c55746cfe tempest-CinderUnicodeTest-1590578926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fff7d340-173f-47db-89ec-6e76eaed85c0.9af18404-1c4f-4329-ab93-252d56e2d024" returned: 0 in 0.295s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:09 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d920f28f-8aad-4231-9c45-766c55746cfe tempest-CinderUnicodeTest-1590578926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fff7d340-173f-47db-89ec-6e76eaed85c0.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:09 devstack sudo[108435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fff7d340-173f-47db-89ec-6e76eaed85c0.info
Nov 06 12:04:09 devstack sudo[108435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:09 devstack sudo[108432]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:09 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-713a99fd-9b77-4129-be1f-c0023ab03ce0 tempest-ProjectReaderTests-1070449080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-eb793203-f84d-4e4b-8aa2-f51d0aaa7046" returned: 0 in 0.294s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:09 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-713a99fd-9b77-4129-be1f-c0023ab03ce0 tempest-ProjectReaderTests-1070449080 None] Lock "cinder-quobyte-eb793203-f84d-4e4b-8aa2-f51d0aaa7046" released by "delete_volume" :: held 0.768s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:10 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-713a99fd-9b77-4129-be1f-c0023ab03ce0 tempest-ProjectReaderTests-1070449080 None] Created reservations ['6b73f65d-5bbe-488b-a345-cfe2af03c0f7', 'd244cc71-a85d-4617-8a03-04976a28b161', 'ef1c6f37-21bb-427b-b99d-9839ad7f9e1d', '79714e0e-545b-46f5-8303-4995311123ba'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:04:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-713a99fd-9b77-4129-be1f-c0023ab03ce0 tempest-ProjectReaderTests-1070449080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-713a99fd-9b77-4129-be1f-c0023ab03ce0 tempest-ProjectReaderTests-1070449080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:10 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-713a99fd-9b77-4129-be1f-c0023ab03ce0 tempest-ProjectReaderTests-1070449080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:04:10 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-713a99fd-9b77-4129-be1f-c0023ab03ce0 tempest-ProjectReaderTests-1070449080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:04:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-713a99fd-9b77-4129-be1f-c0023ab03ce0 tempest-ProjectReaderTests-1070449080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-713a99fd-9b77-4129-be1f-c0023ab03ce0 tempest-ProjectReaderTests-1070449080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:10 devstack sudo[108435]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d920f28f-8aad-4231-9c45-766c55746cfe tempest-CinderUnicodeTest-1590578926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fff7d340-173f-47db-89ec-6e76eaed85c0.info" returned: 0 in 0.304s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:10 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-d920f28f-8aad-4231-9c45-766c55746cfe tempest-CinderUnicodeTest-1590578926 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fff7d340-173f-47db-89ec-6e76eaed85c0.info is being set with open permissions: ugo+rw
Nov 06 12:04:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d920f28f-8aad-4231-9c45-766c55746cfe tempest-CinderUnicodeTest-1590578926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fff7d340-173f-47db-89ec-6e76eaed85c0.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:10 devstack sudo[108439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:04:10 devstack sudo[108439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:10 devstack sudo[108440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fff7d340-173f-47db-89ec-6e76eaed85c0.info
Nov 06 12:04:10 devstack sudo[108440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:10 devstack sudo[108439]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-713a99fd-9b77-4129-be1f-c0023ab03ce0 tempest-ProjectReaderTests-1070449080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.291s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:10 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-713a99fd-9b77-4129-be1f-c0023ab03ce0 tempest-ProjectReaderTests-1070449080 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:04:10 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-713a99fd-9b77-4129-be1f-c0023ab03ce0 tempest-ProjectReaderTests-1070449080 None] Deleted volume successfully.
Nov 06 12:04:10 devstack sudo[108440]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d920f28f-8aad-4231-9c45-766c55746cfe tempest-CinderUnicodeTest-1590578926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fff7d340-173f-47db-89ec-6e76eaed85c0.info" returned: 0 in 0.305s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d920f28f-8aad-4231-9c45-766c55746cfe tempest-CinderUnicodeTest-1590578926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.470s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:10 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-713a99fd-9b77-4129-be1f-c0023ab03ce0 tempest-ProjectReaderTests-1070449080 None] Lock "cinder-eb793203-f84d-4e4b-8aa2-f51d0aaa7046-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9592e558-40c6-4847-81d1-5b05420f6db2 tempest-ProjectReaderTests-1672117553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.837s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:10 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-9592e558-40c6-4847-81d1-5b05420f6db2 tempest-ProjectReaderTests-1672117553 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1701904602',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a98cdff-0626-4dfd-a398-da334d11c547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c737f6ee48a4d11a061314cd20da265',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:04:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:04:08Z,use_quota=True,user_id='7695e7d99bd24749a219f86885bd0d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:04:10 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-9592e558-40c6-4847-81d1-5b05420f6db2 tempest-ProjectReaderTests-1672117553 None] Creating volume 2a98cdff-0626-4dfd-a398-da334d11c547 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:04:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9592e558-40c6-4847-81d1-5b05420f6db2 tempest-ProjectReaderTests-1672117553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9592e558-40c6-4847-81d1-5b05420f6db2 tempest-ProjectReaderTests-1672117553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:10 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-9592e558-40c6-4847-81d1-5b05420f6db2 tempest-ProjectReaderTests-1672117553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:04:10 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-9592e558-40c6-4847-81d1-5b05420f6db2 tempest-ProjectReaderTests-1672117553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:04:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9592e558-40c6-4847-81d1-5b05420f6db2 tempest-ProjectReaderTests-1672117553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:10 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-9592e558-40c6-4847-81d1-5b05420f6db2 tempest-ProjectReaderTests-1672117553 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:04:10 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-9592e558-40c6-4847-81d1-5b05420f6db2 tempest-ProjectReaderTests-1672117553 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:04:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9592e558-40c6-4847-81d1-5b05420f6db2 tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2a98cdff-0626-4dfd-a398-da334d11c547 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:10 devstack sudo[108445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2a98cdff-0626-4dfd-a398-da334d11c547 1073741824
Nov 06 12:04:10 devstack sudo[108445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:10 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-d920f28f-8aad-4231-9c45-766c55746cfe tempest-CinderUnicodeTest-1590578926 None] Create snapshot completed successfully
Nov 06 12:04:10 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fcc5155-9d53-4f9b-9f8c-efc39bdfef64 tempest-ProjectReaderTests-1070449080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:04:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3fcc5155-9d53-4f9b-9f8c-efc39bdfef64 tempest-ProjectReaderTests-1070449080 None] Flow 'volume_create_manager' (04027b25-2997-4337-a81f-f382675643ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:04:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3fcc5155-9d53-4f9b-9f8c-efc39bdfef64 tempest-ProjectReaderTests-1070449080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d04c328d-a70e-4301-9ef3-8b3603791ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3fcc5155-9d53-4f9b-9f8c-efc39bdfef64 tempest-ProjectReaderTests-1070449080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d04c328d-a70e-4301-9ef3-8b3603791ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1190711818',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=543e8804-485b-4c4d-b182-0a21776feeaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c13e3cc25924935a60f5a96ce9b3eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:04:11Z,use_quota=True,user_id='18a7d2dabd13418f829055cfd8f03f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3fcc5155-9d53-4f9b-9f8c-efc39bdfef64 tempest-ProjectReaderTests-1070449080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (651c857f-dc4d-4503-9593-76d4157dc0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3fcc5155-9d53-4f9b-9f8c-efc39bdfef64 tempest-ProjectReaderTests-1070449080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (651c857f-dc4d-4503-9593-76d4157dc0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3fcc5155-9d53-4f9b-9f8c-efc39bdfef64 tempest-ProjectReaderTests-1070449080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6194317e-eb74-4df0-9a41-a51f935cfe81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3fcc5155-9d53-4f9b-9f8c-efc39bdfef64 tempest-ProjectReaderTests-1070449080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6194317e-eb74-4df0-9a41-a51f935cfe81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '543e8804-485b-4c4d-b182-0a21776feeaa', 'volume_name': 'volume-543e8804-485b-4c4d-b182-0a21776feeaa', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3fcc5155-9d53-4f9b-9f8c-efc39bdfef64 tempest-ProjectReaderTests-1070449080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c157997a-80da-4be2-bba5-6536fad3e7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3fcc5155-9d53-4f9b-9f8c-efc39bdfef64 tempest-ProjectReaderTests-1070449080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c157997a-80da-4be2-bba5-6536fad3e7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:10 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3fcc5155-9d53-4f9b-9f8c-efc39bdfef64 tempest-ProjectReaderTests-1070449080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08d5328b-de96-4bca-8e33-4c8723fce81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:10 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-3fcc5155-9d53-4f9b-9f8c-efc39bdfef64 tempest-ProjectReaderTests-1070449080 None] Volume 543e8804-485b-4c4d-b182-0a21776feeaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-543e8804-485b-4c4d-b182-0a21776feeaa', 'volume_size': 1}
Nov 06 12:04:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3fcc5155-9d53-4f9b-9f8c-efc39bdfef64 tempest-ProjectReaderTests-1070449080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:10 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-62259a91-15e8-4f6c-9aa1-491ae73c7545 tempest-CinderUnicodeTest-1590578926 None] Acquiring lock "cinder-9af18404-1c4f-4329-ab93-252d56e2d024-delete_snapshot" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:10 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-62259a91-15e8-4f6c-9aa1-491ae73c7545 tempest-CinderUnicodeTest-1590578926 None] Lock "cinder-9af18404-1c4f-4329-ab93-252d56e2d024-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:10 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-62259a91-15e8-4f6c-9aa1-491ae73c7545 tempest-CinderUnicodeTest-1590578926 None] Acquiring lock "cinder-quobyte-fff7d340-173f-47db-89ec-6e76eaed85c0" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:11 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-62259a91-15e8-4f6c-9aa1-491ae73c7545 tempest-CinderUnicodeTest-1590578926 None] Lock "cinder-quobyte-fff7d340-173f-47db-89ec-6e76eaed85c0" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:11 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-62259a91-15e8-4f6c-9aa1-491ae73c7545 tempest-CinderUnicodeTest-1590578926 None] Acquiring lock "cinder-quobyte-9af18404-1c4f-4329-ab93-252d56e2d024" by "_delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:11 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-62259a91-15e8-4f6c-9aa1-491ae73c7545 tempest-CinderUnicodeTest-1590578926 None] Lock "cinder-quobyte-9af18404-1c4f-4329-ab93-252d56e2d024" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:11 devstack sudo[108445]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:11 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-62259a91-15e8-4f6c-9aa1-491ae73c7545 tempest-CinderUnicodeTest-1590578926 None] Deleting offline snapshot 9af18404-1c4f-4329-ab93-252d56e2d024 of volume fff7d340-173f-47db-89ec-6e76eaed85c0 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 12:04:11 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-62259a91-15e8-4f6c-9aa1-491ae73c7545 tempest-CinderUnicodeTest-1590578926 None] snapshot_file for this snap is: volume-fff7d340-173f-47db-89ec-6e76eaed85c0.9af18404-1c4f-4329-ab93-252d56e2d024 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 12:04:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9592e558-40c6-4847-81d1-5b05420f6db2 tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2a98cdff-0626-4dfd-a398-da334d11c547 1073741824" returned: 0 in 0.574s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:11 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dae23e4-7f7f-441f-8414-156e3a0e65f8]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:04:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-62259a91-15e8-4f6c-9aa1-491ae73c7545 tempest-CinderUnicodeTest-1590578926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fff7d340-173f-47db-89ec-6e76eaed85c0.9af18404-1c4f-4329-ab93-252d56e2d024 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9592e558-40c6-4847-81d1-5b05420f6db2 tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2a98cdff-0626-4dfd-a398-da334d11c547 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:11 devstack sudo[108452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2a98cdff-0626-4dfd-a398-da334d11c547
Nov 06 12:04:11 devstack sudo[108452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:11 devstack sudo[108451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fff7d340-173f-47db-89ec-6e76eaed85c0.9af18404-1c4f-4329-ab93-252d56e2d024
Nov 06 12:04:11 devstack sudo[108451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:11 devstack sudo[108452]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-9592e558-40c6-4847-81d1-5b05420f6db2 tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2a98cdff-0626-4dfd-a398-da334d11c547" returned: 0 in 0.287s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:11 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-9592e558-40c6-4847-81d1-5b05420f6db2 tempest-ProjectReaderTests-1672117553 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:04:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-9592e558-40c6-4847-81d1-5b05420f6db2 tempest-ProjectReaderTests-1672117553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3fcc5155-9d53-4f9b-9f8c-efc39bdfef64 tempest-ProjectReaderTests-1070449080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.477s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:11 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-3fcc5155-9d53-4f9b-9f8c-efc39bdfef64 tempest-ProjectReaderTests-1070449080 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1190711818',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=543e8804-485b-4c4d-b182-0a21776feeaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c13e3cc25924935a60f5a96ce9b3eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:04:11Z,use_quota=True,user_id='18a7d2dabd13418f829055cfd8f03f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:04:11 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-3fcc5155-9d53-4f9b-9f8c-efc39bdfef64 tempest-ProjectReaderTests-1070449080 None] Creating volume 543e8804-485b-4c4d-b182-0a21776feeaa {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:04:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3fcc5155-9d53-4f9b-9f8c-efc39bdfef64 tempest-ProjectReaderTests-1070449080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3fcc5155-9d53-4f9b-9f8c-efc39bdfef64 tempest-ProjectReaderTests-1070449080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:11 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-3fcc5155-9d53-4f9b-9f8c-efc39bdfef64 tempest-ProjectReaderTests-1070449080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:04:11 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-3fcc5155-9d53-4f9b-9f8c-efc39bdfef64 tempest-ProjectReaderTests-1070449080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:04:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3fcc5155-9d53-4f9b-9f8c-efc39bdfef64 tempest-ProjectReaderTests-1070449080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:11 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-3fcc5155-9d53-4f9b-9f8c-efc39bdfef64 tempest-ProjectReaderTests-1070449080 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:04:11 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-3fcc5155-9d53-4f9b-9f8c-efc39bdfef64 tempest-ProjectReaderTests-1070449080 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:04:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3fcc5155-9d53-4f9b-9f8c-efc39bdfef64 tempest-ProjectReaderTests-1070449080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-543e8804-485b-4c4d-b182-0a21776feeaa 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:11 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9592e558-40c6-4847-81d1-5b05420f6db2 tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd567253-6d3c-481d-853e-d78bc3ddca02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a98cdff-0626-4dfd-a398-da334d11c547', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:11 devstack sudo[108458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-543e8804-485b-4c4d-b182-0a21776feeaa 1073741824
Nov 06 12:04:11 devstack sudo[108458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:11 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9592e558-40c6-4847-81d1-5b05420f6db2 tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d34778c-b60b-46bf-b0c5-cb03638a026d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:11 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-9592e558-40c6-4847-81d1-5b05420f6db2 tempest-ProjectReaderTests-1672117553 None] Volume volume-2a98cdff-0626-4dfd-a398-da334d11c547 (2a98cdff-0626-4dfd-a398-da334d11c547): created successfully
Nov 06 12:04:11 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9592e558-40c6-4847-81d1-5b05420f6db2 tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d34778c-b60b-46bf-b0c5-cb03638a026d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:11 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-9592e558-40c6-4847-81d1-5b05420f6db2 tempest-ProjectReaderTests-1672117553 None] Flow 'volume_create_manager' (480c109c-d20d-4b19-82c9-4227a63c781f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:04:11 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-9592e558-40c6-4847-81d1-5b05420f6db2 tempest-ProjectReaderTests-1672117553 None] Created volume successfully.
Nov 06 12:04:11 devstack sudo[108451]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-62259a91-15e8-4f6c-9aa1-491ae73c7545 tempest-CinderUnicodeTest-1590578926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fff7d340-173f-47db-89ec-6e76eaed85c0.9af18404-1c4f-4329-ab93-252d56e2d024" returned: 0 in 0.452s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:11 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-62259a91-15e8-4f6c-9aa1-491ae73c7545 tempest-CinderUnicodeTest-1590578926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fff7d340-173f-47db-89ec-6e76eaed85c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 12:04:11 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e77fda9-0512-4945-9d7f-96d5935c0b68]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:04:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-62259a91-15e8-4f6c-9aa1-491ae73c7545 tempest-CinderUnicodeTest-1590578926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fff7d340-173f-47db-89ec-6e76eaed85c0 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:11 devstack sudo[108461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fff7d340-173f-47db-89ec-6e76eaed85c0
Nov 06 12:04:11 devstack sudo[108461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-97274b91-835a-4614-be0f-3c75f41f9cd1 tempest-ProjectReaderTests-1672117553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:12 devstack sudo[108458]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3fcc5155-9d53-4f9b-9f8c-efc39bdfef64 tempest-ProjectReaderTests-1070449080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-543e8804-485b-4c4d-b182-0a21776feeaa 1073741824" returned: 0 in 0.610s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3fcc5155-9d53-4f9b-9f8c-efc39bdfef64 tempest-ProjectReaderTests-1070449080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-543e8804-485b-4c4d-b182-0a21776feeaa {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:12 devstack sudo[108461]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-62259a91-15e8-4f6c-9aa1-491ae73c7545 tempest-CinderUnicodeTest-1590578926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fff7d340-173f-47db-89ec-6e76eaed85c0" returned: 0 in 0.547s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-62259a91-15e8-4f6c-9aa1-491ae73c7545 tempest-CinderUnicodeTest-1590578926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fff7d340-173f-47db-89ec-6e76eaed85c0.9af18404-1c4f-4329-ab93-252d56e2d024 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:12 devstack sudo[108470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-543e8804-485b-4c4d-b182-0a21776feeaa
Nov 06 12:04:12 devstack sudo[108470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:12 devstack sudo[108471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fff7d340-173f-47db-89ec-6e76eaed85c0.9af18404-1c4f-4329-ab93-252d56e2d024
Nov 06 12:04:12 devstack sudo[108471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:12 devstack sudo[108470]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3fcc5155-9d53-4f9b-9f8c-efc39bdfef64 tempest-ProjectReaderTests-1070449080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-543e8804-485b-4c4d-b182-0a21776feeaa" returned: 0 in 0.266s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:12 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-3fcc5155-9d53-4f9b-9f8c-efc39bdfef64 tempest-ProjectReaderTests-1070449080 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:04:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3fcc5155-9d53-4f9b-9f8c-efc39bdfef64 tempest-ProjectReaderTests-1070449080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-97274b91-835a-4614-be0f-3c75f41f9cd1 tempest-ProjectReaderTests-1672117553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.482s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:12 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3fcc5155-9d53-4f9b-9f8c-efc39bdfef64 tempest-ProjectReaderTests-1070449080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08d5328b-de96-4bca-8e33-4c8723fce81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-543e8804-485b-4c4d-b182-0a21776feeaa', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:12 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3fcc5155-9d53-4f9b-9f8c-efc39bdfef64 tempest-ProjectReaderTests-1070449080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94fde953-9957-47d7-9b4c-f6dbe31f8b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:12 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-97274b91-835a-4614-be0f-3c75f41f9cd1 tempest-ProjectReaderTests-1672117553 None] Creating offline snapshot e213cb98-6e52-474d-8cb6-e1ee2d6560b3 of volume 2a98cdff-0626-4dfd-a398-da334d11c547 {{(pid=87165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 12:04:12 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-3fcc5155-9d53-4f9b-9f8c-efc39bdfef64 tempest-ProjectReaderTests-1070449080 None] Volume volume-543e8804-485b-4c4d-b182-0a21776feeaa (543e8804-485b-4c4d-b182-0a21776feeaa): created successfully
Nov 06 12:04:12 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3fcc5155-9d53-4f9b-9f8c-efc39bdfef64 tempest-ProjectReaderTests-1070449080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94fde953-9957-47d7-9b4c-f6dbe31f8b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:12 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3fcc5155-9d53-4f9b-9f8c-efc39bdfef64 tempest-ProjectReaderTests-1070449080 None] Flow 'volume_create_manager' (04027b25-2997-4337-a81f-f382675643ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:04:12 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[32cc9643-3dbb-4123-90ff-b55546e7c112]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:04:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-97274b91-835a-4614-be0f-3c75f41f9cd1 tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2a98cdff-0626-4dfd-a398-da334d11c547 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:12 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-3fcc5155-9d53-4f9b-9f8c-efc39bdfef64 tempest-ProjectReaderTests-1070449080 None] Created volume successfully.
Nov 06 12:04:12 devstack sudo[108471]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-62259a91-15e8-4f6c-9aa1-491ae73c7545 tempest-CinderUnicodeTest-1590578926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fff7d340-173f-47db-89ec-6e76eaed85c0.9af18404-1c4f-4329-ab93-252d56e2d024" returned: 0 in 0.413s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-62259a91-15e8-4f6c-9aa1-491ae73c7545 tempest-CinderUnicodeTest-1590578926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fff7d340-173f-47db-89ec-6e76eaed85c0.9af18404-1c4f-4329-ab93-252d56e2d024 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:12 devstack sudo[108487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fff7d340-173f-47db-89ec-6e76eaed85c0.9af18404-1c4f-4329-ab93-252d56e2d024
Nov 06 12:04:12 devstack sudo[108487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:12 devstack sudo[108479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2a98cdff-0626-4dfd-a398-da334d11c547
Nov 06 12:04:12 devstack sudo[108479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:12 devstack sudo[108487]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-62259a91-15e8-4f6c-9aa1-491ae73c7545 tempest-CinderUnicodeTest-1590578926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fff7d340-173f-47db-89ec-6e76eaed85c0.9af18404-1c4f-4329-ab93-252d56e2d024" returned: 0 in 0.302s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:12 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-62259a91-15e8-4f6c-9aa1-491ae73c7545 tempest-CinderUnicodeTest-1590578926 None] Lock "cinder-quobyte-9af18404-1c4f-4329-ab93-252d56e2d024" released by "_delete_snapshot" :: held 1.849s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:12 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-62259a91-15e8-4f6c-9aa1-491ae73c7545 tempest-CinderUnicodeTest-1590578926 None] Lock "cinder-quobyte-fff7d340-173f-47db-89ec-6e76eaed85c0" released by "delete_snapshot" :: held 1.879s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:12 devstack sudo[108479]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-97274b91-835a-4614-be0f-3c75f41f9cd1 tempest-ProjectReaderTests-1672117553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2a98cdff-0626-4dfd-a398-da334d11c547" returned: 0 in 0.498s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-97274b91-835a-4614-be0f-3c75f41f9cd1 tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2a98cdff-0626-4dfd-a398-da334d11c547,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2a98cdff-0626-4dfd-a398-da334d11c547.e213cb98-6e52-474d-8cb6-e1ee2d6560b3 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:12 devstack sudo[108523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2a98cdff-0626-4dfd-a398-da334d11c547,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2a98cdff-0626-4dfd-a398-da334d11c547.e213cb98-6e52-474d-8cb6-e1ee2d6560b3 1G
Nov 06 12:04:12 devstack sudo[108523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:13 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-62259a91-15e8-4f6c-9aa1-491ae73c7545 tempest-CinderUnicodeTest-1590578926 None] Created reservations ['f876d077-660a-42c5-a4f4-9d33bb6c8786', '22eee8ed-d597-497b-867e-8f21018cd8be', '4f093348-e2b7-422f-b9c2-3453c88af2df', 'ab946314-5539-4062-8eb1-d38194d8d069'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:04:13 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-62259a91-15e8-4f6c-9aa1-491ae73c7545 tempest-CinderUnicodeTest-1590578926 None] Delete snapshot completed successfully.
Nov 06 12:04:13 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-62259a91-15e8-4f6c-9aa1-491ae73c7545 tempest-CinderUnicodeTest-1590578926 None] Lock "cinder-9af18404-1c4f-4329-ab93-252d56e2d024-delete_snapshot" released by "delete_snapshot" :: held 2.136s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:13 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-83e1e511-10c6-4126-af50-03ed186c235e tempest-ProjectReaderTests-1070449080 None] Acquiring lock "cinder-543e8804-485b-4c4d-b182-0a21776feeaa-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:13 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-83e1e511-10c6-4126-af50-03ed186c235e tempest-ProjectReaderTests-1070449080 None] Lock "cinder-543e8804-485b-4c4d-b182-0a21776feeaa-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:13 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c3a67f8d-6012-487e-aa80-8475a551fb0f tempest-CinderUnicodeTest-1590578926 None] Acquiring lock "cinder-fff7d340-173f-47db-89ec-6e76eaed85c0-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:13 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c3a67f8d-6012-487e-aa80-8475a551fb0f tempest-CinderUnicodeTest-1590578926 None] Lock "cinder-fff7d340-173f-47db-89ec-6e76eaed85c0-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:13 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-83e1e511-10c6-4126-af50-03ed186c235e tempest-ProjectReaderTests-1070449080 None] Acquiring lock "cinder-quobyte-543e8804-485b-4c4d-b182-0a21776feeaa" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:13 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-83e1e511-10c6-4126-af50-03ed186c235e tempest-ProjectReaderTests-1070449080 None] Lock "cinder-quobyte-543e8804-485b-4c4d-b182-0a21776feeaa" acquired by "delete_volume" :: waited 0.032s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:13 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[938dda39-13b0-41e2-8ce5-3fe45c1ec315]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:04:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-83e1e511-10c6-4126-af50-03ed186c235e tempest-ProjectReaderTests-1070449080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-543e8804-485b-4c4d-b182-0a21776feeaa {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:13 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c3a67f8d-6012-487e-aa80-8475a551fb0f tempest-CinderUnicodeTest-1590578926 None] Acquiring lock "cinder-quobyte-fff7d340-173f-47db-89ec-6e76eaed85c0" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:13 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c3a67f8d-6012-487e-aa80-8475a551fb0f tempest-CinderUnicodeTest-1590578926 None] Lock "cinder-quobyte-fff7d340-173f-47db-89ec-6e76eaed85c0" acquired by "delete_volume" :: waited 0.020s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:13 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afb7cbb-ba7c-4ec7-9e43-234448a1caa2]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:04:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c3a67f8d-6012-487e-aa80-8475a551fb0f tempest-CinderUnicodeTest-1590578926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fff7d340-173f-47db-89ec-6e76eaed85c0 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:13 devstack sudo[108529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-543e8804-485b-4c4d-b182-0a21776feeaa
Nov 06 12:04:13 devstack sudo[108529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:13 devstack sudo[108523]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-97274b91-835a-4614-be0f-3c75f41f9cd1 tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2a98cdff-0626-4dfd-a398-da334d11c547,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2a98cdff-0626-4dfd-a398-da334d11c547.e213cb98-6e52-474d-8cb6-e1ee2d6560b3 1G" returned: 0 in 0.629s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-97274b91-835a-4614-be0f-3c75f41f9cd1 tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a98cdff-0626-4dfd-a398-da334d11c547 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2a98cdff-0626-4dfd-a398-da334d11c547.e213cb98-6e52-474d-8cb6-e1ee2d6560b3 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:13 devstack sudo[108530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fff7d340-173f-47db-89ec-6e76eaed85c0
Nov 06 12:04:13 devstack sudo[108530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:13 devstack sudo[108533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a98cdff-0626-4dfd-a398-da334d11c547 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2a98cdff-0626-4dfd-a398-da334d11c547.e213cb98-6e52-474d-8cb6-e1ee2d6560b3
Nov 06 12:04:13 devstack sudo[108533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:13 devstack sudo[108529]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-83e1e511-10c6-4126-af50-03ed186c235e tempest-ProjectReaderTests-1070449080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-543e8804-485b-4c4d-b182-0a21776feeaa" returned: 0 in 0.508s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-83e1e511-10c6-4126-af50-03ed186c235e tempest-ProjectReaderTests-1070449080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-543e8804-485b-4c4d-b182-0a21776feeaa {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:13 devstack sudo[108543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-543e8804-485b-4c4d-b182-0a21776feeaa
Nov 06 12:04:13 devstack sudo[108543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:13 devstack sudo[108533]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-97274b91-835a-4614-be0f-3c75f41f9cd1 tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a98cdff-0626-4dfd-a398-da334d11c547 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2a98cdff-0626-4dfd-a398-da334d11c547.e213cb98-6e52-474d-8cb6-e1ee2d6560b3" returned: 0 in 0.393s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:13 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-97274b91-835a-4614-be0f-3c75f41f9cd1 tempest-ProjectReaderTests-1672117553 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2a98cdff-0626-4dfd-a398-da334d11c547.e213cb98-6e52-474d-8cb6-e1ee2d6560b3 is being set with open permissions: ugo+rw
Nov 06 12:04:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-97274b91-835a-4614-be0f-3c75f41f9cd1 tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2a98cdff-0626-4dfd-a398-da334d11c547.e213cb98-6e52-474d-8cb6-e1ee2d6560b3 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:13 devstack sudo[108530]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c3a67f8d-6012-487e-aa80-8475a551fb0f tempest-CinderUnicodeTest-1590578926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fff7d340-173f-47db-89ec-6e76eaed85c0" returned: 0 in 0.534s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c3a67f8d-6012-487e-aa80-8475a551fb0f tempest-CinderUnicodeTest-1590578926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fff7d340-173f-47db-89ec-6e76eaed85c0 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:13 devstack sudo[108549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2a98cdff-0626-4dfd-a398-da334d11c547.e213cb98-6e52-474d-8cb6-e1ee2d6560b3
Nov 06 12:04:13 devstack sudo[108549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:14 devstack sudo[108550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fff7d340-173f-47db-89ec-6e76eaed85c0
Nov 06 12:04:14 devstack sudo[108550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:14 devstack sudo[108543]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-83e1e511-10c6-4126-af50-03ed186c235e tempest-ProjectReaderTests-1070449080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-543e8804-485b-4c4d-b182-0a21776feeaa" returned: 0 in 0.302s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:14 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-83e1e511-10c6-4126-af50-03ed186c235e tempest-ProjectReaderTests-1070449080 None] Lock "cinder-quobyte-543e8804-485b-4c4d-b182-0a21776feeaa" released by "delete_volume" :: held 0.872s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:14 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-83e1e511-10c6-4126-af50-03ed186c235e tempest-ProjectReaderTests-1070449080 None] Created reservations ['8169d7be-43a5-43a9-b567-a23023aa8984', '2bf47b1a-cee5-422c-b409-0ec3d85e02f2', '54c57183-d400-4208-afff-8f8f0bd9df87', '2f6d03ef-6252-4a50-87bf-23015d561562'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:04:14 devstack sudo[108550]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:14 devstack sudo[108549]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c3a67f8d-6012-487e-aa80-8475a551fb0f tempest-CinderUnicodeTest-1590578926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fff7d340-173f-47db-89ec-6e76eaed85c0" returned: 0 in 0.303s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-97274b91-835a-4614-be0f-3c75f41f9cd1 tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2a98cdff-0626-4dfd-a398-da334d11c547.e213cb98-6e52-474d-8cb6-e1ee2d6560b3" returned: 0 in 0.348s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:14 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c3a67f8d-6012-487e-aa80-8475a551fb0f tempest-CinderUnicodeTest-1590578926 None] Lock "cinder-quobyte-fff7d340-173f-47db-89ec-6e76eaed85c0" released by "delete_volume" :: held 0.926s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-97274b91-835a-4614-be0f-3c75f41f9cd1 tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2a98cdff-0626-4dfd-a398-da334d11c547.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:14 devstack sudo[108556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2a98cdff-0626-4dfd-a398-da334d11c547.info
Nov 06 12:04:14 devstack sudo[108556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-83e1e511-10c6-4126-af50-03ed186c235e tempest-ProjectReaderTests-1070449080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-83e1e511-10c6-4126-af50-03ed186c235e tempest-ProjectReaderTests-1070449080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:14 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-83e1e511-10c6-4126-af50-03ed186c235e tempest-ProjectReaderTests-1070449080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:04:14 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-83e1e511-10c6-4126-af50-03ed186c235e tempest-ProjectReaderTests-1070449080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:04:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-83e1e511-10c6-4126-af50-03ed186c235e tempest-ProjectReaderTests-1070449080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-83e1e511-10c6-4126-af50-03ed186c235e tempest-ProjectReaderTests-1070449080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:14 devstack sudo[108558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:04:14 devstack sudo[108558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:14 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-c3a67f8d-6012-487e-aa80-8475a551fb0f tempest-CinderUnicodeTest-1590578926 None] Created reservations ['df393b53-bb3b-4430-b560-16e5f84543fb', '881940ac-7e55-4836-80d5-a39f279cd3fd', 'fa3e6956-5d2b-4ddb-bb30-14b148d30f03', '789893c4-0827-488e-8d86-9fd020b9808a'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:04:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c3a67f8d-6012-487e-aa80-8475a551fb0f tempest-CinderUnicodeTest-1590578926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c3a67f8d-6012-487e-aa80-8475a551fb0f tempest-CinderUnicodeTest-1590578926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:14 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-c3a67f8d-6012-487e-aa80-8475a551fb0f tempest-CinderUnicodeTest-1590578926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:04:14 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-c3a67f8d-6012-487e-aa80-8475a551fb0f tempest-CinderUnicodeTest-1590578926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:04:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c3a67f8d-6012-487e-aa80-8475a551fb0f tempest-CinderUnicodeTest-1590578926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c3a67f8d-6012-487e-aa80-8475a551fb0f tempest-CinderUnicodeTest-1590578926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:14 devstack sudo[108560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:04:14 devstack sudo[108560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:14 devstack sudo[108556]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-97274b91-835a-4614-be0f-3c75f41f9cd1 tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2a98cdff-0626-4dfd-a398-da334d11c547.info" returned: 0 in 0.406s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:14 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-97274b91-835a-4614-be0f-3c75f41f9cd1 tempest-ProjectReaderTests-1672117553 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2a98cdff-0626-4dfd-a398-da334d11c547.info is being set with open permissions: ugo+rw
Nov 06 12:04:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-97274b91-835a-4614-be0f-3c75f41f9cd1 tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2a98cdff-0626-4dfd-a398-da334d11c547.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:14 devstack sudo[108558]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-83e1e511-10c6-4126-af50-03ed186c235e tempest-ProjectReaderTests-1070449080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.406s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:14 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-83e1e511-10c6-4126-af50-03ed186c235e tempest-ProjectReaderTests-1070449080 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:04:14 devstack sudo[108564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2a98cdff-0626-4dfd-a398-da334d11c547.info
Nov 06 12:04:14 devstack sudo[108564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:14 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-83e1e511-10c6-4126-af50-03ed186c235e tempest-ProjectReaderTests-1070449080 None] Deleted volume successfully.
Nov 06 12:04:14 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-83e1e511-10c6-4126-af50-03ed186c235e tempest-ProjectReaderTests-1070449080 None] Lock "cinder-543e8804-485b-4c4d-b182-0a21776feeaa-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:14 devstack sudo[108560]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c3a67f8d-6012-487e-aa80-8475a551fb0f tempest-CinderUnicodeTest-1590578926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.402s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:15 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-c3a67f8d-6012-487e-aa80-8475a551fb0f tempest-CinderUnicodeTest-1590578926 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:04:15 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-c3a67f8d-6012-487e-aa80-8475a551fb0f tempest-CinderUnicodeTest-1590578926 None] Deleted volume successfully.
Nov 06 12:04:15 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fd488f3-6dd0-44e0-b5c4-b33a5bb73d59 tempest-ProjectReaderTests-1070449080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:04:15 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6fd488f3-6dd0-44e0-b5c4-b33a5bb73d59 tempest-ProjectReaderTests-1070449080 None] Flow 'volume_create_manager' (0816b794-6604-4091-9da1-bbe3b2348813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:04:15 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6fd488f3-6dd0-44e0-b5c4-b33a5bb73d59 tempest-ProjectReaderTests-1070449080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27432166-3433-4e4d-a379-a5a3cf60e2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:15 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c3a67f8d-6012-487e-aa80-8475a551fb0f tempest-CinderUnicodeTest-1590578926 None] Lock "cinder-fff7d340-173f-47db-89ec-6e76eaed85c0-delete_volume" released by "delete_volume" :: held 1.819s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:15 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6fd488f3-6dd0-44e0-b5c4-b33a5bb73d59 tempest-ProjectReaderTests-1070449080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27432166-3433-4e4d-a379-a5a3cf60e2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-935242235',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d978a51-0a34-413f-8fb0-4113d8681cda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c13e3cc25924935a60f5a96ce9b3eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:04:15Z,use_quota=True,user_id='18a7d2dabd13418f829055cfd8f03f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:15 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6fd488f3-6dd0-44e0-b5c4-b33a5bb73d59 tempest-ProjectReaderTests-1070449080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9eb5c1c-7910-417a-bb89-c09d4ec7fdfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:15 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6fd488f3-6dd0-44e0-b5c4-b33a5bb73d59 tempest-ProjectReaderTests-1070449080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9eb5c1c-7910-417a-bb89-c09d4ec7fdfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:15 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6fd488f3-6dd0-44e0-b5c4-b33a5bb73d59 tempest-ProjectReaderTests-1070449080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f295a0d-9910-4b65-9c08-598dd5d56985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:15 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6fd488f3-6dd0-44e0-b5c4-b33a5bb73d59 tempest-ProjectReaderTests-1070449080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f295a0d-9910-4b65-9c08-598dd5d56985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d978a51-0a34-413f-8fb0-4113d8681cda', 'volume_name': 'volume-1d978a51-0a34-413f-8fb0-4113d8681cda', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:15 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6fd488f3-6dd0-44e0-b5c4-b33a5bb73d59 tempest-ProjectReaderTests-1070449080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82a200bf-5d09-4077-8b2d-744210a98e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:15 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6fd488f3-6dd0-44e0-b5c4-b33a5bb73d59 tempest-ProjectReaderTests-1070449080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82a200bf-5d09-4077-8b2d-744210a98e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:15 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6fd488f3-6dd0-44e0-b5c4-b33a5bb73d59 tempest-ProjectReaderTests-1070449080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64769226-d192-4802-804a-55902beb9e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:15 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-6fd488f3-6dd0-44e0-b5c4-b33a5bb73d59 tempest-ProjectReaderTests-1070449080 None] Volume 1d978a51-0a34-413f-8fb0-4113d8681cda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d978a51-0a34-413f-8fb0-4113d8681cda', 'volume_size': 1}
Nov 06 12:04:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6fd488f3-6dd0-44e0-b5c4-b33a5bb73d59 tempest-ProjectReaderTests-1070449080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:15 devstack sudo[108564]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-97274b91-835a-4614-be0f-3c75f41f9cd1 tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2a98cdff-0626-4dfd-a398-da334d11c547.info" returned: 0 in 0.438s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-97274b91-835a-4614-be0f-3c75f41f9cd1 tempest-ProjectReaderTests-1672117553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.858s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6fd488f3-6dd0-44e0-b5c4-b33a5bb73d59 tempest-ProjectReaderTests-1070449080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.049s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:15 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-6fd488f3-6dd0-44e0-b5c4-b33a5bb73d59 tempest-ProjectReaderTests-1070449080 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-935242235',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d978a51-0a34-413f-8fb0-4113d8681cda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c13e3cc25924935a60f5a96ce9b3eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:04:15Z,use_quota=True,user_id='18a7d2dabd13418f829055cfd8f03f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:04:15 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-6fd488f3-6dd0-44e0-b5c4-b33a5bb73d59 tempest-ProjectReaderTests-1070449080 None] Creating volume 1d978a51-0a34-413f-8fb0-4113d8681cda {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:04:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6fd488f3-6dd0-44e0-b5c4-b33a5bb73d59 tempest-ProjectReaderTests-1070449080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6fd488f3-6dd0-44e0-b5c4-b33a5bb73d59 tempest-ProjectReaderTests-1070449080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:15 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-6fd488f3-6dd0-44e0-b5c4-b33a5bb73d59 tempest-ProjectReaderTests-1070449080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:04:15 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-6fd488f3-6dd0-44e0-b5c4-b33a5bb73d59 tempest-ProjectReaderTests-1070449080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:04:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6fd488f3-6dd0-44e0-b5c4-b33a5bb73d59 tempest-ProjectReaderTests-1070449080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:15 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-6fd488f3-6dd0-44e0-b5c4-b33a5bb73d59 tempest-ProjectReaderTests-1070449080 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:04:15 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-6fd488f3-6dd0-44e0-b5c4-b33a5bb73d59 tempest-ProjectReaderTests-1070449080 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:04:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6fd488f3-6dd0-44e0-b5c4-b33a5bb73d59 tempest-ProjectReaderTests-1070449080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1d978a51-0a34-413f-8fb0-4113d8681cda 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:15 devstack sudo[108569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1d978a51-0a34-413f-8fb0-4113d8681cda 1073741824
Nov 06 12:04:15 devstack sudo[108569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:15 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-97274b91-835a-4614-be0f-3c75f41f9cd1 tempest-ProjectReaderTests-1672117553 None] Create snapshot completed successfully
Nov 06 12:04:15 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-4fa05c16-6d9c-4542-b42d-778b13288273 tempest-CinderUnicodeTest-1590578926 None] Acquiring lock "cinder-c16a7a7c-40d3-4939-ac9e-05476518bdef-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:15 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-4fa05c16-6d9c-4542-b42d-778b13288273 tempest-CinderUnicodeTest-1590578926 None] Lock "cinder-c16a7a7c-40d3-4939-ac9e-05476518bdef-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:15 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-4fa05c16-6d9c-4542-b42d-778b13288273 tempest-CinderUnicodeTest-1590578926 None] Acquiring lock "cinder-quobyte-c16a7a7c-40d3-4939-ac9e-05476518bdef" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:15 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-4fa05c16-6d9c-4542-b42d-778b13288273 tempest-CinderUnicodeTest-1590578926 None] Lock "cinder-quobyte-c16a7a7c-40d3-4939-ac9e-05476518bdef" acquired by "delete_volume" :: waited 0.018s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:15 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c3986b-f513-49fb-9681-5126282a1075]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:04:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4fa05c16-6d9c-4542-b42d-778b13288273 tempest-CinderUnicodeTest-1590578926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c16a7a7c-40d3-4939-ac9e-05476518bdef {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:15 devstack sudo[108569]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6fd488f3-6dd0-44e0-b5c4-b33a5bb73d59 tempest-ProjectReaderTests-1070449080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1d978a51-0a34-413f-8fb0-4113d8681cda 1073741824" returned: 0 in 0.528s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:15 devstack sudo[108575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c16a7a7c-40d3-4939-ac9e-05476518bdef
Nov 06 12:04:15 devstack sudo[108575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6fd488f3-6dd0-44e0-b5c4-b33a5bb73d59 tempest-ProjectReaderTests-1070449080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1d978a51-0a34-413f-8fb0-4113d8681cda {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:15 devstack sudo[108577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1d978a51-0a34-413f-8fb0-4113d8681cda
Nov 06 12:04:15 devstack sudo[108577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:16 devstack sudo[108577]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6fd488f3-6dd0-44e0-b5c4-b33a5bb73d59 tempest-ProjectReaderTests-1070449080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1d978a51-0a34-413f-8fb0-4113d8681cda" returned: 0 in 0.292s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:16 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-6fd488f3-6dd0-44e0-b5c4-b33a5bb73d59 tempest-ProjectReaderTests-1070449080 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:04:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6fd488f3-6dd0-44e0-b5c4-b33a5bb73d59 tempest-ProjectReaderTests-1070449080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:16 devstack sudo[108575]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6fd488f3-6dd0-44e0-b5c4-b33a5bb73d59 tempest-ProjectReaderTests-1070449080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64769226-d192-4802-804a-55902beb9e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d978a51-0a34-413f-8fb0-4113d8681cda', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6fd488f3-6dd0-44e0-b5c4-b33a5bb73d59 tempest-ProjectReaderTests-1070449080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (254e279f-5ddc-4b4f-b405-e635ad8667da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4fa05c16-6d9c-4542-b42d-778b13288273 tempest-CinderUnicodeTest-1590578926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c16a7a7c-40d3-4939-ac9e-05476518bdef" returned: 0 in 0.500s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4fa05c16-6d9c-4542-b42d-778b13288273 tempest-CinderUnicodeTest-1590578926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c16a7a7c-40d3-4939-ac9e-05476518bdef {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:16 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-6fd488f3-6dd0-44e0-b5c4-b33a5bb73d59 tempest-ProjectReaderTests-1070449080 None] Volume volume-1d978a51-0a34-413f-8fb0-4113d8681cda (1d978a51-0a34-413f-8fb0-4113d8681cda): created successfully
Nov 06 12:04:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6fd488f3-6dd0-44e0-b5c4-b33a5bb73d59 tempest-ProjectReaderTests-1070449080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (254e279f-5ddc-4b4f-b405-e635ad8667da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:16 devstack sudo[108583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c16a7a7c-40d3-4939-ac9e-05476518bdef
Nov 06 12:04:16 devstack sudo[108583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6fd488f3-6dd0-44e0-b5c4-b33a5bb73d59 tempest-ProjectReaderTests-1070449080 None] Flow 'volume_create_manager' (0816b794-6604-4091-9da1-bbe3b2348813) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:04:16 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d41756ca-d033-4ca0-8bfb-2e3d6009882c tempest-ProjectReaderTests-1672117553 None] Acquiring lock "cinder-e213cb98-6e52-474d-8cb6-e1ee2d6560b3-delete_snapshot" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:16 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-6fd488f3-6dd0-44e0-b5c4-b33a5bb73d59 tempest-ProjectReaderTests-1070449080 None] Created volume successfully.
Nov 06 12:04:16 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d41756ca-d033-4ca0-8bfb-2e3d6009882c tempest-ProjectReaderTests-1672117553 None] Lock "cinder-e213cb98-6e52-474d-8cb6-e1ee2d6560b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:16 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d41756ca-d033-4ca0-8bfb-2e3d6009882c tempest-ProjectReaderTests-1672117553 None] Acquiring lock "cinder-quobyte-2a98cdff-0626-4dfd-a398-da334d11c547" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:16 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d41756ca-d033-4ca0-8bfb-2e3d6009882c tempest-ProjectReaderTests-1672117553 None] Lock "cinder-quobyte-2a98cdff-0626-4dfd-a398-da334d11c547" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:16 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d41756ca-d033-4ca0-8bfb-2e3d6009882c tempest-ProjectReaderTests-1672117553 None] Acquiring lock "cinder-quobyte-e213cb98-6e52-474d-8cb6-e1ee2d6560b3" by "_delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:16 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d41756ca-d033-4ca0-8bfb-2e3d6009882c tempest-ProjectReaderTests-1672117553 None] Lock "cinder-quobyte-e213cb98-6e52-474d-8cb6-e1ee2d6560b3" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:16 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-d41756ca-d033-4ca0-8bfb-2e3d6009882c tempest-ProjectReaderTests-1672117553 None] Deleting offline snapshot e213cb98-6e52-474d-8cb6-e1ee2d6560b3 of volume 2a98cdff-0626-4dfd-a398-da334d11c547 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 12:04:16 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-d41756ca-d033-4ca0-8bfb-2e3d6009882c tempest-ProjectReaderTests-1672117553 None] snapshot_file for this snap is: volume-2a98cdff-0626-4dfd-a398-da334d11c547.e213cb98-6e52-474d-8cb6-e1ee2d6560b3 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 12:04:16 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0b92b3-006d-4f28-a77c-58452ba9a611]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:04:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d41756ca-d033-4ca0-8bfb-2e3d6009882c tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2a98cdff-0626-4dfd-a398-da334d11c547.e213cb98-6e52-474d-8cb6-e1ee2d6560b3 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:16 devstack sudo[108585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2a98cdff-0626-4dfd-a398-da334d11c547.e213cb98-6e52-474d-8cb6-e1ee2d6560b3
Nov 06 12:04:16 devstack sudo[108585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:16 devstack sudo[108583]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4fa05c16-6d9c-4542-b42d-778b13288273 tempest-CinderUnicodeTest-1590578926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-c16a7a7c-40d3-4939-ac9e-05476518bdef" returned: 0 in 0.356s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:16 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-4fa05c16-6d9c-4542-b42d-778b13288273 tempest-CinderUnicodeTest-1590578926 None] Lock "cinder-quobyte-c16a7a7c-40d3-4939-ac9e-05476518bdef" released by "delete_volume" :: held 0.901s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:16 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-4fa05c16-6d9c-4542-b42d-778b13288273 tempest-CinderUnicodeTest-1590578926 None] Created reservations ['366c86a3-f759-4487-ada2-05da9d01d276', '28474983-899e-4b37-b99d-3652229f000e', 'f2723802-da5f-4c3e-ab22-5c8dfcc5a72c', 'b3271611-1cc0-47bc-a69e-9f353c9231b4'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:04:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4fa05c16-6d9c-4542-b42d-778b13288273 tempest-CinderUnicodeTest-1590578926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4fa05c16-6d9c-4542-b42d-778b13288273 tempest-CinderUnicodeTest-1590578926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:16 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-4fa05c16-6d9c-4542-b42d-778b13288273 tempest-CinderUnicodeTest-1590578926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:04:16 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-4fa05c16-6d9c-4542-b42d-778b13288273 tempest-CinderUnicodeTest-1590578926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:04:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-4fa05c16-6d9c-4542-b42d-778b13288273 tempest-CinderUnicodeTest-1590578926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4fa05c16-6d9c-4542-b42d-778b13288273 tempest-CinderUnicodeTest-1590578926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:16 devstack sudo[108588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:04:16 devstack sudo[108588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:16 devstack sudo[108585]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d41756ca-d033-4ca0-8bfb-2e3d6009882c tempest-ProjectReaderTests-1672117553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2a98cdff-0626-4dfd-a398-da334d11c547.e213cb98-6e52-474d-8cb6-e1ee2d6560b3" returned: 0 in 0.488s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:16 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-d41756ca-d033-4ca0-8bfb-2e3d6009882c tempest-ProjectReaderTests-1672117553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a98cdff-0626-4dfd-a398-da334d11c547(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 12:04:16 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94b97d7-5e9e-4362-954f-6be79b6c2e31]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:04:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d41756ca-d033-4ca0-8bfb-2e3d6009882c tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2a98cdff-0626-4dfd-a398-da334d11c547 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:16 devstack sudo[108588]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-4fa05c16-6d9c-4542-b42d-778b13288273 tempest-CinderUnicodeTest-1590578926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.306s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:16 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-4fa05c16-6d9c-4542-b42d-778b13288273 tempest-CinderUnicodeTest-1590578926 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:04:16 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-4fa05c16-6d9c-4542-b42d-778b13288273 tempest-CinderUnicodeTest-1590578926 None] Deleted volume successfully.
Nov 06 12:04:17 devstack sudo[108593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2a98cdff-0626-4dfd-a398-da334d11c547
Nov 06 12:04:17 devstack sudo[108593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:17 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-4fa05c16-6d9c-4542-b42d-778b13288273 tempest-CinderUnicodeTest-1590578926 None] Lock "cinder-c16a7a7c-40d3-4939-ac9e-05476518bdef-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:17 devstack cinder-volume[87165]: DEBUG oslo_service.periodic_task [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 12:04:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:04:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:04:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:17 devstack sudo[108596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:04:17 devstack sudo[108596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:17 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d37354e6-5571-4494-b87d-6f5c95e434ab tempest-ProjectReaderTests-1070449080 None] Acquiring lock "cinder-1d978a51-0a34-413f-8fb0-4113d8681cda-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:17 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d37354e6-5571-4494-b87d-6f5c95e434ab tempest-ProjectReaderTests-1070449080 None] Lock "cinder-1d978a51-0a34-413f-8fb0-4113d8681cda-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:17 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d37354e6-5571-4494-b87d-6f5c95e434ab tempest-ProjectReaderTests-1070449080 None] Acquiring lock "cinder-quobyte-1d978a51-0a34-413f-8fb0-4113d8681cda" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:17 devstack sudo[108593]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:17 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d37354e6-5571-4494-b87d-6f5c95e434ab tempest-ProjectReaderTests-1070449080 None] Lock "cinder-quobyte-1d978a51-0a34-413f-8fb0-4113d8681cda" acquired by "delete_volume" :: waited 0.033s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d41756ca-d033-4ca0-8bfb-2e3d6009882c tempest-ProjectReaderTests-1672117553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2a98cdff-0626-4dfd-a398-da334d11c547" returned: 0 in 0.602s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d41756ca-d033-4ca0-8bfb-2e3d6009882c tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2a98cdff-0626-4dfd-a398-da334d11c547.e213cb98-6e52-474d-8cb6-e1ee2d6560b3 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:17 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a114d20e-c618-4bc2-9965-0d7c51ecdd4c]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:04:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d37354e6-5571-4494-b87d-6f5c95e434ab tempest-ProjectReaderTests-1070449080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1d978a51-0a34-413f-8fb0-4113d8681cda {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:17 devstack sudo[108601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2a98cdff-0626-4dfd-a398-da334d11c547.e213cb98-6e52-474d-8cb6-e1ee2d6560b3
Nov 06 12:04:17 devstack sudo[108601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:17 devstack sudo[108596]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.408s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:17 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:04:17 devstack cinder-volume[87165]: DEBUG oslo_service.periodic_task [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running periodic task VolumeManager._thread_info {{(pid=87165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 12:04:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] thread count: 29 {{(pid=87165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 12:04:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] thread info: [<_MainThread(MainThread, started 127732956901504)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127732842693056)>, <Thread(Thread-3 (stat_writer), started daemon 127732841891136)>, <Thread(Rabbit-heartbeat, started daemon 127732842515648)>, <Thread(Thread-5 (_runner), started daemon 127732840534464)>, <Thread(Thread-7 (_runner), started daemon 127732840636032)>, <Thread(fd_logger, started daemon 127732838664256)>, <Thread(privsep_reader, started daemon 127732838673408)>, <Thread(tpool_thread_0, started daemon 127732829828800)>, <Thread(tpool_thread_1, started daemon 127732821436096)>, <Thread(tpool_thread_2, started daemon 127732813043392)>, <Thread(tpool_thread_3, started daemon 127732804650688)>, <Thread(tpool_thread_4, started daemon 127732796257984)>, <Thread(tpool_thread_5, started daemon 127732787865280)>, <Thread(tpool_thread_6, started daemon 127732779456192)>, <Thread(tpool_thread_7, started daemon 127732771047104)>, <Thread(tpool_thread_8, started daemon 127732762638016)>, <Thread(tpool_thread_9, started daemon 127732754228928)>, <Thread(tpool_thread_10, started daemon 127732745819840)>, <Thread(tpool_thread_11, started daemon 127732737410752)>, <Thread(tpool_thread_12, started daemon 127732729001664)>, <Thread(tpool_thread_13, started daemon 127732720592576)>, <Thread(tpool_thread_14, started daemon 127732712183488)>, <Thread(tpool_thread_15, started daemon 127732703774400)>, <Thread(tpool_thread_16, started daemon 127732695365312)>, <Thread(tpool_thread_17, started daemon 127732686956224)>, <Thread(tpool_thread_18, started daemon 127732678547136)>, <Thread(tpool_thread_19, started daemon 127732670138048)>, <Thread(Rabbit-heartbeat, started daemon 127732832631296)>] {{(pid=87165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 12:04:17 devstack sudo[108602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1d978a51-0a34-413f-8fb0-4113d8681cda
Nov 06 12:04:17 devstack sudo[108602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:17 devstack sudo[108601]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d41756ca-d033-4ca0-8bfb-2e3d6009882c tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2a98cdff-0626-4dfd-a398-da334d11c547.e213cb98-6e52-474d-8cb6-e1ee2d6560b3" returned: 0 in 0.480s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d41756ca-d033-4ca0-8bfb-2e3d6009882c tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2a98cdff-0626-4dfd-a398-da334d11c547.e213cb98-6e52-474d-8cb6-e1ee2d6560b3 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:17 devstack sudo[108609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2a98cdff-0626-4dfd-a398-da334d11c547.e213cb98-6e52-474d-8cb6-e1ee2d6560b3
Nov 06 12:04:17 devstack sudo[108609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:18 devstack sudo[108602]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d37354e6-5571-4494-b87d-6f5c95e434ab tempest-ProjectReaderTests-1070449080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1d978a51-0a34-413f-8fb0-4113d8681cda" returned: 0 in 0.605s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d37354e6-5571-4494-b87d-6f5c95e434ab tempest-ProjectReaderTests-1070449080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1d978a51-0a34-413f-8fb0-4113d8681cda {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:18 devstack sudo[108614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1d978a51-0a34-413f-8fb0-4113d8681cda
Nov 06 12:04:18 devstack sudo[108614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:18 devstack sudo[108609]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d41756ca-d033-4ca0-8bfb-2e3d6009882c tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2a98cdff-0626-4dfd-a398-da334d11c547.e213cb98-6e52-474d-8cb6-e1ee2d6560b3" returned: 0 in 0.318s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:18 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d41756ca-d033-4ca0-8bfb-2e3d6009882c tempest-ProjectReaderTests-1672117553 None] Lock "cinder-quobyte-e213cb98-6e52-474d-8cb6-e1ee2d6560b3" released by "_delete_snapshot" :: held 2.050s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:18 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d41756ca-d033-4ca0-8bfb-2e3d6009882c tempest-ProjectReaderTests-1672117553 None] Lock "cinder-quobyte-2a98cdff-0626-4dfd-a398-da334d11c547" released by "delete_snapshot" :: held 2.090s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:18 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-d41756ca-d033-4ca0-8bfb-2e3d6009882c tempest-ProjectReaderTests-1672117553 None] Created reservations ['049af353-48d5-484e-9ade-45d27a80f3fc', '50e0214b-5e53-4dc2-8d2a-73b9950cc5df', 'c26c9655-d593-400a-88ea-61f2b0d5f668', '05330c32-92af-4d2f-961b-4c5d11aa5ecf'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:04:18 devstack sudo[108614]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d37354e6-5571-4494-b87d-6f5c95e434ab tempest-ProjectReaderTests-1070449080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-1d978a51-0a34-413f-8fb0-4113d8681cda" returned: 0 in 0.468s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:18 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d37354e6-5571-4494-b87d-6f5c95e434ab tempest-ProjectReaderTests-1070449080 None] Lock "cinder-quobyte-1d978a51-0a34-413f-8fb0-4113d8681cda" released by "delete_volume" :: held 1.146s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:18 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-d41756ca-d033-4ca0-8bfb-2e3d6009882c tempest-ProjectReaderTests-1672117553 None] Delete snapshot completed successfully.
Nov 06 12:04:18 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d41756ca-d033-4ca0-8bfb-2e3d6009882c tempest-ProjectReaderTests-1672117553 None] Lock "cinder-e213cb98-6e52-474d-8cb6-e1ee2d6560b3-delete_snapshot" released by "delete_snapshot" :: held 2.383s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:18 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-d37354e6-5571-4494-b87d-6f5c95e434ab tempest-ProjectReaderTests-1070449080 None] Created reservations ['585f21cc-65f6-4e65-8ee0-d363f7a4cf25', 'd0f272ed-a3f5-4159-8e9a-9a4aaf832600', '2c71580d-1822-4e7b-bec6-51d9bd6f7c2a', '8f3c7f19-092e-40ee-ad0a-d9c41dc50aae'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:04:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d37354e6-5571-4494-b87d-6f5c95e434ab tempest-ProjectReaderTests-1070449080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d37354e6-5571-4494-b87d-6f5c95e434ab tempest-ProjectReaderTests-1070449080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:18 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-d37354e6-5571-4494-b87d-6f5c95e434ab tempest-ProjectReaderTests-1070449080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:04:18 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-d37354e6-5571-4494-b87d-6f5c95e434ab tempest-ProjectReaderTests-1070449080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:04:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-d37354e6-5571-4494-b87d-6f5c95e434ab tempest-ProjectReaderTests-1070449080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d37354e6-5571-4494-b87d-6f5c95e434ab tempest-ProjectReaderTests-1070449080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:18 devstack sudo[108618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:04:18 devstack sudo[108618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:18 devstack sudo[108618]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d37354e6-5571-4494-b87d-6f5c95e434ab tempest-ProjectReaderTests-1070449080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.256s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:18 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-d37354e6-5571-4494-b87d-6f5c95e434ab tempest-ProjectReaderTests-1070449080 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:04:19 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-d37354e6-5571-4494-b87d-6f5c95e434ab tempest-ProjectReaderTests-1070449080 None] Deleted volume successfully.
Nov 06 12:04:19 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d37354e6-5571-4494-b87d-6f5c95e434ab tempest-ProjectReaderTests-1070449080 None] Lock "cinder-1d978a51-0a34-413f-8fb0-4113d8681cda-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:19 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0b2d0d30-4db0-485f-8c32-928daf611576 tempest-ProjectReaderTests-1672117553 None] Acquiring lock "cinder-2a98cdff-0626-4dfd-a398-da334d11c547-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:19 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0b2d0d30-4db0-485f-8c32-928daf611576 tempest-ProjectReaderTests-1672117553 None] Lock "cinder-2a98cdff-0626-4dfd-a398-da334d11c547-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:19 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0b2d0d30-4db0-485f-8c32-928daf611576 tempest-ProjectReaderTests-1672117553 None] Acquiring lock "cinder-quobyte-2a98cdff-0626-4dfd-a398-da334d11c547" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:19 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0b2d0d30-4db0-485f-8c32-928daf611576 tempest-ProjectReaderTests-1672117553 None] Lock "cinder-quobyte-2a98cdff-0626-4dfd-a398-da334d11c547" acquired by "delete_volume" :: waited 0.056s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:19 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f245957-2115-4481-b1d8-cd9edcb3b4f3]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:04:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0b2d0d30-4db0-485f-8c32-928daf611576 tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2a98cdff-0626-4dfd-a398-da334d11c547 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:19 devstack sudo[108621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2a98cdff-0626-4dfd-a398-da334d11c547
Nov 06 12:04:19 devstack sudo[108621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:20 devstack sudo[108621]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0b2d0d30-4db0-485f-8c32-928daf611576 tempest-ProjectReaderTests-1672117553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2a98cdff-0626-4dfd-a398-da334d11c547" returned: 0 in 0.574s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0b2d0d30-4db0-485f-8c32-928daf611576 tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2a98cdff-0626-4dfd-a398-da334d11c547 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:20 devstack sudo[108626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2a98cdff-0626-4dfd-a398-da334d11c547
Nov 06 12:04:20 devstack sudo[108626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:20 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-84a5dbdd-21df-423b-8d8d-d6728f056ba0 tempest-ProjectReaderTests-1070449080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:04:20 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-84a5dbdd-21df-423b-8d8d-d6728f056ba0 tempest-ProjectReaderTests-1070449080 None] Flow 'volume_create_manager' (428c59b6-0e0b-4559-8d22-d928d8b3ac41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:04:20 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-84a5dbdd-21df-423b-8d8d-d6728f056ba0 tempest-ProjectReaderTests-1070449080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (369fa33b-b68a-4afd-a6bf-4eeca8d75301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:20 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-84a5dbdd-21df-423b-8d8d-d6728f056ba0 tempest-ProjectReaderTests-1070449080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (369fa33b-b68a-4afd-a6bf-4eeca8d75301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1504436128',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc4058e3-3fe2-4de1-b81f-3cf6ff527a19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c13e3cc25924935a60f5a96ce9b3eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:04:20Z,use_quota=True,user_id='18a7d2dabd13418f829055cfd8f03f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:20 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-84a5dbdd-21df-423b-8d8d-d6728f056ba0 tempest-ProjectReaderTests-1070449080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1caef07a-3eb5-490a-8eaa-34ed2c684d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:20 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-84a5dbdd-21df-423b-8d8d-d6728f056ba0 tempest-ProjectReaderTests-1070449080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1caef07a-3eb5-490a-8eaa-34ed2c684d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:20 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-84a5dbdd-21df-423b-8d8d-d6728f056ba0 tempest-ProjectReaderTests-1070449080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b77c2f21-ea21-48aa-8a03-f6ef5a3e8c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:20 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-84a5dbdd-21df-423b-8d8d-d6728f056ba0 tempest-ProjectReaderTests-1070449080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b77c2f21-ea21-48aa-8a03-f6ef5a3e8c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc4058e3-3fe2-4de1-b81f-3cf6ff527a19', 'volume_name': 'volume-fc4058e3-3fe2-4de1-b81f-3cf6ff527a19', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:20 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-84a5dbdd-21df-423b-8d8d-d6728f056ba0 tempest-ProjectReaderTests-1070449080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89c35413-612d-43b8-bcb7-62e58b8d01cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:20 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-84a5dbdd-21df-423b-8d8d-d6728f056ba0 tempest-ProjectReaderTests-1070449080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89c35413-612d-43b8-bcb7-62e58b8d01cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:20 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-84a5dbdd-21df-423b-8d8d-d6728f056ba0 tempest-ProjectReaderTests-1070449080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f20634a5-6a8f-4ad3-9543-e0eba8f373ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:20 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-84a5dbdd-21df-423b-8d8d-d6728f056ba0 tempest-ProjectReaderTests-1070449080 None] Volume fc4058e3-3fe2-4de1-b81f-3cf6ff527a19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc4058e3-3fe2-4de1-b81f-3cf6ff527a19', 'volume_size': 1}
Nov 06 12:04:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-84a5dbdd-21df-423b-8d8d-d6728f056ba0 tempest-ProjectReaderTests-1070449080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-84a5dbdd-21df-423b-8d8d-d6728f056ba0 tempest-ProjectReaderTests-1070449080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:20 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-84a5dbdd-21df-423b-8d8d-d6728f056ba0 tempest-ProjectReaderTests-1070449080 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1504436128',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc4058e3-3fe2-4de1-b81f-3cf6ff527a19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c13e3cc25924935a60f5a96ce9b3eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:04:20Z,use_quota=True,user_id='18a7d2dabd13418f829055cfd8f03f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:04:20 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-84a5dbdd-21df-423b-8d8d-d6728f056ba0 tempest-ProjectReaderTests-1070449080 None] Creating volume fc4058e3-3fe2-4de1-b81f-3cf6ff527a19 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:04:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-84a5dbdd-21df-423b-8d8d-d6728f056ba0 tempest-ProjectReaderTests-1070449080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-84a5dbdd-21df-423b-8d8d-d6728f056ba0 tempest-ProjectReaderTests-1070449080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:20 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-84a5dbdd-21df-423b-8d8d-d6728f056ba0 tempest-ProjectReaderTests-1070449080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:04:20 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-84a5dbdd-21df-423b-8d8d-d6728f056ba0 tempest-ProjectReaderTests-1070449080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:04:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-84a5dbdd-21df-423b-8d8d-d6728f056ba0 tempest-ProjectReaderTests-1070449080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:20 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-84a5dbdd-21df-423b-8d8d-d6728f056ba0 tempest-ProjectReaderTests-1070449080 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:04:20 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-84a5dbdd-21df-423b-8d8d-d6728f056ba0 tempest-ProjectReaderTests-1070449080 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:04:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-84a5dbdd-21df-423b-8d8d-d6728f056ba0 tempest-ProjectReaderTests-1070449080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fc4058e3-3fe2-4de1-b81f-3cf6ff527a19 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:20 devstack sudo[108628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fc4058e3-3fe2-4de1-b81f-3cf6ff527a19 1073741824
Nov 06 12:04:20 devstack sudo[108628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:20 devstack sudo[108626]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0b2d0d30-4db0-485f-8c32-928daf611576 tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-2a98cdff-0626-4dfd-a398-da334d11c547" returned: 0 in 0.428s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:20 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0b2d0d30-4db0-485f-8c32-928daf611576 tempest-ProjectReaderTests-1672117553 None] Lock "cinder-quobyte-2a98cdff-0626-4dfd-a398-da334d11c547" released by "delete_volume" :: held 1.096s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:20 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-0b2d0d30-4db0-485f-8c32-928daf611576 tempest-ProjectReaderTests-1672117553 None] Created reservations ['f51f382c-cb7f-4c6e-93e0-ef107b46496f', 'b254de39-3534-4652-8ca7-3b6e49c7cc24', '2e873988-181a-46db-83ee-b406af0c3e7b', '4f63e9b7-3f8a-4dc4-afef-77138f7d0a3a'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:04:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-0b2d0d30-4db0-485f-8c32-928daf611576 tempest-ProjectReaderTests-1672117553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-0b2d0d30-4db0-485f-8c32-928daf611576 tempest-ProjectReaderTests-1672117553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:20 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-0b2d0d30-4db0-485f-8c32-928daf611576 tempest-ProjectReaderTests-1672117553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:04:20 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-0b2d0d30-4db0-485f-8c32-928daf611576 tempest-ProjectReaderTests-1672117553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:04:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-0b2d0d30-4db0-485f-8c32-928daf611576 tempest-ProjectReaderTests-1672117553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0b2d0d30-4db0-485f-8c32-928daf611576 tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:20 devstack sudo[108635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:04:20 devstack sudo[108635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:21 devstack sudo[108628]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-84a5dbdd-21df-423b-8d8d-d6728f056ba0 tempest-ProjectReaderTests-1070449080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fc4058e3-3fe2-4de1-b81f-3cf6ff527a19 1073741824" returned: 0 in 0.675s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-84a5dbdd-21df-423b-8d8d-d6728f056ba0 tempest-ProjectReaderTests-1070449080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fc4058e3-3fe2-4de1-b81f-3cf6ff527a19 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:21 devstack sudo[108637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fc4058e3-3fe2-4de1-b81f-3cf6ff527a19
Nov 06 12:04:21 devstack sudo[108637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:21 devstack sudo[108635]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0b2d0d30-4db0-485f-8c32-928daf611576 tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.419s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:21 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-0b2d0d30-4db0-485f-8c32-928daf611576 tempest-ProjectReaderTests-1672117553 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:04:21 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-0b2d0d30-4db0-485f-8c32-928daf611576 tempest-ProjectReaderTests-1672117553 None] Deleted volume successfully.
Nov 06 12:04:21 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-53f29847-0006-408c-9144-3c68426a473b tempest-ProjectAdminTests-1885486810 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.401268005371, 'free_capacity_gb': 1773.401268005371, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87165) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 06 12:04:21 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0b2d0d30-4db0-485f-8c32-928daf611576 tempest-ProjectReaderTests-1672117553 None] Lock "cinder-2a98cdff-0626-4dfd-a398-da334d11c547-delete_volume" released by "delete_volume" :: held 1.917s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:21 devstack sudo[108637]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-84a5dbdd-21df-423b-8d8d-d6728f056ba0 tempest-ProjectReaderTests-1070449080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fc4058e3-3fe2-4de1-b81f-3cf6ff527a19" returned: 0 in 0.353s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:21 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-84a5dbdd-21df-423b-8d8d-d6728f056ba0 tempest-ProjectReaderTests-1070449080 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:04:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-84a5dbdd-21df-423b-8d8d-d6728f056ba0 tempest-ProjectReaderTests-1070449080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:21 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-84a5dbdd-21df-423b-8d8d-d6728f056ba0 tempest-ProjectReaderTests-1070449080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f20634a5-6a8f-4ad3-9543-e0eba8f373ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc4058e3-3fe2-4de1-b81f-3cf6ff527a19', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:21 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-84a5dbdd-21df-423b-8d8d-d6728f056ba0 tempest-ProjectReaderTests-1070449080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e946d5fc-d781-4318-83f3-878463f1e238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:21 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-84a5dbdd-21df-423b-8d8d-d6728f056ba0 tempest-ProjectReaderTests-1070449080 None] Volume volume-fc4058e3-3fe2-4de1-b81f-3cf6ff527a19 (fc4058e3-3fe2-4de1-b81f-3cf6ff527a19): created successfully
Nov 06 12:04:21 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-84a5dbdd-21df-423b-8d8d-d6728f056ba0 tempest-ProjectReaderTests-1070449080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e946d5fc-d781-4318-83f3-878463f1e238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:21 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-84a5dbdd-21df-423b-8d8d-d6728f056ba0 tempest-ProjectReaderTests-1070449080 None] Flow 'volume_create_manager' (428c59b6-0e0b-4559-8d22-d928d8b3ac41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:04:21 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-84a5dbdd-21df-423b-8d8d-d6728f056ba0 tempest-ProjectReaderTests-1070449080 None] Created volume successfully.
Nov 06 12:04:22 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdef9b94-48e6-4f3f-ad51-31155ea9fe34 tempest-ProjectReaderTests-1672117553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:04:22 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-cdef9b94-48e6-4f3f-ad51-31155ea9fe34 tempest-ProjectReaderTests-1672117553 None] Flow 'volume_create_manager' (8e65bb17-a655-44cd-8d55-ae908c19fdde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:04:22 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-cdef9b94-48e6-4f3f-ad51-31155ea9fe34 tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (000b5086-7c03-4768-8dd4-9e2059063778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:22 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-cdef9b94-48e6-4f3f-ad51-31155ea9fe34 tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (000b5086-7c03-4768-8dd4-9e2059063778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-883668158',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9887945a-394e-4606-800c-8cb1fd618423,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c737f6ee48a4d11a061314cd20da265',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:04:22Z,use_quota=True,user_id='7695e7d99bd24749a219f86885bd0d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:22 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-cdef9b94-48e6-4f3f-ad51-31155ea9fe34 tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adda12fd-dbc4-4464-a309-8fe958d76d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:22 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-cdef9b94-48e6-4f3f-ad51-31155ea9fe34 tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adda12fd-dbc4-4464-a309-8fe958d76d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:22 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-cdef9b94-48e6-4f3f-ad51-31155ea9fe34 tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e419292-5c24-435b-b88b-846480469360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:22 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-cdef9b94-48e6-4f3f-ad51-31155ea9fe34 tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e419292-5c24-435b-b88b-846480469360) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9887945a-394e-4606-800c-8cb1fd618423', 'volume_name': 'volume-9887945a-394e-4606-800c-8cb1fd618423', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:22 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-cdef9b94-48e6-4f3f-ad51-31155ea9fe34 tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a92c0da-643c-4617-a28a-a8ed45d00d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:22 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-cdef9b94-48e6-4f3f-ad51-31155ea9fe34 tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a92c0da-643c-4617-a28a-a8ed45d00d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:22 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-cdef9b94-48e6-4f3f-ad51-31155ea9fe34 tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2debd782-d6c3-4026-aa3d-c2c32cd4792f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:22 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-cdef9b94-48e6-4f3f-ad51-31155ea9fe34 tempest-ProjectReaderTests-1672117553 None] Volume 9887945a-394e-4606-800c-8cb1fd618423: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9887945a-394e-4606-800c-8cb1fd618423', 'volume_size': 1}
Nov 06 12:04:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-cdef9b94-48e6-4f3f-ad51-31155ea9fe34 tempest-ProjectReaderTests-1672117553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-cdef9b94-48e6-4f3f-ad51-31155ea9fe34 tempest-ProjectReaderTests-1672117553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:22 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-cdef9b94-48e6-4f3f-ad51-31155ea9fe34 tempest-ProjectReaderTests-1672117553 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-883668158',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9887945a-394e-4606-800c-8cb1fd618423,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c737f6ee48a4d11a061314cd20da265',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:04:22Z,use_quota=True,user_id='7695e7d99bd24749a219f86885bd0d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:04:22 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-cdef9b94-48e6-4f3f-ad51-31155ea9fe34 tempest-ProjectReaderTests-1672117553 None] Creating volume 9887945a-394e-4606-800c-8cb1fd618423 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:04:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-cdef9b94-48e6-4f3f-ad51-31155ea9fe34 tempest-ProjectReaderTests-1672117553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-cdef9b94-48e6-4f3f-ad51-31155ea9fe34 tempest-ProjectReaderTests-1672117553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:22 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-cdef9b94-48e6-4f3f-ad51-31155ea9fe34 tempest-ProjectReaderTests-1672117553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:04:22 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-cdef9b94-48e6-4f3f-ad51-31155ea9fe34 tempest-ProjectReaderTests-1672117553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:04:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-cdef9b94-48e6-4f3f-ad51-31155ea9fe34 tempest-ProjectReaderTests-1672117553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:22 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-cdef9b94-48e6-4f3f-ad51-31155ea9fe34 tempest-ProjectReaderTests-1672117553 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:04:22 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-cdef9b94-48e6-4f3f-ad51-31155ea9fe34 tempest-ProjectReaderTests-1672117553 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:04:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cdef9b94-48e6-4f3f-ad51-31155ea9fe34 tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9887945a-394e-4606-800c-8cb1fd618423 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:22 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-6086bebf-4140-4527-9dcb-b57dbcf2df4d tempest-ProjectReaderTests-1070449080 None] Acquiring lock "cinder-fc4058e3-3fe2-4de1-b81f-3cf6ff527a19-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:22 devstack sudo[108641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9887945a-394e-4606-800c-8cb1fd618423 1073741824
Nov 06 12:04:22 devstack sudo[108641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:22 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-6086bebf-4140-4527-9dcb-b57dbcf2df4d tempest-ProjectReaderTests-1070449080 None] Lock "cinder-fc4058e3-3fe2-4de1-b81f-3cf6ff527a19-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:22 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-6086bebf-4140-4527-9dcb-b57dbcf2df4d tempest-ProjectReaderTests-1070449080 None] Acquiring lock "cinder-quobyte-fc4058e3-3fe2-4de1-b81f-3cf6ff527a19" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:22 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-6086bebf-4140-4527-9dcb-b57dbcf2df4d tempest-ProjectReaderTests-1070449080 None] Lock "cinder-quobyte-fc4058e3-3fe2-4de1-b81f-3cf6ff527a19" acquired by "delete_volume" :: waited 0.024s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:22 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8bcf51-d493-4c7e-b3ca-a19dbf49d063]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:04:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6086bebf-4140-4527-9dcb-b57dbcf2df4d tempest-ProjectReaderTests-1070449080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fc4058e3-3fe2-4de1-b81f-3cf6ff527a19 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:22 devstack sudo[108643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fc4058e3-3fe2-4de1-b81f-3cf6ff527a19
Nov 06 12:04:22 devstack sudo[108643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:23 devstack sudo[108641]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cdef9b94-48e6-4f3f-ad51-31155ea9fe34 tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9887945a-394e-4606-800c-8cb1fd618423 1073741824" returned: 0 in 0.654s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:23 devstack sudo[108643]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6086bebf-4140-4527-9dcb-b57dbcf2df4d tempest-ProjectReaderTests-1070449080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fc4058e3-3fe2-4de1-b81f-3cf6ff527a19" returned: 0 in 0.522s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6086bebf-4140-4527-9dcb-b57dbcf2df4d tempest-ProjectReaderTests-1070449080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fc4058e3-3fe2-4de1-b81f-3cf6ff527a19 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:23 devstack sudo[108653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fc4058e3-3fe2-4de1-b81f-3cf6ff527a19
Nov 06 12:04:23 devstack sudo[108653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cdef9b94-48e6-4f3f-ad51-31155ea9fe34 tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9887945a-394e-4606-800c-8cb1fd618423 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:23 devstack sudo[108655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9887945a-394e-4606-800c-8cb1fd618423
Nov 06 12:04:23 devstack sudo[108655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:23 devstack sudo[108655]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cdef9b94-48e6-4f3f-ad51-31155ea9fe34 tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9887945a-394e-4606-800c-8cb1fd618423" returned: 0 in 0.332s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:23 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-cdef9b94-48e6-4f3f-ad51-31155ea9fe34 tempest-ProjectReaderTests-1672117553 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:04:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-cdef9b94-48e6-4f3f-ad51-31155ea9fe34 tempest-ProjectReaderTests-1672117553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:23 devstack sudo[108653]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:23 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-cdef9b94-48e6-4f3f-ad51-31155ea9fe34 tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2debd782-d6c3-4026-aa3d-c2c32cd4792f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9887945a-394e-4606-800c-8cb1fd618423', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:23 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-cdef9b94-48e6-4f3f-ad51-31155ea9fe34 tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c8ea7a4-e6e0-4f55-b7d6-b9e30851d7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6086bebf-4140-4527-9dcb-b57dbcf2df4d tempest-ProjectReaderTests-1070449080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-fc4058e3-3fe2-4de1-b81f-3cf6ff527a19" returned: 0 in 0.436s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:23 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-6086bebf-4140-4527-9dcb-b57dbcf2df4d tempest-ProjectReaderTests-1070449080 None] Lock "cinder-quobyte-fc4058e3-3fe2-4de1-b81f-3cf6ff527a19" released by "delete_volume" :: held 1.026s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:23 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-cdef9b94-48e6-4f3f-ad51-31155ea9fe34 tempest-ProjectReaderTests-1672117553 None] Volume volume-9887945a-394e-4606-800c-8cb1fd618423 (9887945a-394e-4606-800c-8cb1fd618423): created successfully
Nov 06 12:04:23 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-cdef9b94-48e6-4f3f-ad51-31155ea9fe34 tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c8ea7a4-e6e0-4f55-b7d6-b9e30851d7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:23 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-cdef9b94-48e6-4f3f-ad51-31155ea9fe34 tempest-ProjectReaderTests-1672117553 None] Flow 'volume_create_manager' (8e65bb17-a655-44cd-8d55-ae908c19fdde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:04:23 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-cdef9b94-48e6-4f3f-ad51-31155ea9fe34 tempest-ProjectReaderTests-1672117553 None] Created volume successfully.
Nov 06 12:04:23 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-6086bebf-4140-4527-9dcb-b57dbcf2df4d tempest-ProjectReaderTests-1070449080 None] Created reservations ['8ea1008d-d24f-46b2-ad74-c713711d6ae9', '3bc36015-3312-4237-9c50-880325d65d0c', 'd3a22c83-26b5-40d6-b4cc-f60e0f482140', 'b1cba2e2-e29f-4c95-b26e-bb3734d6b8b8'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:04:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6086bebf-4140-4527-9dcb-b57dbcf2df4d tempest-ProjectReaderTests-1070449080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6086bebf-4140-4527-9dcb-b57dbcf2df4d tempest-ProjectReaderTests-1070449080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:23 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-6086bebf-4140-4527-9dcb-b57dbcf2df4d tempest-ProjectReaderTests-1070449080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:04:23 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-6086bebf-4140-4527-9dcb-b57dbcf2df4d tempest-ProjectReaderTests-1070449080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:04:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6086bebf-4140-4527-9dcb-b57dbcf2df4d tempest-ProjectReaderTests-1070449080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6086bebf-4140-4527-9dcb-b57dbcf2df4d tempest-ProjectReaderTests-1070449080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:24 devstack sudo[108659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:04:24 devstack sudo[108659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:24 devstack sudo[108659]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6086bebf-4140-4527-9dcb-b57dbcf2df4d tempest-ProjectReaderTests-1070449080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.270s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:24 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-6086bebf-4140-4527-9dcb-b57dbcf2df4d tempest-ProjectReaderTests-1070449080 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:04:24 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-6086bebf-4140-4527-9dcb-b57dbcf2df4d tempest-ProjectReaderTests-1070449080 None] Deleted volume successfully.
Nov 06 12:04:24 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-6086bebf-4140-4527-9dcb-b57dbcf2df4d tempest-ProjectReaderTests-1070449080 None] Lock "cinder-fc4058e3-3fe2-4de1-b81f-3cf6ff527a19-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-257ff12b-8a90-4dfe-9351-95b23de01374 tempest-ProjectReaderTests-1672117553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-257ff12b-8a90-4dfe-9351-95b23de01374 tempest-ProjectReaderTests-1672117553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:24 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-257ff12b-8a90-4dfe-9351-95b23de01374 tempest-ProjectReaderTests-1672117553 None] Creating offline snapshot 571f9382-0821-4329-b22e-6d51bd5fff61 of volume 9887945a-394e-4606-800c-8cb1fd618423 {{(pid=87165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 12:04:24 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9c728b-b2a6-4488-b144-4092d55f2c09]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:04:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-257ff12b-8a90-4dfe-9351-95b23de01374 tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9887945a-394e-4606-800c-8cb1fd618423 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:25 devstack sudo[108663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9887945a-394e-4606-800c-8cb1fd618423
Nov 06 12:04:25 devstack sudo[108663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:25 devstack sudo[108663]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-257ff12b-8a90-4dfe-9351-95b23de01374 tempest-ProjectReaderTests-1672117553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9887945a-394e-4606-800c-8cb1fd618423" returned: 0 in 0.554s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-257ff12b-8a90-4dfe-9351-95b23de01374 tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9887945a-394e-4606-800c-8cb1fd618423,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9887945a-394e-4606-800c-8cb1fd618423.571f9382-0821-4329-b22e-6d51bd5fff61 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:25 devstack sudo[108668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9887945a-394e-4606-800c-8cb1fd618423,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9887945a-394e-4606-800c-8cb1fd618423.571f9382-0821-4329-b22e-6d51bd5fff61 1G
Nov 06 12:04:25 devstack sudo[108668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:26 devstack sudo[108668]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-257ff12b-8a90-4dfe-9351-95b23de01374 tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9887945a-394e-4606-800c-8cb1fd618423,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9887945a-394e-4606-800c-8cb1fd618423.571f9382-0821-4329-b22e-6d51bd5fff61 1G" returned: 0 in 0.703s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-257ff12b-8a90-4dfe-9351-95b23de01374 tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9887945a-394e-4606-800c-8cb1fd618423 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9887945a-394e-4606-800c-8cb1fd618423.571f9382-0821-4329-b22e-6d51bd5fff61 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:26 devstack sudo[108674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9887945a-394e-4606-800c-8cb1fd618423 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9887945a-394e-4606-800c-8cb1fd618423.571f9382-0821-4329-b22e-6d51bd5fff61
Nov 06 12:04:26 devstack sudo[108674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:26 devstack sudo[108674]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-257ff12b-8a90-4dfe-9351-95b23de01374 tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9887945a-394e-4606-800c-8cb1fd618423 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9887945a-394e-4606-800c-8cb1fd618423.571f9382-0821-4329-b22e-6d51bd5fff61" returned: 0 in 0.369s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:26 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-257ff12b-8a90-4dfe-9351-95b23de01374 tempest-ProjectReaderTests-1672117553 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9887945a-394e-4606-800c-8cb1fd618423.571f9382-0821-4329-b22e-6d51bd5fff61 is being set with open permissions: ugo+rw
Nov 06 12:04:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-257ff12b-8a90-4dfe-9351-95b23de01374 tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9887945a-394e-4606-800c-8cb1fd618423.571f9382-0821-4329-b22e-6d51bd5fff61 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:26 devstack sudo[108679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9887945a-394e-4606-800c-8cb1fd618423.571f9382-0821-4329-b22e-6d51bd5fff61
Nov 06 12:04:26 devstack sudo[108679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:26 devstack sudo[108679]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-257ff12b-8a90-4dfe-9351-95b23de01374 tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9887945a-394e-4606-800c-8cb1fd618423.571f9382-0821-4329-b22e-6d51bd5fff61" returned: 0 in 0.344s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-257ff12b-8a90-4dfe-9351-95b23de01374 tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9887945a-394e-4606-800c-8cb1fd618423.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:27 devstack sudo[108682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9887945a-394e-4606-800c-8cb1fd618423.info
Nov 06 12:04:27 devstack sudo[108682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:27 devstack sudo[108682]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-257ff12b-8a90-4dfe-9351-95b23de01374 tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9887945a-394e-4606-800c-8cb1fd618423.info" returned: 0 in 0.330s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:27 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-257ff12b-8a90-4dfe-9351-95b23de01374 tempest-ProjectReaderTests-1672117553 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9887945a-394e-4606-800c-8cb1fd618423.info is being set with open permissions: ugo+rw
Nov 06 12:04:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-257ff12b-8a90-4dfe-9351-95b23de01374 tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9887945a-394e-4606-800c-8cb1fd618423.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:27 devstack sudo[108685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9887945a-394e-4606-800c-8cb1fd618423.info
Nov 06 12:04:27 devstack sudo[108685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:27 devstack sudo[108685]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-257ff12b-8a90-4dfe-9351-95b23de01374 tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9887945a-394e-4606-800c-8cb1fd618423.info" returned: 0 in 0.318s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-257ff12b-8a90-4dfe-9351-95b23de01374 tempest-ProjectReaderTests-1672117553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.778s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:27 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-257ff12b-8a90-4dfe-9351-95b23de01374 tempest-ProjectReaderTests-1672117553 None] Create snapshot completed successfully
Nov 06 12:04:28 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a5f72afb-70e9-49a4-88e2-fd96d86117b1 tempest-ProjectReaderTests-1672117553 None] Acquiring lock "cinder-571f9382-0821-4329-b22e-6d51bd5fff61-delete_snapshot" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:28 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a5f72afb-70e9-49a4-88e2-fd96d86117b1 tempest-ProjectReaderTests-1672117553 None] Lock "cinder-571f9382-0821-4329-b22e-6d51bd5fff61-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:28 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a5f72afb-70e9-49a4-88e2-fd96d86117b1 tempest-ProjectReaderTests-1672117553 None] Acquiring lock "cinder-quobyte-9887945a-394e-4606-800c-8cb1fd618423" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:28 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a5f72afb-70e9-49a4-88e2-fd96d86117b1 tempest-ProjectReaderTests-1672117553 None] Lock "cinder-quobyte-9887945a-394e-4606-800c-8cb1fd618423" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:28 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a5f72afb-70e9-49a4-88e2-fd96d86117b1 tempest-ProjectReaderTests-1672117553 None] Acquiring lock "cinder-quobyte-571f9382-0821-4329-b22e-6d51bd5fff61" by "_delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:28 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a5f72afb-70e9-49a4-88e2-fd96d86117b1 tempest-ProjectReaderTests-1672117553 None] Lock "cinder-quobyte-571f9382-0821-4329-b22e-6d51bd5fff61" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:28 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-a5f72afb-70e9-49a4-88e2-fd96d86117b1 tempest-ProjectReaderTests-1672117553 None] Deleting offline snapshot 571f9382-0821-4329-b22e-6d51bd5fff61 of volume 9887945a-394e-4606-800c-8cb1fd618423 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 12:04:28 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-a5f72afb-70e9-49a4-88e2-fd96d86117b1 tempest-ProjectReaderTests-1672117553 None] snapshot_file for this snap is: volume-9887945a-394e-4606-800c-8cb1fd618423.571f9382-0821-4329-b22e-6d51bd5fff61 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 12:04:28 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7286b2cb-f525-4f5f-a47d-71750b03bd23]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:04:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a5f72afb-70e9-49a4-88e2-fd96d86117b1 tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9887945a-394e-4606-800c-8cb1fd618423.571f9382-0821-4329-b22e-6d51bd5fff61 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:28 devstack sudo[108689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9887945a-394e-4606-800c-8cb1fd618423.571f9382-0821-4329-b22e-6d51bd5fff61
Nov 06 12:04:28 devstack sudo[108689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:28 devstack sudo[108689]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a5f72afb-70e9-49a4-88e2-fd96d86117b1 tempest-ProjectReaderTests-1672117553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9887945a-394e-4606-800c-8cb1fd618423.571f9382-0821-4329-b22e-6d51bd5fff61" returned: 0 in 0.434s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:28 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-a5f72afb-70e9-49a4-88e2-fd96d86117b1 tempest-ProjectReaderTests-1672117553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9887945a-394e-4606-800c-8cb1fd618423(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 12:04:28 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c681ec-2bb2-42c3-b3b1-84831b921fa9]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:04:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a5f72afb-70e9-49a4-88e2-fd96d86117b1 tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9887945a-394e-4606-800c-8cb1fd618423 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:28 devstack sudo[108695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9887945a-394e-4606-800c-8cb1fd618423
Nov 06 12:04:28 devstack sudo[108695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:29 devstack sudo[108695]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a5f72afb-70e9-49a4-88e2-fd96d86117b1 tempest-ProjectReaderTests-1672117553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9887945a-394e-4606-800c-8cb1fd618423" returned: 0 in 0.439s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a5f72afb-70e9-49a4-88e2-fd96d86117b1 tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9887945a-394e-4606-800c-8cb1fd618423.571f9382-0821-4329-b22e-6d51bd5fff61 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:29 devstack sudo[108700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9887945a-394e-4606-800c-8cb1fd618423.571f9382-0821-4329-b22e-6d51bd5fff61
Nov 06 12:04:29 devstack sudo[108700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:29 devstack sudo[108700]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a5f72afb-70e9-49a4-88e2-fd96d86117b1 tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9887945a-394e-4606-800c-8cb1fd618423.571f9382-0821-4329-b22e-6d51bd5fff61" returned: 0 in 0.390s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a5f72afb-70e9-49a4-88e2-fd96d86117b1 tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9887945a-394e-4606-800c-8cb1fd618423.571f9382-0821-4329-b22e-6d51bd5fff61 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:29 devstack sudo[108705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9887945a-394e-4606-800c-8cb1fd618423.571f9382-0821-4329-b22e-6d51bd5fff61
Nov 06 12:04:29 devstack sudo[108705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:29 devstack sudo[108705]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a5f72afb-70e9-49a4-88e2-fd96d86117b1 tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9887945a-394e-4606-800c-8cb1fd618423.571f9382-0821-4329-b22e-6d51bd5fff61" returned: 0 in 0.287s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:29 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a5f72afb-70e9-49a4-88e2-fd96d86117b1 tempest-ProjectReaderTests-1672117553 None] Lock "cinder-quobyte-571f9382-0821-4329-b22e-6d51bd5fff61" released by "_delete_snapshot" :: held 1.702s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:29 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a5f72afb-70e9-49a4-88e2-fd96d86117b1 tempest-ProjectReaderTests-1672117553 None] Lock "cinder-quobyte-9887945a-394e-4606-800c-8cb1fd618423" released by "delete_snapshot" :: held 1.734s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:29 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-a5f72afb-70e9-49a4-88e2-fd96d86117b1 tempest-ProjectReaderTests-1672117553 None] Created reservations ['40ef70c4-2685-494d-aa47-2b75a465409a', '287b7920-0e65-4d70-8fc2-fef60e3a598e', '795dd9c3-90f6-44d2-90c3-754f7945b09c', '754633af-8c94-47ff-adf1-d9b70429e91c'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:04:30 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-a5f72afb-70e9-49a4-88e2-fd96d86117b1 tempest-ProjectReaderTests-1672117553 None] Delete snapshot completed successfully.
Nov 06 12:04:30 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a5f72afb-70e9-49a4-88e2-fd96d86117b1 tempest-ProjectReaderTests-1672117553 None] Lock "cinder-571f9382-0821-4329-b22e-6d51bd5fff61-delete_snapshot" released by "delete_snapshot" :: held 1.947s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:30 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-dad2f7c5-54ac-418f-a9ab-cedd7692e9da tempest-ProjectReaderTests-1672117553 None] Acquiring lock "cinder-9887945a-394e-4606-800c-8cb1fd618423-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:30 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-dad2f7c5-54ac-418f-a9ab-cedd7692e9da tempest-ProjectReaderTests-1672117553 None] Lock "cinder-9887945a-394e-4606-800c-8cb1fd618423-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:30 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-dad2f7c5-54ac-418f-a9ab-cedd7692e9da tempest-ProjectReaderTests-1672117553 None] Acquiring lock "cinder-quobyte-9887945a-394e-4606-800c-8cb1fd618423" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:30 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-dad2f7c5-54ac-418f-a9ab-cedd7692e9da tempest-ProjectReaderTests-1672117553 None] Lock "cinder-quobyte-9887945a-394e-4606-800c-8cb1fd618423" acquired by "delete_volume" :: waited 0.027s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:30 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c377514c-e15d-45cf-888c-72534d293395]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:04:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-dad2f7c5-54ac-418f-a9ab-cedd7692e9da tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9887945a-394e-4606-800c-8cb1fd618423 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:30 devstack sudo[108708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9887945a-394e-4606-800c-8cb1fd618423
Nov 06 12:04:30 devstack sudo[108708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:30 devstack sudo[108708]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-dad2f7c5-54ac-418f-a9ab-cedd7692e9da tempest-ProjectReaderTests-1672117553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9887945a-394e-4606-800c-8cb1fd618423" returned: 0 in 0.446s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-dad2f7c5-54ac-418f-a9ab-cedd7692e9da tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9887945a-394e-4606-800c-8cb1fd618423 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:30 devstack sudo[108713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9887945a-394e-4606-800c-8cb1fd618423
Nov 06 12:04:30 devstack sudo[108713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:31 devstack sudo[108713]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-dad2f7c5-54ac-418f-a9ab-cedd7692e9da tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9887945a-394e-4606-800c-8cb1fd618423" returned: 0 in 0.289s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:31 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-dad2f7c5-54ac-418f-a9ab-cedd7692e9da tempest-ProjectReaderTests-1672117553 None] Lock "cinder-quobyte-9887945a-394e-4606-800c-8cb1fd618423" released by "delete_volume" :: held 0.838s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:31 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-dad2f7c5-54ac-418f-a9ab-cedd7692e9da tempest-ProjectReaderTests-1672117553 None] Created reservations ['40e32419-bf85-4478-a943-fa07cac70b13', '43abf39d-4518-4d48-a9c2-8bbfb01dc781', 'c299c214-47e0-4ab0-891a-a2d63feda0aa', 'b1b90953-a51a-4b59-ae2a-66fe79f1ba36'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:04:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-dad2f7c5-54ac-418f-a9ab-cedd7692e9da tempest-ProjectReaderTests-1672117553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-dad2f7c5-54ac-418f-a9ab-cedd7692e9da tempest-ProjectReaderTests-1672117553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:31 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-dad2f7c5-54ac-418f-a9ab-cedd7692e9da tempest-ProjectReaderTests-1672117553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:04:31 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-dad2f7c5-54ac-418f-a9ab-cedd7692e9da tempest-ProjectReaderTests-1672117553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:04:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-dad2f7c5-54ac-418f-a9ab-cedd7692e9da tempest-ProjectReaderTests-1672117553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-dad2f7c5-54ac-418f-a9ab-cedd7692e9da tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:31 devstack sudo[108716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:04:31 devstack sudo[108716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:31 devstack sudo[108716]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-dad2f7c5-54ac-418f-a9ab-cedd7692e9da tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.291s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:31 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-dad2f7c5-54ac-418f-a9ab-cedd7692e9da tempest-ProjectReaderTests-1672117553 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:04:31 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-dad2f7c5-54ac-418f-a9ab-cedd7692e9da tempest-ProjectReaderTests-1672117553 None] Deleted volume successfully.
Nov 06 12:04:31 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-dad2f7c5-54ac-418f-a9ab-cedd7692e9da tempest-ProjectReaderTests-1672117553 None] Lock "cinder-9887945a-394e-4606-800c-8cb1fd618423-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:32 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaaadcc2-3c0b-4730-8810-6414354d5dd3 tempest-ProjectReaderTests-1672117553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:04:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-aaaadcc2-3c0b-4730-8810-6414354d5dd3 tempest-ProjectReaderTests-1672117553 None] Flow 'volume_create_manager' (6b523dfc-edcc-4dfe-a828-7d92fd80c1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:04:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-aaaadcc2-3c0b-4730-8810-6414354d5dd3 tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3759bd8-2d9c-45ce-b0ca-1a6514b513c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-aaaadcc2-3c0b-4730-8810-6414354d5dd3 tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3759bd8-2d9c-45ce-b0ca-1a6514b513c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:04:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-974415458',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=377268c1-80e8-447f-95e3-974158661192,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c737f6ee48a4d11a061314cd20da265',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:04:32Z,use_quota=True,user_id='7695e7d99bd24749a219f86885bd0d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-aaaadcc2-3c0b-4730-8810-6414354d5dd3 tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c93fef12-0486-4057-8b55-79c1d213d2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-aaaadcc2-3c0b-4730-8810-6414354d5dd3 tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c93fef12-0486-4057-8b55-79c1d213d2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-aaaadcc2-3c0b-4730-8810-6414354d5dd3 tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d3ad63c-3d0d-49ab-83f1-24996b10e430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-aaaadcc2-3c0b-4730-8810-6414354d5dd3 tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d3ad63c-3d0d-49ab-83f1-24996b10e430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '377268c1-80e8-447f-95e3-974158661192', 'volume_name': 'volume-377268c1-80e8-447f-95e3-974158661192', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-aaaadcc2-3c0b-4730-8810-6414354d5dd3 tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (561aef5f-9d79-4c37-9b69-fb86ab56f090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-aaaadcc2-3c0b-4730-8810-6414354d5dd3 tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (561aef5f-9d79-4c37-9b69-fb86ab56f090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:32 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-aaaadcc2-3c0b-4730-8810-6414354d5dd3 tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56e5a381-e61b-4121-9e10-b427837fb263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:32 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-aaaadcc2-3c0b-4730-8810-6414354d5dd3 tempest-ProjectReaderTests-1672117553 None] Volume 377268c1-80e8-447f-95e3-974158661192: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-377268c1-80e8-447f-95e3-974158661192', 'volume_size': 1}
Nov 06 12:04:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-aaaadcc2-3c0b-4730-8810-6414354d5dd3 tempest-ProjectReaderTests-1672117553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-aaaadcc2-3c0b-4730-8810-6414354d5dd3 tempest-ProjectReaderTests-1672117553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:32 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-aaaadcc2-3c0b-4730-8810-6414354d5dd3 tempest-ProjectReaderTests-1672117553 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:04:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-974415458',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=377268c1-80e8-447f-95e3-974158661192,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c737f6ee48a4d11a061314cd20da265',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:04:32Z,use_quota=True,user_id='7695e7d99bd24749a219f86885bd0d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:04:32 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-aaaadcc2-3c0b-4730-8810-6414354d5dd3 tempest-ProjectReaderTests-1672117553 None] Creating volume 377268c1-80e8-447f-95e3-974158661192 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:04:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-aaaadcc2-3c0b-4730-8810-6414354d5dd3 tempest-ProjectReaderTests-1672117553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-aaaadcc2-3c0b-4730-8810-6414354d5dd3 tempest-ProjectReaderTests-1672117553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:32 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-aaaadcc2-3c0b-4730-8810-6414354d5dd3 tempest-ProjectReaderTests-1672117553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:04:32 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-aaaadcc2-3c0b-4730-8810-6414354d5dd3 tempest-ProjectReaderTests-1672117553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:04:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-aaaadcc2-3c0b-4730-8810-6414354d5dd3 tempest-ProjectReaderTests-1672117553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:32 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-aaaadcc2-3c0b-4730-8810-6414354d5dd3 tempest-ProjectReaderTests-1672117553 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:04:32 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-aaaadcc2-3c0b-4730-8810-6414354d5dd3 tempest-ProjectReaderTests-1672117553 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:04:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-aaaadcc2-3c0b-4730-8810-6414354d5dd3 tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-377268c1-80e8-447f-95e3-974158661192 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:32 devstack sudo[108719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-377268c1-80e8-447f-95e3-974158661192 1073741824
Nov 06 12:04:32 devstack sudo[108719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:32 devstack sudo[108719]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-aaaadcc2-3c0b-4730-8810-6414354d5dd3 tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-377268c1-80e8-447f-95e3-974158661192 1073741824" returned: 0 in 0.545s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-aaaadcc2-3c0b-4730-8810-6414354d5dd3 tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-377268c1-80e8-447f-95e3-974158661192 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:32 devstack sudo[108725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-377268c1-80e8-447f-95e3-974158661192
Nov 06 12:04:32 devstack sudo[108725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:33 devstack sudo[108725]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-aaaadcc2-3c0b-4730-8810-6414354d5dd3 tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-377268c1-80e8-447f-95e3-974158661192" returned: 0 in 0.328s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:33 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-aaaadcc2-3c0b-4730-8810-6414354d5dd3 tempest-ProjectReaderTests-1672117553 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:04:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-aaaadcc2-3c0b-4730-8810-6414354d5dd3 tempest-ProjectReaderTests-1672117553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:33 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-aaaadcc2-3c0b-4730-8810-6414354d5dd3 tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56e5a381-e61b-4121-9e10-b427837fb263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-377268c1-80e8-447f-95e3-974158661192', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:33 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-aaaadcc2-3c0b-4730-8810-6414354d5dd3 tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08a92495-47ef-4568-9ab4-14e0c7e809c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:33 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-aaaadcc2-3c0b-4730-8810-6414354d5dd3 tempest-ProjectReaderTests-1672117553 None] Volume volume-377268c1-80e8-447f-95e3-974158661192 (377268c1-80e8-447f-95e3-974158661192): created successfully
Nov 06 12:04:33 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-aaaadcc2-3c0b-4730-8810-6414354d5dd3 tempest-ProjectReaderTests-1672117553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08a92495-47ef-4568-9ab4-14e0c7e809c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:33 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-aaaadcc2-3c0b-4730-8810-6414354d5dd3 tempest-ProjectReaderTests-1672117553 None] Flow 'volume_create_manager' (6b523dfc-edcc-4dfe-a828-7d92fd80c1bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:04:33 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-aaaadcc2-3c0b-4730-8810-6414354d5dd3 tempest-ProjectReaderTests-1672117553 None] Created volume successfully.
Nov 06 12:04:33 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-24a4883c-ea70-4028-bbbc-078230e61006 tempest-ProjectMemberTests-2128122521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:04:33 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-24a4883c-ea70-4028-bbbc-078230e61006 tempest-ProjectMemberTests-2128122521 None] Flow 'volume_create_manager' (023fb50c-8efe-4318-9483-f5078aaabfad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:04:33 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-24a4883c-ea70-4028-bbbc-078230e61006 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88c24a55-ae8f-4c49-a320-49dd3cfd6bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:33 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-24a4883c-ea70-4028-bbbc-078230e61006 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88c24a55-ae8f-4c49-a320-49dd3cfd6bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1180759797',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25a68afd-7b3a-436a-8442-3b389504d014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3c5c4d5cd09492198badac02cec1874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:04:33Z,use_quota=True,user_id='78f8479fdeb04b689787bce30dc332ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:33 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-24a4883c-ea70-4028-bbbc-078230e61006 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d3adda-4321-4cc9-89b6-784be31ace00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:33 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-24a4883c-ea70-4028-bbbc-078230e61006 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d3adda-4321-4cc9-89b6-784be31ace00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:33 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-24a4883c-ea70-4028-bbbc-078230e61006 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82d0edc3-d0eb-4cee-b98a-43ebe675a207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:33 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-24a4883c-ea70-4028-bbbc-078230e61006 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82d0edc3-d0eb-4cee-b98a-43ebe675a207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25a68afd-7b3a-436a-8442-3b389504d014', 'volume_name': 'volume-25a68afd-7b3a-436a-8442-3b389504d014', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:33 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-24a4883c-ea70-4028-bbbc-078230e61006 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c397eb58-db16-4318-b329-90b87907bd3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:33 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-24a4883c-ea70-4028-bbbc-078230e61006 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c397eb58-db16-4318-b329-90b87907bd3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:33 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-24a4883c-ea70-4028-bbbc-078230e61006 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63542d94-98c3-4050-98ab-ff492f633667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:33 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-24a4883c-ea70-4028-bbbc-078230e61006 tempest-ProjectMemberTests-2128122521 None] Volume 25a68afd-7b3a-436a-8442-3b389504d014: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25a68afd-7b3a-436a-8442-3b389504d014', 'volume_size': 1}
Nov 06 12:04:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-24a4883c-ea70-4028-bbbc-078230e61006 tempest-ProjectMemberTests-2128122521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-24a4883c-ea70-4028-bbbc-078230e61006 tempest-ProjectMemberTests-2128122521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:33 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-24a4883c-ea70-4028-bbbc-078230e61006 tempest-ProjectMemberTests-2128122521 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1180759797',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25a68afd-7b3a-436a-8442-3b389504d014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3c5c4d5cd09492198badac02cec1874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:04:33Z,use_quota=True,user_id='78f8479fdeb04b689787bce30dc332ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:04:33 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-24a4883c-ea70-4028-bbbc-078230e61006 tempest-ProjectMemberTests-2128122521 None] Creating volume 25a68afd-7b3a-436a-8442-3b389504d014 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:04:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-24a4883c-ea70-4028-bbbc-078230e61006 tempest-ProjectMemberTests-2128122521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-24a4883c-ea70-4028-bbbc-078230e61006 tempest-ProjectMemberTests-2128122521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:33 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-24a4883c-ea70-4028-bbbc-078230e61006 tempest-ProjectMemberTests-2128122521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:04:33 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-24a4883c-ea70-4028-bbbc-078230e61006 tempest-ProjectMemberTests-2128122521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:04:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-24a4883c-ea70-4028-bbbc-078230e61006 tempest-ProjectMemberTests-2128122521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:33 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-24a4883c-ea70-4028-bbbc-078230e61006 tempest-ProjectMemberTests-2128122521 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:04:33 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-24a4883c-ea70-4028-bbbc-078230e61006 tempest-ProjectMemberTests-2128122521 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:04:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-24a4883c-ea70-4028-bbbc-078230e61006 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25a68afd-7b3a-436a-8442-3b389504d014 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:33 devstack sudo[108728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25a68afd-7b3a-436a-8442-3b389504d014 1073741824
Nov 06 12:04:33 devstack sudo[108728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:33 devstack sudo[108728]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-24a4883c-ea70-4028-bbbc-078230e61006 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25a68afd-7b3a-436a-8442-3b389504d014 1073741824" returned: 0 in 0.450s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-24a4883c-ea70-4028-bbbc-078230e61006 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25a68afd-7b3a-436a-8442-3b389504d014 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:33 devstack sudo[108734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25a68afd-7b3a-436a-8442-3b389504d014
Nov 06 12:04:33 devstack sudo[108734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:34 devstack sudo[108734]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-24a4883c-ea70-4028-bbbc-078230e61006 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25a68afd-7b3a-436a-8442-3b389504d014" returned: 0 in 0.269s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:34 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-24a4883c-ea70-4028-bbbc-078230e61006 tempest-ProjectMemberTests-2128122521 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:04:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-24a4883c-ea70-4028-bbbc-078230e61006 tempest-ProjectMemberTests-2128122521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:34 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-24a4883c-ea70-4028-bbbc-078230e61006 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63542d94-98c3-4050-98ab-ff492f633667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25a68afd-7b3a-436a-8442-3b389504d014', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:34 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-24a4883c-ea70-4028-bbbc-078230e61006 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c04a7aa-6fe1-4232-8b19-d3c374eb70ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:34 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-24a4883c-ea70-4028-bbbc-078230e61006 tempest-ProjectMemberTests-2128122521 None] Volume volume-25a68afd-7b3a-436a-8442-3b389504d014 (25a68afd-7b3a-436a-8442-3b389504d014): created successfully
Nov 06 12:04:34 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-24a4883c-ea70-4028-bbbc-078230e61006 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c04a7aa-6fe1-4232-8b19-d3c374eb70ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:34 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-24a4883c-ea70-4028-bbbc-078230e61006 tempest-ProjectMemberTests-2128122521 None] Flow 'volume_create_manager' (023fb50c-8efe-4318-9483-f5078aaabfad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:04:34 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-24a4883c-ea70-4028-bbbc-078230e61006 tempest-ProjectMemberTests-2128122521 None] Created volume successfully.
Nov 06 12:04:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-7a0f263a-f713-452b-9e24-7cec7038063b tempest-ProjectReaderTests-1672117553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-7a0f263a-f713-452b-9e24-7cec7038063b tempest-ProjectReaderTests-1672117553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:34 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-7a0f263a-f713-452b-9e24-7cec7038063b tempest-ProjectReaderTests-1672117553 None] Creating offline snapshot cc73861c-5ea9-4ec5-b37b-7ba15f52d652 of volume 377268c1-80e8-447f-95e3-974158661192 {{(pid=87165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 12:04:34 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ca029b-99ca-4f3d-89ea-661835bd314e]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:04:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7a0f263a-f713-452b-9e24-7cec7038063b tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-377268c1-80e8-447f-95e3-974158661192 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:34 devstack sudo[108737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-377268c1-80e8-447f-95e3-974158661192
Nov 06 12:04:34 devstack sudo[108737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:34 devstack sudo[108737]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7a0f263a-f713-452b-9e24-7cec7038063b tempest-ProjectReaderTests-1672117553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-377268c1-80e8-447f-95e3-974158661192" returned: 0 in 0.379s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7a0f263a-f713-452b-9e24-7cec7038063b tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-377268c1-80e8-447f-95e3-974158661192,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-377268c1-80e8-447f-95e3-974158661192.cc73861c-5ea9-4ec5-b37b-7ba15f52d652 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:34 devstack sudo[108742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-377268c1-80e8-447f-95e3-974158661192,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-377268c1-80e8-447f-95e3-974158661192.cc73861c-5ea9-4ec5-b37b-7ba15f52d652 1G
Nov 06 12:04:34 devstack sudo[108742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:35 devstack sudo[108742]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7a0f263a-f713-452b-9e24-7cec7038063b tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-377268c1-80e8-447f-95e3-974158661192,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-377268c1-80e8-447f-95e3-974158661192.cc73861c-5ea9-4ec5-b37b-7ba15f52d652 1G" returned: 0 in 0.553s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7a0f263a-f713-452b-9e24-7cec7038063b tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-377268c1-80e8-447f-95e3-974158661192 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-377268c1-80e8-447f-95e3-974158661192.cc73861c-5ea9-4ec5-b37b-7ba15f52d652 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:35 devstack sudo[108749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-377268c1-80e8-447f-95e3-974158661192 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-377268c1-80e8-447f-95e3-974158661192.cc73861c-5ea9-4ec5-b37b-7ba15f52d652
Nov 06 12:04:35 devstack sudo[108749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:35 devstack sudo[108749]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7a0f263a-f713-452b-9e24-7cec7038063b tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-377268c1-80e8-447f-95e3-974158661192 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-377268c1-80e8-447f-95e3-974158661192.cc73861c-5ea9-4ec5-b37b-7ba15f52d652" returned: 0 in 0.381s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:35 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-7a0f263a-f713-452b-9e24-7cec7038063b tempest-ProjectReaderTests-1672117553 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-377268c1-80e8-447f-95e3-974158661192.cc73861c-5ea9-4ec5-b37b-7ba15f52d652 is being set with open permissions: ugo+rw
Nov 06 12:04:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7a0f263a-f713-452b-9e24-7cec7038063b tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-377268c1-80e8-447f-95e3-974158661192.cc73861c-5ea9-4ec5-b37b-7ba15f52d652 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-751ad6e7-efdb-49c6-9f89-8fcfaf8b42d3 tempest-ProjectMemberTests-2128122521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:35 devstack sudo[108755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-377268c1-80e8-447f-95e3-974158661192.cc73861c-5ea9-4ec5-b37b-7ba15f52d652
Nov 06 12:04:35 devstack sudo[108755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:36 devstack sudo[108755]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7a0f263a-f713-452b-9e24-7cec7038063b tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-377268c1-80e8-447f-95e3-974158661192.cc73861c-5ea9-4ec5-b37b-7ba15f52d652" returned: 0 in 0.279s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7a0f263a-f713-452b-9e24-7cec7038063b tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-377268c1-80e8-447f-95e3-974158661192.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:36 devstack sudo[108758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-377268c1-80e8-447f-95e3-974158661192.info
Nov 06 12:04:36 devstack sudo[108758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:36 devstack sudo[108758]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7a0f263a-f713-452b-9e24-7cec7038063b tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-377268c1-80e8-447f-95e3-974158661192.info" returned: 0 in 0.297s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:36 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-7a0f263a-f713-452b-9e24-7cec7038063b tempest-ProjectReaderTests-1672117553 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-377268c1-80e8-447f-95e3-974158661192.info is being set with open permissions: ugo+rw
Nov 06 12:04:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7a0f263a-f713-452b-9e24-7cec7038063b tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-377268c1-80e8-447f-95e3-974158661192.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:36 devstack sudo[108761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-377268c1-80e8-447f-95e3-974158661192.info
Nov 06 12:04:36 devstack sudo[108761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:36 devstack sudo[108761]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7a0f263a-f713-452b-9e24-7cec7038063b tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-377268c1-80e8-447f-95e3-974158661192.info" returned: 0 in 0.262s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-7a0f263a-f713-452b-9e24-7cec7038063b tempest-ProjectReaderTests-1672117553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.246s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-751ad6e7-efdb-49c6-9f89-8fcfaf8b42d3 tempest-ProjectMemberTests-2128122521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.871s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:36 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-751ad6e7-efdb-49c6-9f89-8fcfaf8b42d3 tempest-ProjectMemberTests-2128122521 None] Creating offline snapshot 334ac71c-a4b2-4ba4-9105-c1eeda519ea1 of volume 25a68afd-7b3a-436a-8442-3b389504d014 {{(pid=87165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 12:04:36 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-7a0f263a-f713-452b-9e24-7cec7038063b tempest-ProjectReaderTests-1672117553 None] Create snapshot completed successfully
Nov 06 12:04:36 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d62b2f9-67e3-466e-8928-67f7ae7618df]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:04:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-751ad6e7-efdb-49c6-9f89-8fcfaf8b42d3 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25a68afd-7b3a-436a-8442-3b389504d014 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:36 devstack sudo[108764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25a68afd-7b3a-436a-8442-3b389504d014
Nov 06 12:04:36 devstack sudo[108764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:37 devstack sudo[108764]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-751ad6e7-efdb-49c6-9f89-8fcfaf8b42d3 tempest-ProjectMemberTests-2128122521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25a68afd-7b3a-436a-8442-3b389504d014" returned: 0 in 0.376s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-751ad6e7-efdb-49c6-9f89-8fcfaf8b42d3 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25a68afd-7b3a-436a-8442-3b389504d014,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25a68afd-7b3a-436a-8442-3b389504d014.334ac71c-a4b2-4ba4-9105-c1eeda519ea1 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:37 devstack sudo[108769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25a68afd-7b3a-436a-8442-3b389504d014,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25a68afd-7b3a-436a-8442-3b389504d014.334ac71c-a4b2-4ba4-9105-c1eeda519ea1 1G
Nov 06 12:04:37 devstack sudo[108769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:37 devstack sudo[108769]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-751ad6e7-efdb-49c6-9f89-8fcfaf8b42d3 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25a68afd-7b3a-436a-8442-3b389504d014,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25a68afd-7b3a-436a-8442-3b389504d014.334ac71c-a4b2-4ba4-9105-c1eeda519ea1 1G" returned: 0 in 0.501s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-751ad6e7-efdb-49c6-9f89-8fcfaf8b42d3 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25a68afd-7b3a-436a-8442-3b389504d014 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25a68afd-7b3a-436a-8442-3b389504d014.334ac71c-a4b2-4ba4-9105-c1eeda519ea1 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:37 devstack sudo[108775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25a68afd-7b3a-436a-8442-3b389504d014 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25a68afd-7b3a-436a-8442-3b389504d014.334ac71c-a4b2-4ba4-9105-c1eeda519ea1
Nov 06 12:04:37 devstack sudo[108775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:37 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d8178474-bc53-4cd1-951b-234d5839f3ae tempest-ProjectReaderTests-1672117553 None] Acquiring lock "cinder-cc73861c-5ea9-4ec5-b37b-7ba15f52d652-delete_snapshot" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:37 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d8178474-bc53-4cd1-951b-234d5839f3ae tempest-ProjectReaderTests-1672117553 None] Lock "cinder-cc73861c-5ea9-4ec5-b37b-7ba15f52d652-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:37 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d8178474-bc53-4cd1-951b-234d5839f3ae tempest-ProjectReaderTests-1672117553 None] Acquiring lock "cinder-quobyte-377268c1-80e8-447f-95e3-974158661192" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:37 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d8178474-bc53-4cd1-951b-234d5839f3ae tempest-ProjectReaderTests-1672117553 None] Lock "cinder-quobyte-377268c1-80e8-447f-95e3-974158661192" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:37 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d8178474-bc53-4cd1-951b-234d5839f3ae tempest-ProjectReaderTests-1672117553 None] Acquiring lock "cinder-quobyte-cc73861c-5ea9-4ec5-b37b-7ba15f52d652" by "_delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:37 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d8178474-bc53-4cd1-951b-234d5839f3ae tempest-ProjectReaderTests-1672117553 None] Lock "cinder-quobyte-cc73861c-5ea9-4ec5-b37b-7ba15f52d652" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:37 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-d8178474-bc53-4cd1-951b-234d5839f3ae tempest-ProjectReaderTests-1672117553 None] Deleting offline snapshot cc73861c-5ea9-4ec5-b37b-7ba15f52d652 of volume 377268c1-80e8-447f-95e3-974158661192 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 12:04:37 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-d8178474-bc53-4cd1-951b-234d5839f3ae tempest-ProjectReaderTests-1672117553 None] snapshot_file for this snap is: volume-377268c1-80e8-447f-95e3-974158661192.cc73861c-5ea9-4ec5-b37b-7ba15f52d652 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 12:04:37 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc14683-c07c-444e-9510-d7968ceb2dd2]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:04:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d8178474-bc53-4cd1-951b-234d5839f3ae tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-377268c1-80e8-447f-95e3-974158661192.cc73861c-5ea9-4ec5-b37b-7ba15f52d652 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:37 devstack sudo[108777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-377268c1-80e8-447f-95e3-974158661192.cc73861c-5ea9-4ec5-b37b-7ba15f52d652
Nov 06 12:04:37 devstack sudo[108777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:37 devstack sudo[108775]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-751ad6e7-efdb-49c6-9f89-8fcfaf8b42d3 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25a68afd-7b3a-436a-8442-3b389504d014 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25a68afd-7b3a-436a-8442-3b389504d014.334ac71c-a4b2-4ba4-9105-c1eeda519ea1" returned: 0 in 0.386s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:38 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-751ad6e7-efdb-49c6-9f89-8fcfaf8b42d3 tempest-ProjectMemberTests-2128122521 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25a68afd-7b3a-436a-8442-3b389504d014.334ac71c-a4b2-4ba4-9105-c1eeda519ea1 is being set with open permissions: ugo+rw
Nov 06 12:04:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-751ad6e7-efdb-49c6-9f89-8fcfaf8b42d3 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25a68afd-7b3a-436a-8442-3b389504d014.334ac71c-a4b2-4ba4-9105-c1eeda519ea1 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:38 devstack sudo[108782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25a68afd-7b3a-436a-8442-3b389504d014.334ac71c-a4b2-4ba4-9105-c1eeda519ea1
Nov 06 12:04:38 devstack sudo[108782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:38 devstack sudo[108777]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d8178474-bc53-4cd1-951b-234d5839f3ae tempest-ProjectReaderTests-1672117553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-377268c1-80e8-447f-95e3-974158661192.cc73861c-5ea9-4ec5-b37b-7ba15f52d652" returned: 0 in 0.465s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:38 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-d8178474-bc53-4cd1-951b-234d5839f3ae tempest-ProjectReaderTests-1672117553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-377268c1-80e8-447f-95e3-974158661192(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 12:04:38 devstack sudo[108782]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:38 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[604ff737-5589-4aae-b751-802fec8bbd3d]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:04:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d8178474-bc53-4cd1-951b-234d5839f3ae tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-377268c1-80e8-447f-95e3-974158661192 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-751ad6e7-efdb-49c6-9f89-8fcfaf8b42d3 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25a68afd-7b3a-436a-8442-3b389504d014.334ac71c-a4b2-4ba4-9105-c1eeda519ea1" returned: 0 in 0.324s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-751ad6e7-efdb-49c6-9f89-8fcfaf8b42d3 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25a68afd-7b3a-436a-8442-3b389504d014.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:38 devstack sudo[108789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25a68afd-7b3a-436a-8442-3b389504d014.info
Nov 06 12:04:38 devstack sudo[108789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:38 devstack sudo[108788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-377268c1-80e8-447f-95e3-974158661192
Nov 06 12:04:38 devstack sudo[108788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:38 devstack sudo[108789]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-751ad6e7-efdb-49c6-9f89-8fcfaf8b42d3 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25a68afd-7b3a-436a-8442-3b389504d014.info" returned: 0 in 0.369s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:38 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-751ad6e7-efdb-49c6-9f89-8fcfaf8b42d3 tempest-ProjectMemberTests-2128122521 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25a68afd-7b3a-436a-8442-3b389504d014.info is being set with open permissions: ugo+rw
Nov 06 12:04:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-751ad6e7-efdb-49c6-9f89-8fcfaf8b42d3 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25a68afd-7b3a-436a-8442-3b389504d014.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:38 devstack sudo[108795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25a68afd-7b3a-436a-8442-3b389504d014.info
Nov 06 12:04:38 devstack sudo[108795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:38 devstack sudo[108788]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d8178474-bc53-4cd1-951b-234d5839f3ae tempest-ProjectReaderTests-1672117553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-377268c1-80e8-447f-95e3-974158661192" returned: 0 in 0.577s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d8178474-bc53-4cd1-951b-234d5839f3ae tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-377268c1-80e8-447f-95e3-974158661192.cc73861c-5ea9-4ec5-b37b-7ba15f52d652 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:38 devstack sudo[108798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-377268c1-80e8-447f-95e3-974158661192.cc73861c-5ea9-4ec5-b37b-7ba15f52d652
Nov 06 12:04:38 devstack sudo[108798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:39 devstack sudo[108795]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-751ad6e7-efdb-49c6-9f89-8fcfaf8b42d3 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25a68afd-7b3a-436a-8442-3b389504d014.info" returned: 0 in 0.301s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-751ad6e7-efdb-49c6-9f89-8fcfaf8b42d3 tempest-ProjectMemberTests-2128122521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.427s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:39 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-751ad6e7-efdb-49c6-9f89-8fcfaf8b42d3 tempest-ProjectMemberTests-2128122521 None] Create snapshot completed successfully
Nov 06 12:04:39 devstack sudo[108798]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d8178474-bc53-4cd1-951b-234d5839f3ae tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-377268c1-80e8-447f-95e3-974158661192.cc73861c-5ea9-4ec5-b37b-7ba15f52d652" returned: 0 in 0.383s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d8178474-bc53-4cd1-951b-234d5839f3ae tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-377268c1-80e8-447f-95e3-974158661192.cc73861c-5ea9-4ec5-b37b-7ba15f52d652 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:39 devstack sudo[108805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-377268c1-80e8-447f-95e3-974158661192.cc73861c-5ea9-4ec5-b37b-7ba15f52d652
Nov 06 12:04:39 devstack sudo[108805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:39 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7ef3b29-f668-4498-897e-947914488ae4 tempest-SnapshotDependencyTests-2081702305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:04:39 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c7ef3b29-f668-4498-897e-947914488ae4 tempest-SnapshotDependencyTests-2081702305 None] Flow 'volume_create_manager' (3536496d-e163-440e-b8ea-783da82e4b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:04:39 devstack sudo[108805]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:39 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c7ef3b29-f668-4498-897e-947914488ae4 tempest-SnapshotDependencyTests-2081702305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df710081-8aee-4ba2-bec1-81e215c5e760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-d8178474-bc53-4cd1-951b-234d5839f3ae tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-377268c1-80e8-447f-95e3-974158661192.cc73861c-5ea9-4ec5-b37b-7ba15f52d652" returned: 0 in 0.258s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:39 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c7ef3b29-f668-4498-897e-947914488ae4 tempest-SnapshotDependencyTests-2081702305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df710081-8aee-4ba2-bec1-81e215c5e760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1312133633',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47e572a5-d533-42ba-a7af-352e63af4c9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f5c883b133493d94cdddcc6c2a8df0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:04:39Z,use_quota=True,user_id='8909c24acca34611bdd6b904819e28d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:39 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c7ef3b29-f668-4498-897e-947914488ae4 tempest-SnapshotDependencyTests-2081702305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c87470d6-a1b6-49d5-ab2a-dba5dd4f9c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:39 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c7ef3b29-f668-4498-897e-947914488ae4 tempest-SnapshotDependencyTests-2081702305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c87470d6-a1b6-49d5-ab2a-dba5dd4f9c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:39 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c7ef3b29-f668-4498-897e-947914488ae4 tempest-SnapshotDependencyTests-2081702305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c5772a4-6fa5-4601-880c-fd0ab0e1b3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:39 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c7ef3b29-f668-4498-897e-947914488ae4 tempest-SnapshotDependencyTests-2081702305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c5772a4-6fa5-4601-880c-fd0ab0e1b3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47e572a5-d533-42ba-a7af-352e63af4c9f', 'volume_name': 'volume-47e572a5-d533-42ba-a7af-352e63af4c9f', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:39 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c7ef3b29-f668-4498-897e-947914488ae4 tempest-SnapshotDependencyTests-2081702305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd396fe8-6a93-4a5d-ba68-7819cd65c766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:39 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c7ef3b29-f668-4498-897e-947914488ae4 tempest-SnapshotDependencyTests-2081702305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd396fe8-6a93-4a5d-ba68-7819cd65c766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:39 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c7ef3b29-f668-4498-897e-947914488ae4 tempest-SnapshotDependencyTests-2081702305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e184bcd2-584a-4108-ad82-9810be7368ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:39 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-c7ef3b29-f668-4498-897e-947914488ae4 tempest-SnapshotDependencyTests-2081702305 None] Volume 47e572a5-d533-42ba-a7af-352e63af4c9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47e572a5-d533-42ba-a7af-352e63af4c9f', 'volume_size': 1}
Nov 06 12:04:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c7ef3b29-f668-4498-897e-947914488ae4 tempest-SnapshotDependencyTests-2081702305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c7ef3b29-f668-4498-897e-947914488ae4 tempest-SnapshotDependencyTests-2081702305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:39 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-c7ef3b29-f668-4498-897e-947914488ae4 tempest-SnapshotDependencyTests-2081702305 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1312133633',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47e572a5-d533-42ba-a7af-352e63af4c9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f5c883b133493d94cdddcc6c2a8df0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:04:39Z,use_quota=True,user_id='8909c24acca34611bdd6b904819e28d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:04:39 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-c7ef3b29-f668-4498-897e-947914488ae4 tempest-SnapshotDependencyTests-2081702305 None] Creating volume 47e572a5-d533-42ba-a7af-352e63af4c9f {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:04:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c7ef3b29-f668-4498-897e-947914488ae4 tempest-SnapshotDependencyTests-2081702305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c7ef3b29-f668-4498-897e-947914488ae4 tempest-SnapshotDependencyTests-2081702305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:39 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-c7ef3b29-f668-4498-897e-947914488ae4 tempest-SnapshotDependencyTests-2081702305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:04:39 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-c7ef3b29-f668-4498-897e-947914488ae4 tempest-SnapshotDependencyTests-2081702305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:04:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c7ef3b29-f668-4498-897e-947914488ae4 tempest-SnapshotDependencyTests-2081702305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:39 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-c7ef3b29-f668-4498-897e-947914488ae4 tempest-SnapshotDependencyTests-2081702305 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:04:39 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-c7ef3b29-f668-4498-897e-947914488ae4 tempest-SnapshotDependencyTests-2081702305 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:04:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c7ef3b29-f668-4498-897e-947914488ae4 tempest-SnapshotDependencyTests-2081702305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:39 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d8178474-bc53-4cd1-951b-234d5839f3ae tempest-ProjectReaderTests-1672117553 None] Lock "cinder-quobyte-cc73861c-5ea9-4ec5-b37b-7ba15f52d652" released by "_delete_snapshot" :: held 1.893s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:39 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d8178474-bc53-4cd1-951b-234d5839f3ae tempest-ProjectReaderTests-1672117553 None] Lock "cinder-quobyte-377268c1-80e8-447f-95e3-974158661192" released by "delete_snapshot" :: held 1.921s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:39 devstack sudo[108808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f 1073741824
Nov 06 12:04:39 devstack sudo[108808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:39 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-d8178474-bc53-4cd1-951b-234d5839f3ae tempest-ProjectReaderTests-1672117553 None] Created reservations ['6d524521-9e55-474a-aac7-45a6cff192b3', 'cba61039-690e-4ec5-a1f2-ba21389f1ef1', 'a80bbea7-a428-4833-a861-7b468002b1e2', 'ab5bd3b1-ada5-4dbf-af63-e906634d7eaf'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:04:39 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-d8178474-bc53-4cd1-951b-234d5839f3ae tempest-ProjectReaderTests-1672117553 None] Delete snapshot completed successfully.
Nov 06 12:04:39 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-d8178474-bc53-4cd1-951b-234d5839f3ae tempest-ProjectReaderTests-1672117553 None] Lock "cinder-cc73861c-5ea9-4ec5-b37b-7ba15f52d652-delete_snapshot" released by "delete_snapshot" :: held 2.061s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:39 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-24a1af83-7c31-4d83-8029-0e7e6fc655e3 tempest-ProjectReaderTests-1672117553 None] Acquiring lock "cinder-377268c1-80e8-447f-95e3-974158661192-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:39 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-24a1af83-7c31-4d83-8029-0e7e6fc655e3 tempest-ProjectReaderTests-1672117553 None] Lock "cinder-377268c1-80e8-447f-95e3-974158661192-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:39 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-24a1af83-7c31-4d83-8029-0e7e6fc655e3 tempest-ProjectReaderTests-1672117553 None] Acquiring lock "cinder-quobyte-377268c1-80e8-447f-95e3-974158661192" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:39 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-24a1af83-7c31-4d83-8029-0e7e6fc655e3 tempest-ProjectReaderTests-1672117553 None] Lock "cinder-quobyte-377268c1-80e8-447f-95e3-974158661192" acquired by "delete_volume" :: waited 0.014s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:39 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[95825d19-63ac-4fcd-913b-3609a69b2277]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:04:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-24a1af83-7c31-4d83-8029-0e7e6fc655e3 tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-377268c1-80e8-447f-95e3-974158661192 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:39 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-84d6a515-546f-4fde-b729-5fb6facb3dab tempest-ProjectMemberTests-2128122521 None] Acquiring lock "cinder-334ac71c-a4b2-4ba4-9105-c1eeda519ea1-delete_snapshot" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:40 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-84d6a515-546f-4fde-b729-5fb6facb3dab tempest-ProjectMemberTests-2128122521 None] Lock "cinder-334ac71c-a4b2-4ba4-9105-c1eeda519ea1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:40 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-84d6a515-546f-4fde-b729-5fb6facb3dab tempest-ProjectMemberTests-2128122521 None] Acquiring lock "cinder-quobyte-25a68afd-7b3a-436a-8442-3b389504d014" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:40 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-84d6a515-546f-4fde-b729-5fb6facb3dab tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-25a68afd-7b3a-436a-8442-3b389504d014" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:40 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-84d6a515-546f-4fde-b729-5fb6facb3dab tempest-ProjectMemberTests-2128122521 None] Acquiring lock "cinder-quobyte-334ac71c-a4b2-4ba4-9105-c1eeda519ea1" by "_delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:40 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-84d6a515-546f-4fde-b729-5fb6facb3dab tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-334ac71c-a4b2-4ba4-9105-c1eeda519ea1" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:40 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-84d6a515-546f-4fde-b729-5fb6facb3dab tempest-ProjectMemberTests-2128122521 None] Deleting offline snapshot 334ac71c-a4b2-4ba4-9105-c1eeda519ea1 of volume 25a68afd-7b3a-436a-8442-3b389504d014 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 12:04:40 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-84d6a515-546f-4fde-b729-5fb6facb3dab tempest-ProjectMemberTests-2128122521 None] snapshot_file for this snap is: volume-25a68afd-7b3a-436a-8442-3b389504d014.334ac71c-a4b2-4ba4-9105-c1eeda519ea1 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 12:04:40 devstack sudo[108813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-377268c1-80e8-447f-95e3-974158661192
Nov 06 12:04:40 devstack sudo[108813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:40 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fca563-3ecf-451d-ba35-10a270b03e3f]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:04:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-84d6a515-546f-4fde-b729-5fb6facb3dab tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25a68afd-7b3a-436a-8442-3b389504d014.334ac71c-a4b2-4ba4-9105-c1eeda519ea1 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:40 devstack sudo[108808]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c7ef3b29-f668-4498-897e-947914488ae4 tempest-SnapshotDependencyTests-2081702305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f 1073741824" returned: 0 in 0.550s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c7ef3b29-f668-4498-897e-947914488ae4 tempest-SnapshotDependencyTests-2081702305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:40 devstack sudo[108816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25a68afd-7b3a-436a-8442-3b389504d014.334ac71c-a4b2-4ba4-9105-c1eeda519ea1
Nov 06 12:04:40 devstack sudo[108816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:40 devstack sudo[108817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f
Nov 06 12:04:40 devstack sudo[108817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:40 devstack sudo[108813]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-24a1af83-7c31-4d83-8029-0e7e6fc655e3 tempest-ProjectReaderTests-1672117553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-377268c1-80e8-447f-95e3-974158661192" returned: 0 in 0.417s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-24a1af83-7c31-4d83-8029-0e7e6fc655e3 tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-377268c1-80e8-447f-95e3-974158661192 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:40 devstack sudo[108823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-377268c1-80e8-447f-95e3-974158661192
Nov 06 12:04:40 devstack sudo[108823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:40 devstack sudo[108817]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c7ef3b29-f668-4498-897e-947914488ae4 tempest-SnapshotDependencyTests-2081702305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f" returned: 0 in 0.275s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:40 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-c7ef3b29-f668-4498-897e-947914488ae4 tempest-SnapshotDependencyTests-2081702305 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:04:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-c7ef3b29-f668-4498-897e-947914488ae4 tempest-SnapshotDependencyTests-2081702305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:40 devstack sudo[108816]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c7ef3b29-f668-4498-897e-947914488ae4 tempest-SnapshotDependencyTests-2081702305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e184bcd2-584a-4108-ad82-9810be7368ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47e572a5-d533-42ba-a7af-352e63af4c9f', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c7ef3b29-f668-4498-897e-947914488ae4 tempest-SnapshotDependencyTests-2081702305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cd52ceb-820b-4f6b-ae69-40e5a50742b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-84d6a515-546f-4fde-b729-5fb6facb3dab tempest-ProjectMemberTests-2128122521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25a68afd-7b3a-436a-8442-3b389504d014.334ac71c-a4b2-4ba4-9105-c1eeda519ea1" returned: 0 in 0.399s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:40 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-84d6a515-546f-4fde-b729-5fb6facb3dab tempest-ProjectMemberTests-2128122521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25a68afd-7b3a-436a-8442-3b389504d014(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 12:04:40 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-c7ef3b29-f668-4498-897e-947914488ae4 tempest-SnapshotDependencyTests-2081702305 None] Volume volume-47e572a5-d533-42ba-a7af-352e63af4c9f (47e572a5-d533-42ba-a7af-352e63af4c9f): created successfully
Nov 06 12:04:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c7ef3b29-f668-4498-897e-947914488ae4 tempest-SnapshotDependencyTests-2081702305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cd52ceb-820b-4f6b-ae69-40e5a50742b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:40 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-c7ef3b29-f668-4498-897e-947914488ae4 tempest-SnapshotDependencyTests-2081702305 None] Flow 'volume_create_manager' (3536496d-e163-440e-b8ea-783da82e4b80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:04:40 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e3acd8-aff0-4667-b3a1-3c3f85fe5fe4]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:04:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-84d6a515-546f-4fde-b729-5fb6facb3dab tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25a68afd-7b3a-436a-8442-3b389504d014 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:40 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-c7ef3b29-f668-4498-897e-947914488ae4 tempest-SnapshotDependencyTests-2081702305 None] Created volume successfully.
Nov 06 12:04:40 devstack sudo[108823]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-24a1af83-7c31-4d83-8029-0e7e6fc655e3 tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-377268c1-80e8-447f-95e3-974158661192" returned: 0 in 0.270s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:40 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-24a1af83-7c31-4d83-8029-0e7e6fc655e3 tempest-ProjectReaderTests-1672117553 None] Lock "cinder-quobyte-377268c1-80e8-447f-95e3-974158661192" released by "delete_volume" :: held 0.757s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:40 devstack sudo[108829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25a68afd-7b3a-436a-8442-3b389504d014
Nov 06 12:04:40 devstack sudo[108829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:40 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-24a1af83-7c31-4d83-8029-0e7e6fc655e3 tempest-ProjectReaderTests-1672117553 None] Created reservations ['9bba1c57-9f8f-4a17-8802-e52bc20ff698', '0668408e-635d-479e-98b7-bc2a684e4af0', '0352bdbd-1668-41b8-8aec-be55579aa410', '3a14a38d-09ea-418c-892e-ff5359c66b72'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:04:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-24a1af83-7c31-4d83-8029-0e7e6fc655e3 tempest-ProjectReaderTests-1672117553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-24a1af83-7c31-4d83-8029-0e7e6fc655e3 tempest-ProjectReaderTests-1672117553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:40 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-24a1af83-7c31-4d83-8029-0e7e6fc655e3 tempest-ProjectReaderTests-1672117553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:04:40 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-24a1af83-7c31-4d83-8029-0e7e6fc655e3 tempest-ProjectReaderTests-1672117553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:04:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-24a1af83-7c31-4d83-8029-0e7e6fc655e3 tempest-ProjectReaderTests-1672117553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-24a1af83-7c31-4d83-8029-0e7e6fc655e3 tempest-ProjectReaderTests-1672117553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:40 devstack sudo[108832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:04:40 devstack sudo[108832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:40 devstack sudo[108829]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-84d6a515-546f-4fde-b729-5fb6facb3dab tempest-ProjectMemberTests-2128122521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25a68afd-7b3a-436a-8442-3b389504d014" returned: 0 in 0.401s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-84d6a515-546f-4fde-b729-5fb6facb3dab tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25a68afd-7b3a-436a-8442-3b389504d014.334ac71c-a4b2-4ba4-9105-c1eeda519ea1 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:40 devstack sudo[108837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25a68afd-7b3a-436a-8442-3b389504d014.334ac71c-a4b2-4ba4-9105-c1eeda519ea1
Nov 06 12:04:40 devstack sudo[108837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:41 devstack sudo[108832]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-24a1af83-7c31-4d83-8029-0e7e6fc655e3 tempest-ProjectReaderTests-1672117553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.265s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:41 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-24a1af83-7c31-4d83-8029-0e7e6fc655e3 tempest-ProjectReaderTests-1672117553 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:04:41 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-24a1af83-7c31-4d83-8029-0e7e6fc655e3 tempest-ProjectReaderTests-1672117553 None] Deleted volume successfully.
Nov 06 12:04:41 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-24a1af83-7c31-4d83-8029-0e7e6fc655e3 tempest-ProjectReaderTests-1672117553 None] Lock "cinder-377268c1-80e8-447f-95e3-974158661192-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:41 devstack sudo[108837]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-84d6a515-546f-4fde-b729-5fb6facb3dab tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25a68afd-7b3a-436a-8442-3b389504d014.334ac71c-a4b2-4ba4-9105-c1eeda519ea1" returned: 0 in 0.367s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-84d6a515-546f-4fde-b729-5fb6facb3dab tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25a68afd-7b3a-436a-8442-3b389504d014.334ac71c-a4b2-4ba4-9105-c1eeda519ea1 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:41 devstack sudo[108844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25a68afd-7b3a-436a-8442-3b389504d014.334ac71c-a4b2-4ba4-9105-c1eeda519ea1
Nov 06 12:04:41 devstack sudo[108844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:41 devstack sudo[108844]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-84d6a515-546f-4fde-b729-5fb6facb3dab tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25a68afd-7b3a-436a-8442-3b389504d014.334ac71c-a4b2-4ba4-9105-c1eeda519ea1" returned: 0 in 0.265s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:41 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-84d6a515-546f-4fde-b729-5fb6facb3dab tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-334ac71c-a4b2-4ba4-9105-c1eeda519ea1" released by "_delete_snapshot" :: held 1.580s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:41 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-84d6a515-546f-4fde-b729-5fb6facb3dab tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-25a68afd-7b3a-436a-8442-3b389504d014" released by "delete_snapshot" :: held 1.607s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:41 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-84d6a515-546f-4fde-b729-5fb6facb3dab tempest-ProjectMemberTests-2128122521 None] Created reservations ['461beab7-7e54-4e58-bbe1-3c17a2f70013', '2a3e2720-dcd1-4bc6-a62a-600053a1ab27', 'da6b5dfd-c337-4203-9a18-3c8d553b9093', 'cf8e26d0-c514-436d-b7e2-9b6432c864c3'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:04:41 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-84d6a515-546f-4fde-b729-5fb6facb3dab tempest-ProjectMemberTests-2128122521 None] Delete snapshot completed successfully.
Nov 06 12:04:41 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-84d6a515-546f-4fde-b729-5fb6facb3dab tempest-ProjectMemberTests-2128122521 None] Lock "cinder-334ac71c-a4b2-4ba4-9105-c1eeda519ea1-delete_snapshot" released by "delete_snapshot" :: held 1.788s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-cf6af3f4-b951-4e6c-98c7-08de0cff8155 tempest-SnapshotDependencyTests-2081702305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-cf6af3f4-b951-4e6c-98c7-08de0cff8155 tempest-SnapshotDependencyTests-2081702305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:41 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-cf6af3f4-b951-4e6c-98c7-08de0cff8155 tempest-SnapshotDependencyTests-2081702305 None] Creating offline snapshot 8055e27c-0a47-40b8-9e7d-1bc7bdef7548 of volume 47e572a5-d533-42ba-a7af-352e63af4c9f {{(pid=87165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 12:04:41 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[01580f32-5485-409f-ab18-5b7f8828b2c8]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:04:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cf6af3f4-b951-4e6c-98c7-08de0cff8155 tempest-SnapshotDependencyTests-2081702305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:42 devstack sudo[108847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f
Nov 06 12:04:42 devstack sudo[108847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:42 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e1df4738-f5bb-4789-8c9b-d92c04f5b9ea tempest-ProjectMemberTests-2128122521 None] Acquiring lock "cinder-25a68afd-7b3a-436a-8442-3b389504d014-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:42 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e1df4738-f5bb-4789-8c9b-d92c04f5b9ea tempest-ProjectMemberTests-2128122521 None] Lock "cinder-25a68afd-7b3a-436a-8442-3b389504d014-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:42 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e1df4738-f5bb-4789-8c9b-d92c04f5b9ea tempest-ProjectMemberTests-2128122521 None] Acquiring lock "cinder-quobyte-25a68afd-7b3a-436a-8442-3b389504d014" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:42 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e1df4738-f5bb-4789-8c9b-d92c04f5b9ea tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-25a68afd-7b3a-436a-8442-3b389504d014" acquired by "delete_volume" :: waited 0.017s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:42 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e82799-b7a8-4f2f-bf16-bc888e42fffe]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:04:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e1df4738-f5bb-4789-8c9b-d92c04f5b9ea tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25a68afd-7b3a-436a-8442-3b389504d014 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:42 devstack sudo[108847]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cf6af3f4-b951-4e6c-98c7-08de0cff8155 tempest-SnapshotDependencyTests-2081702305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f" returned: 0 in 0.442s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cf6af3f4-b951-4e6c-98c7-08de0cff8155 tempest-SnapshotDependencyTests-2081702305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f.8055e27c-0a47-40b8-9e7d-1bc7bdef7548 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:42 devstack sudo[108853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f.8055e27c-0a47-40b8-9e7d-1bc7bdef7548 1G
Nov 06 12:04:42 devstack sudo[108853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:42 devstack sudo[108852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25a68afd-7b3a-436a-8442-3b389504d014
Nov 06 12:04:42 devstack sudo[108852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:42 devstack sudo[108852]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e1df4738-f5bb-4789-8c9b-d92c04f5b9ea tempest-ProjectMemberTests-2128122521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25a68afd-7b3a-436a-8442-3b389504d014" returned: 0 in 0.468s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e1df4738-f5bb-4789-8c9b-d92c04f5b9ea tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25a68afd-7b3a-436a-8442-3b389504d014 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:42 devstack sudo[108863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25a68afd-7b3a-436a-8442-3b389504d014
Nov 06 12:04:42 devstack sudo[108863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:42 devstack sudo[108853]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cf6af3f4-b951-4e6c-98c7-08de0cff8155 tempest-SnapshotDependencyTests-2081702305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f.8055e27c-0a47-40b8-9e7d-1bc7bdef7548 1G" returned: 0 in 0.489s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cf6af3f4-b951-4e6c-98c7-08de0cff8155 tempest-SnapshotDependencyTests-2081702305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47e572a5-d533-42ba-a7af-352e63af4c9f -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f.8055e27c-0a47-40b8-9e7d-1bc7bdef7548 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:42 devstack sudo[108865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47e572a5-d533-42ba-a7af-352e63af4c9f -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f.8055e27c-0a47-40b8-9e7d-1bc7bdef7548
Nov 06 12:04:42 devstack sudo[108865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:43 devstack sudo[108863]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e1df4738-f5bb-4789-8c9b-d92c04f5b9ea tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-25a68afd-7b3a-436a-8442-3b389504d014" returned: 0 in 0.280s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:43 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e1df4738-f5bb-4789-8c9b-d92c04f5b9ea tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-25a68afd-7b3a-436a-8442-3b389504d014" released by "delete_volume" :: held 0.828s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:43 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-e1df4738-f5bb-4789-8c9b-d92c04f5b9ea tempest-ProjectMemberTests-2128122521 None] Created reservations ['3820d3fb-228c-4991-a910-69a1c1fc80f1', 'b67aa167-f1f9-46dd-baed-61f57285f6f9', '966ac2d5-b89e-42a3-82d8-f7980193706b', '5f8bf878-9115-4d88-af66-38eb0c85945f'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:04:43 devstack sudo[108865]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cf6af3f4-b951-4e6c-98c7-08de0cff8155 tempest-SnapshotDependencyTests-2081702305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47e572a5-d533-42ba-a7af-352e63af4c9f -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f.8055e27c-0a47-40b8-9e7d-1bc7bdef7548" returned: 0 in 0.338s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:43 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-cf6af3f4-b951-4e6c-98c7-08de0cff8155 tempest-SnapshotDependencyTests-2081702305 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f.8055e27c-0a47-40b8-9e7d-1bc7bdef7548 is being set with open permissions: ugo+rw
Nov 06 12:04:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cf6af3f4-b951-4e6c-98c7-08de0cff8155 tempest-SnapshotDependencyTests-2081702305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f.8055e27c-0a47-40b8-9e7d-1bc7bdef7548 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:43 devstack sudo[108871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f.8055e27c-0a47-40b8-9e7d-1bc7bdef7548
Nov 06 12:04:43 devstack sudo[108871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e1df4738-f5bb-4789-8c9b-d92c04f5b9ea tempest-ProjectMemberTests-2128122521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e1df4738-f5bb-4789-8c9b-d92c04f5b9ea tempest-ProjectMemberTests-2128122521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:43 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-e1df4738-f5bb-4789-8c9b-d92c04f5b9ea tempest-ProjectMemberTests-2128122521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:04:43 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-e1df4738-f5bb-4789-8c9b-d92c04f5b9ea tempest-ProjectMemberTests-2128122521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:04:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e1df4738-f5bb-4789-8c9b-d92c04f5b9ea tempest-ProjectMemberTests-2128122521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e1df4738-f5bb-4789-8c9b-d92c04f5b9ea tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:43 devstack sudo[108873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:04:43 devstack sudo[108873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:43 devstack sudo[108873]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e1df4738-f5bb-4789-8c9b-d92c04f5b9ea tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.326s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:43 devstack sudo[108871]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:43 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-e1df4738-f5bb-4789-8c9b-d92c04f5b9ea tempest-ProjectMemberTests-2128122521 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:04:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cf6af3f4-b951-4e6c-98c7-08de0cff8155 tempest-SnapshotDependencyTests-2081702305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f.8055e27c-0a47-40b8-9e7d-1bc7bdef7548" returned: 0 in 0.392s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:43 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-e1df4738-f5bb-4789-8c9b-d92c04f5b9ea tempest-ProjectMemberTests-2128122521 None] Deleted volume successfully.
Nov 06 12:04:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cf6af3f4-b951-4e6c-98c7-08de0cff8155 tempest-SnapshotDependencyTests-2081702305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:43 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-e1df4738-f5bb-4789-8c9b-d92c04f5b9ea tempest-ProjectMemberTests-2128122521 None] Lock "cinder-25a68afd-7b3a-436a-8442-3b389504d014-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:43 devstack sudo[108877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f.info
Nov 06 12:04:43 devstack sudo[108877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:43 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-8db7a2d1-f2b7-454b-9fb0-66a556dd6766 tempest-ProjectMemberTests-2128122521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:04:43 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8db7a2d1-f2b7-454b-9fb0-66a556dd6766 tempest-ProjectMemberTests-2128122521 None] Flow 'volume_create_manager' (dbc3ac7b-d67a-439f-8ca4-2f4fba70643f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:04:43 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8db7a2d1-f2b7-454b-9fb0-66a556dd6766 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4164053-4062-4b85-8699-8dfa2df349d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:43 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8db7a2d1-f2b7-454b-9fb0-66a556dd6766 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4164053-4062-4b85-8699-8dfa2df349d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1370268449',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0522dae1-24f4-493b-953e-66dd8949a6ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3c5c4d5cd09492198badac02cec1874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:04:44Z,use_quota=True,user_id='78f8479fdeb04b689787bce30dc332ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:43 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8db7a2d1-f2b7-454b-9fb0-66a556dd6766 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61245e94-c3a7-4cdc-8f97-3baadba2eb6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:43 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8db7a2d1-f2b7-454b-9fb0-66a556dd6766 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61245e94-c3a7-4cdc-8f97-3baadba2eb6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:43 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8db7a2d1-f2b7-454b-9fb0-66a556dd6766 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b016ed7c-bda4-45f3-8ef6-98e4530f9797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:43 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8db7a2d1-f2b7-454b-9fb0-66a556dd6766 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b016ed7c-bda4-45f3-8ef6-98e4530f9797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0522dae1-24f4-493b-953e-66dd8949a6ba', 'volume_name': 'volume-0522dae1-24f4-493b-953e-66dd8949a6ba', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:43 devstack sudo[108877]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:43 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8db7a2d1-f2b7-454b-9fb0-66a556dd6766 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6359ac9-0761-443f-ad72-a3364603a08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:43 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8db7a2d1-f2b7-454b-9fb0-66a556dd6766 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6359ac9-0761-443f-ad72-a3364603a08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:43 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8db7a2d1-f2b7-454b-9fb0-66a556dd6766 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a063520-c3f1-4a72-a515-6caf4868770e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:43 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-8db7a2d1-f2b7-454b-9fb0-66a556dd6766 tempest-ProjectMemberTests-2128122521 None] Volume 0522dae1-24f4-493b-953e-66dd8949a6ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0522dae1-24f4-493b-953e-66dd8949a6ba', 'volume_size': 1}
Nov 06 12:04:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-8db7a2d1-f2b7-454b-9fb0-66a556dd6766 tempest-ProjectMemberTests-2128122521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cf6af3f4-b951-4e6c-98c7-08de0cff8155 tempest-SnapshotDependencyTests-2081702305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f.info" returned: 0 in 0.342s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:44 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-cf6af3f4-b951-4e6c-98c7-08de0cff8155 tempest-SnapshotDependencyTests-2081702305 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f.info is being set with open permissions: ugo+rw
Nov 06 12:04:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cf6af3f4-b951-4e6c-98c7-08de0cff8155 tempest-SnapshotDependencyTests-2081702305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:44 devstack sudo[108880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f.info
Nov 06 12:04:44 devstack sudo[108880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:44 devstack sudo[108880]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-cf6af3f4-b951-4e6c-98c7-08de0cff8155 tempest-SnapshotDependencyTests-2081702305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f.info" returned: 0 in 0.262s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-cf6af3f4-b951-4e6c-98c7-08de0cff8155 tempest-SnapshotDependencyTests-2081702305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.384s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-8db7a2d1-f2b7-454b-9fb0-66a556dd6766 tempest-ProjectMemberTests-2128122521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.289s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:44 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-8db7a2d1-f2b7-454b-9fb0-66a556dd6766 tempest-ProjectMemberTests-2128122521 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1370268449',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0522dae1-24f4-493b-953e-66dd8949a6ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3c5c4d5cd09492198badac02cec1874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:04:44Z,use_quota=True,user_id='78f8479fdeb04b689787bce30dc332ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:04:44 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-8db7a2d1-f2b7-454b-9fb0-66a556dd6766 tempest-ProjectMemberTests-2128122521 None] Creating volume 0522dae1-24f4-493b-953e-66dd8949a6ba {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:04:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-8db7a2d1-f2b7-454b-9fb0-66a556dd6766 tempest-ProjectMemberTests-2128122521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-8db7a2d1-f2b7-454b-9fb0-66a556dd6766 tempest-ProjectMemberTests-2128122521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:44 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-8db7a2d1-f2b7-454b-9fb0-66a556dd6766 tempest-ProjectMemberTests-2128122521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:04:44 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-8db7a2d1-f2b7-454b-9fb0-66a556dd6766 tempest-ProjectMemberTests-2128122521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:04:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-8db7a2d1-f2b7-454b-9fb0-66a556dd6766 tempest-ProjectMemberTests-2128122521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:44 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-8db7a2d1-f2b7-454b-9fb0-66a556dd6766 tempest-ProjectMemberTests-2128122521 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:04:44 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-8db7a2d1-f2b7-454b-9fb0-66a556dd6766 tempest-ProjectMemberTests-2128122521 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:04:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-8db7a2d1-f2b7-454b-9fb0-66a556dd6766 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0522dae1-24f4-493b-953e-66dd8949a6ba 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:44 devstack sudo[108883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0522dae1-24f4-493b-953e-66dd8949a6ba 1073741824
Nov 06 12:04:44 devstack sudo[108883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:44 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-cf6af3f4-b951-4e6c-98c7-08de0cff8155 tempest-SnapshotDependencyTests-2081702305 None] Create snapshot completed successfully
Nov 06 12:04:44 devstack sudo[108883]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-8db7a2d1-f2b7-454b-9fb0-66a556dd6766 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0522dae1-24f4-493b-953e-66dd8949a6ba 1073741824" returned: 0 in 0.455s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-8db7a2d1-f2b7-454b-9fb0-66a556dd6766 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0522dae1-24f4-493b-953e-66dd8949a6ba {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:44 devstack sudo[108888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0522dae1-24f4-493b-953e-66dd8949a6ba
Nov 06 12:04:44 devstack sudo[108888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:45 devstack sudo[108888]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-8db7a2d1-f2b7-454b-9fb0-66a556dd6766 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0522dae1-24f4-493b-953e-66dd8949a6ba" returned: 0 in 0.255s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:45 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-8db7a2d1-f2b7-454b-9fb0-66a556dd6766 tempest-ProjectMemberTests-2128122521 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:04:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-8db7a2d1-f2b7-454b-9fb0-66a556dd6766 tempest-ProjectMemberTests-2128122521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:45 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8db7a2d1-f2b7-454b-9fb0-66a556dd6766 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a063520-c3f1-4a72-a515-6caf4868770e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0522dae1-24f4-493b-953e-66dd8949a6ba', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:45 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8db7a2d1-f2b7-454b-9fb0-66a556dd6766 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce0f9c95-4571-4450-bdb5-4b9ae6b103e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:45 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-8db7a2d1-f2b7-454b-9fb0-66a556dd6766 tempest-ProjectMemberTests-2128122521 None] Volume volume-0522dae1-24f4-493b-953e-66dd8949a6ba (0522dae1-24f4-493b-953e-66dd8949a6ba): created successfully
Nov 06 12:04:45 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8db7a2d1-f2b7-454b-9fb0-66a556dd6766 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce0f9c95-4571-4450-bdb5-4b9ae6b103e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:45 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-8db7a2d1-f2b7-454b-9fb0-66a556dd6766 tempest-ProjectMemberTests-2128122521 None] Flow 'volume_create_manager' (dbc3ac7b-d67a-439f-8ca4-2f4fba70643f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:04:45 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-8db7a2d1-f2b7-454b-9fb0-66a556dd6766 tempest-ProjectMemberTests-2128122521 None] Created volume successfully.
Nov 06 12:04:45 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:04:45 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] Flow 'volume_create_manager' (30ab648b-d79d-4ad3-a9f2-74459666bb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:04:45 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24a9994f-2348-4cc2-bbbf-d72d6aae5da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:45 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24a9994f-2348-4cc2-bbbf-d72d6aae5da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:04:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44e908da-e2de-421f-9553-c44dc781ea39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f5c883b133493d94cdddcc6c2a8df0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8055e27c-0a47-40b8-9e7d-1bc7bdef7548,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:04:46Z,use_quota=True,user_id='8909c24acca34611bdd6b904819e28d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:45 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d387e101-10a5-4fd7-9666-825c305172d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:45 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d387e101-10a5-4fd7-9666-825c305172d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:45 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f89c890f-b85a-480d-9f06-7b7625aba7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:45 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f89c890f-b85a-480d-9f06-7b7625aba7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '44e908da-e2de-421f-9553-c44dc781ea39', 'volume_name': 'volume-44e908da-e2de-421f-9553-c44dc781ea39', 'volume_size': 1, 'snapshot_id': '8055e27c-0a47-40b8-9e7d-1bc7bdef7548'}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:45 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d519b19-03ac-442a-b135-2a58a080cf45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:45 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d519b19-03ac-442a-b135-2a58a080cf45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:45 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc936641-8948-4bc1-b3b8-786c0621c788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:45 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] Volume 44e908da-e2de-421f-9553-c44dc781ea39: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-44e908da-e2de-421f-9553-c44dc781ea39', 'volume_size': 1, 'snapshot_id': '8055e27c-0a47-40b8-9e7d-1bc7bdef7548'}
Nov 06 12:04:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:45 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] Acquiring lock "cinder-quobyte-8055e27c-0a47-40b8-9e7d-1bc7bdef7548-44e908da-e2de-421f-9553-c44dc781ea39" by "_create_volume_from_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:46 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] Lock "cinder-quobyte-8055e27c-0a47-40b8-9e7d-1bc7bdef7548-44e908da-e2de-421f-9553-c44dc781ea39" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:46 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] Creating volume 44e908da-e2de-421f-9553-c44dc781ea39 from snapshot 8055e27c-0a47-40b8-9e7d-1bc7bdef7548 {{(pid=87165) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 06 12:04:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:46 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:04:46 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:04:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:46 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:04:46 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] Acquiring lock "cinder-quobyte-44e908da-e2de-421f-9553-c44dc781ea39" by "_copy_volume_from_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:46 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] Lock "cinder-quobyte-44e908da-e2de-421f-9553-c44dc781ea39" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:46 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] snapshot: 8055e27c-0a47-40b8-9e7d-1bc7bdef7548, volume: 44e908da-e2de-421f-9553-c44dc781ea39,  {{(pid=87165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 06 12:04:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:46 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:04:46 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:04:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:46 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[44db70ba-cda2-4dff-99dd-34a73a999c31]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:04:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f.8055e27c-0a47-40b8-9e7d-1bc7bdef7548 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:46 devstack sudo[108894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f.8055e27c-0a47-40b8-9e7d-1bc7bdef7548
Nov 06 12:04:46 devstack sudo[108894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-706cb227-6ffb-4dfd-ae7c-340bac33ffb5 tempest-ProjectMemberTests-2128122521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:46 devstack sudo[108894]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f.8055e27c-0a47-40b8-9e7d-1bc7bdef7548" returned: 0 in 0.452s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:46 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47e572a5-d533-42ba-a7af-352e63af4c9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 12:04:46 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1c3125-3c30-42e2-a3a4-276989a73f50]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:04:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:46 devstack sudo[108899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f
Nov 06 12:04:46 devstack sudo[108899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:47 devstack sudo[108899]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f" returned: 0 in 0.415s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:47 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f {{(pid=87165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 06 12:04:47 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] Creating direct copy from snapshot {{(pid=87165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 06 12:04:47 devstack cinder-volume[87165]: DEBUG cinder.utils [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] Path /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-44e908da-e2de-421f-9553-c44dc781ea39 not found in is_blk_device check {{(pid=87165) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 06 12:04:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-44e908da-e2de-421f-9553-c44dc781ea39 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:47 devstack sudo[108905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-44e908da-e2de-421f-9553-c44dc781ea39
Nov 06 12:04:47 devstack sudo[108905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:53 devstack sudo[108905]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-44e908da-e2de-421f-9553-c44dc781ea39" returned: 0 in 6.186s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:53 devstack cinder-volume[87165]: DEBUG cinder.image.image_utils [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] Image conversion details: src /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f, size 1024.00 MB, duration 6.19 sec, destination /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-44e908da-e2de-421f-9553-c44dc781ea39 {{(pid=87165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 06 12:04:53 devstack cinder-volume[87165]: INFO cinder.image.image_utils [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] Converted 1024.00 MB image at 165.49 MB/s
Nov 06 12:04:53 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-44e908da-e2de-421f-9553-c44dc781ea39 is being set with open permissions: ugo+rw
Nov 06 12:04:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-44e908da-e2de-421f-9553-c44dc781ea39 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:53 devstack sudo[108918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-44e908da-e2de-421f-9553-c44dc781ea39
Nov 06 12:04:53 devstack sudo[108918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:53 devstack sudo[108918]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-44e908da-e2de-421f-9553-c44dc781ea39" returned: 0 in 0.252s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:53 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] Lock "cinder-quobyte-44e908da-e2de-421f-9553-c44dc781ea39" released by "_copy_volume_from_snapshot" :: held 7.425s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:53 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] Lock "cinder-quobyte-8055e27c-0a47-40b8-9e7d-1bc7bdef7548-44e908da-e2de-421f-9553-c44dc781ea39" released by "_create_volume_from_snapshot" :: held 7.495s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.517s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-706cb227-6ffb-4dfd-ae7c-340bac33ffb5 tempest-ProjectMemberTests-2128122521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.229s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:53 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-706cb227-6ffb-4dfd-ae7c-340bac33ffb5 tempest-ProjectMemberTests-2128122521 None] Creating offline snapshot c1cf7be3-43cc-4385-ba4e-702e619a622d of volume 0522dae1-24f4-493b-953e-66dd8949a6ba {{(pid=87165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 12:04:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc936641-8948-4bc1-b3b8-786c0621c788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44e908da-e2de-421f-9553-c44dc781ea39', 'volume_size': 1, 'snapshot_id': '8055e27c-0a47-40b8-9e7d-1bc7bdef7548'}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (358d26f7-f2f7-43f4-83c9-f185208c823b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:53 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[118047a1-7e7b-43e9-a9e0-a31e5015a7e7]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:04:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-706cb227-6ffb-4dfd-ae7c-340bac33ffb5 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0522dae1-24f4-493b-953e-66dd8949a6ba {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:53 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] Volume volume-44e908da-e2de-421f-9553-c44dc781ea39 (44e908da-e2de-421f-9553-c44dc781ea39): created successfully
Nov 06 12:04:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (358d26f7-f2f7-43f4-83c9-f185208c823b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:53 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] Flow 'volume_create_manager' (30ab648b-d79d-4ad3-a9f2-74459666bb1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:04:53 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-a435dcda-2b2e-4b67-b626-5758b74616e3 tempest-SnapshotDependencyTests-2081702305 None] Created volume successfully.
Nov 06 12:04:53 devstack sudo[108921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0522dae1-24f4-493b-953e-66dd8949a6ba
Nov 06 12:04:53 devstack sudo[108921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:53 devstack sudo[108921]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-706cb227-6ffb-4dfd-ae7c-340bac33ffb5 tempest-ProjectMemberTests-2128122521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0522dae1-24f4-493b-953e-66dd8949a6ba" returned: 0 in 0.358s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:53 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-706cb227-6ffb-4dfd-ae7c-340bac33ffb5 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0522dae1-24f4-493b-953e-66dd8949a6ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0522dae1-24f4-493b-953e-66dd8949a6ba.c1cf7be3-43cc-4385-ba4e-702e619a622d 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:53 devstack sudo[108926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0522dae1-24f4-493b-953e-66dd8949a6ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0522dae1-24f4-493b-953e-66dd8949a6ba.c1cf7be3-43cc-4385-ba4e-702e619a622d 1G
Nov 06 12:04:53 devstack sudo[108926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:54 devstack sudo[108926]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-706cb227-6ffb-4dfd-ae7c-340bac33ffb5 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0522dae1-24f4-493b-953e-66dd8949a6ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0522dae1-24f4-493b-953e-66dd8949a6ba.c1cf7be3-43cc-4385-ba4e-702e619a622d 1G" returned: 0 in 0.375s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-706cb227-6ffb-4dfd-ae7c-340bac33ffb5 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0522dae1-24f4-493b-953e-66dd8949a6ba -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0522dae1-24f4-493b-953e-66dd8949a6ba.c1cf7be3-43cc-4385-ba4e-702e619a622d {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:54 devstack sudo[108932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0522dae1-24f4-493b-953e-66dd8949a6ba -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0522dae1-24f4-493b-953e-66dd8949a6ba.c1cf7be3-43cc-4385-ba4e-702e619a622d
Nov 06 12:04:54 devstack sudo[108932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:54 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-00dc8c31-0af4-4396-b9b2-1383ed628099 tempest-SnapshotDependencyTests-2081702305 None] Acquiring lock "cinder-8055e27c-0a47-40b8-9e7d-1bc7bdef7548-delete_snapshot" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:54 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-00dc8c31-0af4-4396-b9b2-1383ed628099 tempest-SnapshotDependencyTests-2081702305 None] Lock "cinder-8055e27c-0a47-40b8-9e7d-1bc7bdef7548-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:54 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-00dc8c31-0af4-4396-b9b2-1383ed628099 tempest-SnapshotDependencyTests-2081702305 None] Acquiring lock "cinder-quobyte-47e572a5-d533-42ba-a7af-352e63af4c9f" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:54 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-00dc8c31-0af4-4396-b9b2-1383ed628099 tempest-SnapshotDependencyTests-2081702305 None] Lock "cinder-quobyte-47e572a5-d533-42ba-a7af-352e63af4c9f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:54 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-00dc8c31-0af4-4396-b9b2-1383ed628099 tempest-SnapshotDependencyTests-2081702305 None] Acquiring lock "cinder-quobyte-8055e27c-0a47-40b8-9e7d-1bc7bdef7548" by "_delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:54 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-00dc8c31-0af4-4396-b9b2-1383ed628099 tempest-SnapshotDependencyTests-2081702305 None] Lock "cinder-quobyte-8055e27c-0a47-40b8-9e7d-1bc7bdef7548" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:54 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-00dc8c31-0af4-4396-b9b2-1383ed628099 tempest-SnapshotDependencyTests-2081702305 None] Deleting offline snapshot 8055e27c-0a47-40b8-9e7d-1bc7bdef7548 of volume 47e572a5-d533-42ba-a7af-352e63af4c9f {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 12:04:54 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-00dc8c31-0af4-4396-b9b2-1383ed628099 tempest-SnapshotDependencyTests-2081702305 None] snapshot_file for this snap is: volume-47e572a5-d533-42ba-a7af-352e63af4c9f.8055e27c-0a47-40b8-9e7d-1bc7bdef7548 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 12:04:54 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef79ac83-24bb-42f2-9dd3-e649fc9e12ff]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:04:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-00dc8c31-0af4-4396-b9b2-1383ed628099 tempest-SnapshotDependencyTests-2081702305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f.8055e27c-0a47-40b8-9e7d-1bc7bdef7548 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:54 devstack sudo[108932]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-706cb227-6ffb-4dfd-ae7c-340bac33ffb5 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0522dae1-24f4-493b-953e-66dd8949a6ba -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0522dae1-24f4-493b-953e-66dd8949a6ba.c1cf7be3-43cc-4385-ba4e-702e619a622d" returned: 0 in 0.293s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:54 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-706cb227-6ffb-4dfd-ae7c-340bac33ffb5 tempest-ProjectMemberTests-2128122521 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0522dae1-24f4-493b-953e-66dd8949a6ba.c1cf7be3-43cc-4385-ba4e-702e619a622d is being set with open permissions: ugo+rw
Nov 06 12:04:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-706cb227-6ffb-4dfd-ae7c-340bac33ffb5 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0522dae1-24f4-493b-953e-66dd8949a6ba.c1cf7be3-43cc-4385-ba4e-702e619a622d {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:54 devstack sudo[108938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0522dae1-24f4-493b-953e-66dd8949a6ba.c1cf7be3-43cc-4385-ba4e-702e619a622d
Nov 06 12:04:54 devstack sudo[108938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:54 devstack sudo[108937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f.8055e27c-0a47-40b8-9e7d-1bc7bdef7548
Nov 06 12:04:54 devstack sudo[108937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:54 devstack sudo[108938]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-706cb227-6ffb-4dfd-ae7c-340bac33ffb5 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0522dae1-24f4-493b-953e-66dd8949a6ba.c1cf7be3-43cc-4385-ba4e-702e619a622d" returned: 0 in 0.269s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-706cb227-6ffb-4dfd-ae7c-340bac33ffb5 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0522dae1-24f4-493b-953e-66dd8949a6ba.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:54 devstack sudo[108945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0522dae1-24f4-493b-953e-66dd8949a6ba.info
Nov 06 12:04:54 devstack sudo[108945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:54 devstack sudo[108937]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-00dc8c31-0af4-4396-b9b2-1383ed628099 tempest-SnapshotDependencyTests-2081702305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f.8055e27c-0a47-40b8-9e7d-1bc7bdef7548" returned: 0 in 0.397s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:54 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-00dc8c31-0af4-4396-b9b2-1383ed628099 tempest-SnapshotDependencyTests-2081702305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47e572a5-d533-42ba-a7af-352e63af4c9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 12:04:54 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[273f86ef-e4a7-43c1-9424-65438b983e5b]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:04:54 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-00dc8c31-0af4-4396-b9b2-1383ed628099 tempest-SnapshotDependencyTests-2081702305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:55 devstack sudo[108948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f
Nov 06 12:04:55 devstack sudo[108948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:55 devstack sudo[108945]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-706cb227-6ffb-4dfd-ae7c-340bac33ffb5 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0522dae1-24f4-493b-953e-66dd8949a6ba.info" returned: 0 in 0.269s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:55 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-706cb227-6ffb-4dfd-ae7c-340bac33ffb5 tempest-ProjectMemberTests-2128122521 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0522dae1-24f4-493b-953e-66dd8949a6ba.info is being set with open permissions: ugo+rw
Nov 06 12:04:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-706cb227-6ffb-4dfd-ae7c-340bac33ffb5 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0522dae1-24f4-493b-953e-66dd8949a6ba.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:55 devstack sudo[108951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0522dae1-24f4-493b-953e-66dd8949a6ba.info
Nov 06 12:04:55 devstack sudo[108951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:55 devstack sudo[108951]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-706cb227-6ffb-4dfd-ae7c-340bac33ffb5 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0522dae1-24f4-493b-953e-66dd8949a6ba.info" returned: 0 in 0.251s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-706cb227-6ffb-4dfd-ae7c-340bac33ffb5 tempest-ProjectMemberTests-2128122521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.919s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:55 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-706cb227-6ffb-4dfd-ae7c-340bac33ffb5 tempest-ProjectMemberTests-2128122521 None] Create snapshot completed successfully
Nov 06 12:04:55 devstack sudo[108948]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-00dc8c31-0af4-4396-b9b2-1383ed628099 tempest-SnapshotDependencyTests-2081702305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f" returned: 0 in 0.537s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-00dc8c31-0af4-4396-b9b2-1383ed628099 tempest-SnapshotDependencyTests-2081702305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f.8055e27c-0a47-40b8-9e7d-1bc7bdef7548 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:55 devstack sudo[108957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f.8055e27c-0a47-40b8-9e7d-1bc7bdef7548
Nov 06 12:04:55 devstack sudo[108957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:55 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c1ac72c6-6bb7-4af0-b810-6e81a4b07dcf tempest-ProjectMemberTests-2128122521 None] Acquiring lock "cinder-c1cf7be3-43cc-4385-ba4e-702e619a622d-delete_snapshot" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:55 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c1ac72c6-6bb7-4af0-b810-6e81a4b07dcf tempest-ProjectMemberTests-2128122521 None] Lock "cinder-c1cf7be3-43cc-4385-ba4e-702e619a622d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:55 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c1ac72c6-6bb7-4af0-b810-6e81a4b07dcf tempest-ProjectMemberTests-2128122521 None] Acquiring lock "cinder-quobyte-0522dae1-24f4-493b-953e-66dd8949a6ba" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:55 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c1ac72c6-6bb7-4af0-b810-6e81a4b07dcf tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-0522dae1-24f4-493b-953e-66dd8949a6ba" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:55 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c1ac72c6-6bb7-4af0-b810-6e81a4b07dcf tempest-ProjectMemberTests-2128122521 None] Acquiring lock "cinder-quobyte-c1cf7be3-43cc-4385-ba4e-702e619a622d" by "_delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:55 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c1ac72c6-6bb7-4af0-b810-6e81a4b07dcf tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-c1cf7be3-43cc-4385-ba4e-702e619a622d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:55 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-c1ac72c6-6bb7-4af0-b810-6e81a4b07dcf tempest-ProjectMemberTests-2128122521 None] Deleting offline snapshot c1cf7be3-43cc-4385-ba4e-702e619a622d of volume 0522dae1-24f4-493b-953e-66dd8949a6ba {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 12:04:55 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-c1ac72c6-6bb7-4af0-b810-6e81a4b07dcf tempest-ProjectMemberTests-2128122521 None] snapshot_file for this snap is: volume-0522dae1-24f4-493b-953e-66dd8949a6ba.c1cf7be3-43cc-4385-ba4e-702e619a622d {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 12:04:55 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d18e05f-9afb-4722-b808-731325803d2f]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:04:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c1ac72c6-6bb7-4af0-b810-6e81a4b07dcf tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0522dae1-24f4-493b-953e-66dd8949a6ba.c1cf7be3-43cc-4385-ba4e-702e619a622d {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:55 devstack sudo[108957]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-00dc8c31-0af4-4396-b9b2-1383ed628099 tempest-SnapshotDependencyTests-2081702305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f.8055e27c-0a47-40b8-9e7d-1bc7bdef7548" returned: 0 in 0.349s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:55 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-00dc8c31-0af4-4396-b9b2-1383ed628099 tempest-SnapshotDependencyTests-2081702305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f.8055e27c-0a47-40b8-9e7d-1bc7bdef7548 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:55 devstack sudo[108964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f.8055e27c-0a47-40b8-9e7d-1bc7bdef7548
Nov 06 12:04:55 devstack sudo[108964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:55 devstack sudo[108962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0522dae1-24f4-493b-953e-66dd8949a6ba.c1cf7be3-43cc-4385-ba4e-702e619a622d
Nov 06 12:04:55 devstack sudo[108962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:56 devstack sudo[108964]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-00dc8c31-0af4-4396-b9b2-1383ed628099 tempest-SnapshotDependencyTests-2081702305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f.8055e27c-0a47-40b8-9e7d-1bc7bdef7548" returned: 0 in 0.259s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:56 devstack sudo[108962]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c1ac72c6-6bb7-4af0-b810-6e81a4b07dcf tempest-ProjectMemberTests-2128122521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0522dae1-24f4-493b-953e-66dd8949a6ba.c1cf7be3-43cc-4385-ba4e-702e619a622d" returned: 0 in 0.369s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:56 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-c1ac72c6-6bb7-4af0-b810-6e81a4b07dcf tempest-ProjectMemberTests-2128122521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0522dae1-24f4-493b-953e-66dd8949a6ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 12:04:56 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-00dc8c31-0af4-4396-b9b2-1383ed628099 tempest-SnapshotDependencyTests-2081702305 None] Lock "cinder-quobyte-8055e27c-0a47-40b8-9e7d-1bc7bdef7548" released by "_delete_snapshot" :: held 1.663s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:56 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-00dc8c31-0af4-4396-b9b2-1383ed628099 tempest-SnapshotDependencyTests-2081702305 None] Lock "cinder-quobyte-47e572a5-d533-42ba-a7af-352e63af4c9f" released by "delete_snapshot" :: held 1.689s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:56 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb12161-a957-4649-a13e-937f006835c0]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:04:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c1ac72c6-6bb7-4af0-b810-6e81a4b07dcf tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0522dae1-24f4-493b-953e-66dd8949a6ba {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:56 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-00dc8c31-0af4-4396-b9b2-1383ed628099 tempest-SnapshotDependencyTests-2081702305 None] Created reservations ['983eb7ee-4ac9-4121-9872-313c2b093967', '85d6f425-4d48-42f0-9c5f-6e136838148f', 'c217a137-ab8b-4c78-8de1-dca918e1185f', '9e8bfc1c-a3d8-4188-9350-225f9a725b2f'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:04:56 devstack sudo[108971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0522dae1-24f4-493b-953e-66dd8949a6ba
Nov 06 12:04:56 devstack sudo[108971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:56 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-00dc8c31-0af4-4396-b9b2-1383ed628099 tempest-SnapshotDependencyTests-2081702305 None] Delete snapshot completed successfully.
Nov 06 12:04:56 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-00dc8c31-0af4-4396-b9b2-1383ed628099 tempest-SnapshotDependencyTests-2081702305 None] Lock "cinder-8055e27c-0a47-40b8-9e7d-1bc7bdef7548-delete_snapshot" released by "delete_snapshot" :: held 1.842s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:56 devstack sudo[108971]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c1ac72c6-6bb7-4af0-b810-6e81a4b07dcf tempest-ProjectMemberTests-2128122521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0522dae1-24f4-493b-953e-66dd8949a6ba" returned: 0 in 0.354s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c1ac72c6-6bb7-4af0-b810-6e81a4b07dcf tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0522dae1-24f4-493b-953e-66dd8949a6ba.c1cf7be3-43cc-4385-ba4e-702e619a622d {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:56 devstack sudo[108976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0522dae1-24f4-493b-953e-66dd8949a6ba.c1cf7be3-43cc-4385-ba4e-702e619a622d
Nov 06 12:04:56 devstack sudo[108976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:56 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-7fd1df9d-e37f-4274-9e9e-881905c41323 tempest-SnapshotDependencyTests-2081702305 None] Acquiring lock "cinder-47e572a5-d533-42ba-a7af-352e63af4c9f-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:56 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-7fd1df9d-e37f-4274-9e9e-881905c41323 tempest-SnapshotDependencyTests-2081702305 None] Lock "cinder-47e572a5-d533-42ba-a7af-352e63af4c9f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:56 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-7fd1df9d-e37f-4274-9e9e-881905c41323 tempest-SnapshotDependencyTests-2081702305 None] Acquiring lock "cinder-quobyte-47e572a5-d533-42ba-a7af-352e63af4c9f" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:56 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-7fd1df9d-e37f-4274-9e9e-881905c41323 tempest-SnapshotDependencyTests-2081702305 None] Lock "cinder-quobyte-47e572a5-d533-42ba-a7af-352e63af4c9f" acquired by "delete_volume" :: waited 0.019s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:56 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[46117254-81f4-44e4-9ec4-66364b6b291a]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:04:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7fd1df9d-e37f-4274-9e9e-881905c41323 tempest-SnapshotDependencyTests-2081702305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:56 devstack sudo[108978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f
Nov 06 12:04:56 devstack sudo[108978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:56 devstack sudo[108976]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c1ac72c6-6bb7-4af0-b810-6e81a4b07dcf tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0522dae1-24f4-493b-953e-66dd8949a6ba.c1cf7be3-43cc-4385-ba4e-702e619a622d" returned: 0 in 0.335s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:56 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c1ac72c6-6bb7-4af0-b810-6e81a4b07dcf tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0522dae1-24f4-493b-953e-66dd8949a6ba.c1cf7be3-43cc-4385-ba4e-702e619a622d {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:56 devstack sudo[108983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0522dae1-24f4-493b-953e-66dd8949a6ba.c1cf7be3-43cc-4385-ba4e-702e619a622d
Nov 06 12:04:56 devstack sudo[108983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:57 devstack sudo[108983]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-c1ac72c6-6bb7-4af0-b810-6e81a4b07dcf tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0522dae1-24f4-493b-953e-66dd8949a6ba.c1cf7be3-43cc-4385-ba4e-702e619a622d" returned: 0 in 0.249s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:57 devstack sudo[108978]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7fd1df9d-e37f-4274-9e9e-881905c41323 tempest-SnapshotDependencyTests-2081702305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f" returned: 0 in 0.402s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7fd1df9d-e37f-4274-9e9e-881905c41323 tempest-SnapshotDependencyTests-2081702305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:57 devstack sudo[108989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f
Nov 06 12:04:57 devstack sudo[108989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:57 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c1ac72c6-6bb7-4af0-b810-6e81a4b07dcf tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-c1cf7be3-43cc-4385-ba4e-702e619a622d" released by "_delete_snapshot" :: held 1.437s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:57 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c1ac72c6-6bb7-4af0-b810-6e81a4b07dcf tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-0522dae1-24f4-493b-953e-66dd8949a6ba" released by "delete_snapshot" :: held 1.463s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:57 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-c1ac72c6-6bb7-4af0-b810-6e81a4b07dcf tempest-ProjectMemberTests-2128122521 None] Created reservations ['7109953c-8c2f-4392-b0d2-328e677022d8', 'b0fa6b74-57a3-4307-944c-ce22568c9d45', '72050c3c-7d29-43e7-a56d-0832f7056020', '36f7e2d7-dbb9-43bf-95f9-57427d72d758'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:04:57 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-c1ac72c6-6bb7-4af0-b810-6e81a4b07dcf tempest-ProjectMemberTests-2128122521 None] Delete snapshot completed successfully.
Nov 06 12:04:57 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-c1ac72c6-6bb7-4af0-b810-6e81a4b07dcf tempest-ProjectMemberTests-2128122521 None] Lock "cinder-c1cf7be3-43cc-4385-ba4e-702e619a622d-delete_snapshot" released by "delete_snapshot" :: held 1.609s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:57 devstack sudo[108989]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7fd1df9d-e37f-4274-9e9e-881905c41323 tempest-SnapshotDependencyTests-2081702305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-47e572a5-d533-42ba-a7af-352e63af4c9f" returned: 0 in 0.252s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:57 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-7fd1df9d-e37f-4274-9e9e-881905c41323 tempest-SnapshotDependencyTests-2081702305 None] Lock "cinder-quobyte-47e572a5-d533-42ba-a7af-352e63af4c9f" released by "delete_volume" :: held 0.713s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:57 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-7fd1df9d-e37f-4274-9e9e-881905c41323 tempest-SnapshotDependencyTests-2081702305 None] Created reservations ['0ee9968e-ffd4-454a-ab85-e8e004aebb9f', 'c78fb27b-3835-4270-ade0-f605f9c78100', 'f8720ecc-b353-4235-a6fe-9ad73a58c88b', '8c4f349b-1579-4828-8334-583b0745daac'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:04:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-7fd1df9d-e37f-4274-9e9e-881905c41323 tempest-SnapshotDependencyTests-2081702305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-7fd1df9d-e37f-4274-9e9e-881905c41323 tempest-SnapshotDependencyTests-2081702305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:57 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-7fd1df9d-e37f-4274-9e9e-881905c41323 tempest-SnapshotDependencyTests-2081702305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:04:57 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-7fd1df9d-e37f-4274-9e9e-881905c41323 tempest-SnapshotDependencyTests-2081702305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:04:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-7fd1df9d-e37f-4274-9e9e-881905c41323 tempest-SnapshotDependencyTests-2081702305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7fd1df9d-e37f-4274-9e9e-881905c41323 tempest-SnapshotDependencyTests-2081702305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:57 devstack sudo[108992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:04:57 devstack sudo[108992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:57 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-f9929898-c417-41f9-949a-7b7ee8701baf tempest-SnapshotDependencyTests-2081702305 None] Acquiring lock "cinder-44e908da-e2de-421f-9553-c44dc781ea39-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:57 devstack sudo[108992]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-7fd1df9d-e37f-4274-9e9e-881905c41323 tempest-SnapshotDependencyTests-2081702305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.267s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:57 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-7fd1df9d-e37f-4274-9e9e-881905c41323 tempest-SnapshotDependencyTests-2081702305 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:04:57 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-f9929898-c417-41f9-949a-7b7ee8701baf tempest-SnapshotDependencyTests-2081702305 None] Lock "cinder-44e908da-e2de-421f-9553-c44dc781ea39-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:57 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-7fd1df9d-e37f-4274-9e9e-881905c41323 tempest-SnapshotDependencyTests-2081702305 None] Deleted volume successfully.
Nov 06 12:04:57 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-7fd1df9d-e37f-4274-9e9e-881905c41323 tempest-SnapshotDependencyTests-2081702305 None] Lock "cinder-47e572a5-d533-42ba-a7af-352e63af4c9f-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:57 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-f9929898-c417-41f9-949a-7b7ee8701baf tempest-SnapshotDependencyTests-2081702305 None] Acquiring lock "cinder-quobyte-44e908da-e2de-421f-9553-c44dc781ea39" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:57 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-f9929898-c417-41f9-949a-7b7ee8701baf tempest-SnapshotDependencyTests-2081702305 None] Lock "cinder-quobyte-44e908da-e2de-421f-9553-c44dc781ea39" acquired by "delete_volume" :: waited 0.021s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:57 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[786b466a-0f81-4cd3-a28a-3fe7e662fda2]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:04:57 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f9929898-c417-41f9-949a-7b7ee8701baf tempest-SnapshotDependencyTests-2081702305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-44e908da-e2de-421f-9553-c44dc781ea39 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:57 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-afa56792-349c-4a7b-9be5-c61ada1ddf34 tempest-ProjectMemberTests-2128122521 None] Acquiring lock "cinder-0522dae1-24f4-493b-953e-66dd8949a6ba-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:57 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-afa56792-349c-4a7b-9be5-c61ada1ddf34 tempest-ProjectMemberTests-2128122521 None] Lock "cinder-0522dae1-24f4-493b-953e-66dd8949a6ba-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:58 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-afa56792-349c-4a7b-9be5-c61ada1ddf34 tempest-ProjectMemberTests-2128122521 None] Acquiring lock "cinder-quobyte-0522dae1-24f4-493b-953e-66dd8949a6ba" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:04:58 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-afa56792-349c-4a7b-9be5-c61ada1ddf34 tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-0522dae1-24f4-493b-953e-66dd8949a6ba" acquired by "delete_volume" :: waited 0.015s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:04:58 devstack sudo[108995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-44e908da-e2de-421f-9553-c44dc781ea39
Nov 06 12:04:58 devstack sudo[108995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:58 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd714c35-f61e-415a-b4a8-bfab668e04a4]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:04:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-afa56792-349c-4a7b-9be5-c61ada1ddf34 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0522dae1-24f4-493b-953e-66dd8949a6ba {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:58 devstack sudo[108997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0522dae1-24f4-493b-953e-66dd8949a6ba
Nov 06 12:04:58 devstack sudo[108997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:58 devstack sudo[108995]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f9929898-c417-41f9-949a-7b7ee8701baf tempest-SnapshotDependencyTests-2081702305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-44e908da-e2de-421f-9553-c44dc781ea39" returned: 0 in 0.407s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f9929898-c417-41f9-949a-7b7ee8701baf tempest-SnapshotDependencyTests-2081702305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-44e908da-e2de-421f-9553-c44dc781ea39 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:58 devstack sudo[109002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-44e908da-e2de-421f-9553-c44dc781ea39
Nov 06 12:04:58 devstack sudo[109002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:58 devstack sudo[108997]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-afa56792-349c-4a7b-9be5-c61ada1ddf34 tempest-ProjectMemberTests-2128122521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0522dae1-24f4-493b-953e-66dd8949a6ba" returned: 0 in 0.394s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-afa56792-349c-4a7b-9be5-c61ada1ddf34 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0522dae1-24f4-493b-953e-66dd8949a6ba {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:58 devstack sudo[109007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0522dae1-24f4-493b-953e-66dd8949a6ba
Nov 06 12:04:58 devstack sudo[109007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:58 devstack sudo[109002]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f9929898-c417-41f9-949a-7b7ee8701baf tempest-SnapshotDependencyTests-2081702305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-44e908da-e2de-421f-9553-c44dc781ea39" returned: 0 in 0.270s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:58 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-f9929898-c417-41f9-949a-7b7ee8701baf tempest-SnapshotDependencyTests-2081702305 None] Lock "cinder-quobyte-44e908da-e2de-421f-9553-c44dc781ea39" released by "delete_volume" :: held 0.727s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:58 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-f9929898-c417-41f9-949a-7b7ee8701baf tempest-SnapshotDependencyTests-2081702305 None] Created reservations ['bd73d9fe-6309-4f62-8cc3-edd8a13b196e', '76e28a5d-7ea0-47e0-8fc9-04f9520afb38', 'e07042a9-e65a-44a4-8364-13aca65cb71c', '092f0645-2206-4d5e-92be-dea373f31281'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:04:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f9929898-c417-41f9-949a-7b7ee8701baf tempest-SnapshotDependencyTests-2081702305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f9929898-c417-41f9-949a-7b7ee8701baf tempest-SnapshotDependencyTests-2081702305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:58 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-f9929898-c417-41f9-949a-7b7ee8701baf tempest-SnapshotDependencyTests-2081702305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:04:58 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-f9929898-c417-41f9-949a-7b7ee8701baf tempest-SnapshotDependencyTests-2081702305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:04:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f9929898-c417-41f9-949a-7b7ee8701baf tempest-SnapshotDependencyTests-2081702305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f9929898-c417-41f9-949a-7b7ee8701baf tempest-SnapshotDependencyTests-2081702305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:58 devstack sudo[109007]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-afa56792-349c-4a7b-9be5-c61ada1ddf34 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-0522dae1-24f4-493b-953e-66dd8949a6ba" returned: 0 in 0.270s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:58 devstack sudo[109011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:04:58 devstack sudo[109011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:58 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-afa56792-349c-4a7b-9be5-c61ada1ddf34 tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-0522dae1-24f4-493b-953e-66dd8949a6ba" released by "delete_volume" :: held 0.730s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:58 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-afa56792-349c-4a7b-9be5-c61ada1ddf34 tempest-ProjectMemberTests-2128122521 None] Created reservations ['3092bf99-ea49-40e6-afd6-45aa267b4253', '2f6153c5-d1b4-4bd9-9429-27d57eb06392', '222ba997-5538-4c67-8217-4ade47b4655d', '12feb0a7-e02a-4e19-9103-b19d5a69973c'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:04:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-afa56792-349c-4a7b-9be5-c61ada1ddf34 tempest-ProjectMemberTests-2128122521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-afa56792-349c-4a7b-9be5-c61ada1ddf34 tempest-ProjectMemberTests-2128122521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:58 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-afa56792-349c-4a7b-9be5-c61ada1ddf34 tempest-ProjectMemberTests-2128122521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:04:58 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-afa56792-349c-4a7b-9be5-c61ada1ddf34 tempest-ProjectMemberTests-2128122521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:04:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-afa56792-349c-4a7b-9be5-c61ada1ddf34 tempest-ProjectMemberTests-2128122521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:58 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-afa56792-349c-4a7b-9be5-c61ada1ddf34 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:58 devstack sudo[109013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:04:58 devstack sudo[109013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:04:59 devstack sudo[109011]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f9929898-c417-41f9-949a-7b7ee8701baf tempest-SnapshotDependencyTests-2081702305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.279s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:59 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-f9929898-c417-41f9-949a-7b7ee8701baf tempest-SnapshotDependencyTests-2081702305 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:04:59 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-f9929898-c417-41f9-949a-7b7ee8701baf tempest-SnapshotDependencyTests-2081702305 None] Deleted volume successfully.
Nov 06 12:04:59 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-f9929898-c417-41f9-949a-7b7ee8701baf tempest-SnapshotDependencyTests-2081702305 None] Lock "cinder-44e908da-e2de-421f-9553-c44dc781ea39-delete_volume" released by "delete_volume" :: held 1.254s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:59 devstack sudo[109013]: pam_unix(sudo:session): session closed for user root
Nov 06 12:04:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-afa56792-349c-4a7b-9be5-c61ada1ddf34 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.293s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:04:59 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-afa56792-349c-4a7b-9be5-c61ada1ddf34 tempest-ProjectMemberTests-2128122521 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:04:59 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-afa56792-349c-4a7b-9be5-c61ada1ddf34 tempest-ProjectMemberTests-2128122521 None] Deleted volume successfully.
Nov 06 12:04:59 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-afa56792-349c-4a7b-9be5-c61ada1ddf34 tempest-ProjectMemberTests-2128122521 None] Lock "cinder-0522dae1-24f4-493b-953e-66dd8949a6ba-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:04:59 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-83d187e4-bb6a-4e6a-be18-35d195bf9d27 tempest-ProjectMemberTests-2128122521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:04:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-83d187e4-bb6a-4e6a-be18-35d195bf9d27 tempest-ProjectMemberTests-2128122521 None] Flow 'volume_create_manager' (e1c4dc13-cc76-4c68-b50a-9c0c80964893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:04:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-83d187e4-bb6a-4e6a-be18-35d195bf9d27 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64d08a5e-530a-481d-8e92-b972f7f03094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-83d187e4-bb6a-4e6a-be18-35d195bf9d27 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64d08a5e-530a-481d-8e92-b972f7f03094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:04:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1673429487',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4c793a6-a6fb-4a3c-a604-ceda3545a1d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3c5c4d5cd09492198badac02cec1874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:05:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:05:00Z,use_quota=True,user_id='78f8479fdeb04b689787bce30dc332ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-83d187e4-bb6a-4e6a-be18-35d195bf9d27 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79836f70-041a-4625-b62c-27e52346edd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-83d187e4-bb6a-4e6a-be18-35d195bf9d27 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79836f70-041a-4625-b62c-27e52346edd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-83d187e4-bb6a-4e6a-be18-35d195bf9d27 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f2cddc8-40b7-40ce-b5ef-f6270a58d75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-83d187e4-bb6a-4e6a-be18-35d195bf9d27 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f2cddc8-40b7-40ce-b5ef-f6270a58d75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4c793a6-a6fb-4a3c-a604-ceda3545a1d9', 'volume_name': 'volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-83d187e4-bb6a-4e6a-be18-35d195bf9d27 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06a70456-ac5c-4dcc-8713-d2f85ece1976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-83d187e4-bb6a-4e6a-be18-35d195bf9d27 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06a70456-ac5c-4dcc-8713-d2f85ece1976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:04:59 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-83d187e4-bb6a-4e6a-be18-35d195bf9d27 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b678822-bdee-4ff2-b8df-11d84b6e662a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:04:59 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-83d187e4-bb6a-4e6a-be18-35d195bf9d27 tempest-ProjectMemberTests-2128122521 None] Volume f4c793a6-a6fb-4a3c-a604-ceda3545a1d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9', 'volume_size': 1}
Nov 06 12:04:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-83d187e4-bb6a-4e6a-be18-35d195bf9d27 tempest-ProjectMemberTests-2128122521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-83d187e4-bb6a-4e6a-be18-35d195bf9d27 tempest-ProjectMemberTests-2128122521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:59 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-83d187e4-bb6a-4e6a-be18-35d195bf9d27 tempest-ProjectMemberTests-2128122521 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:04:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1673429487',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4c793a6-a6fb-4a3c-a604-ceda3545a1d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3c5c4d5cd09492198badac02cec1874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:05:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:05:00Z,use_quota=True,user_id='78f8479fdeb04b689787bce30dc332ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:04:59 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-83d187e4-bb6a-4e6a-be18-35d195bf9d27 tempest-ProjectMemberTests-2128122521 None] Creating volume f4c793a6-a6fb-4a3c-a604-ceda3545a1d9 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:04:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-83d187e4-bb6a-4e6a-be18-35d195bf9d27 tempest-ProjectMemberTests-2128122521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:04:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-83d187e4-bb6a-4e6a-be18-35d195bf9d27 tempest-ProjectMemberTests-2128122521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:04:59 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-83d187e4-bb6a-4e6a-be18-35d195bf9d27 tempest-ProjectMemberTests-2128122521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:04:59 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-83d187e4-bb6a-4e6a-be18-35d195bf9d27 tempest-ProjectMemberTests-2128122521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:04:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-83d187e4-bb6a-4e6a-be18-35d195bf9d27 tempest-ProjectMemberTests-2128122521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:04:59 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-83d187e4-bb6a-4e6a-be18-35d195bf9d27 tempest-ProjectMemberTests-2128122521 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:04:59 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-83d187e4-bb6a-4e6a-be18-35d195bf9d27 tempest-ProjectMemberTests-2128122521 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:04:59 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-83d187e4-bb6a-4e6a-be18-35d195bf9d27 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:04:59 devstack sudo[109017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9 1073741824
Nov 06 12:04:59 devstack sudo[109017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:00 devstack sudo[109017]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-83d187e4-bb6a-4e6a-be18-35d195bf9d27 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9 1073741824" returned: 0 in 0.466s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-83d187e4-bb6a-4e6a-be18-35d195bf9d27 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:00 devstack sudo[109023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9
Nov 06 12:05:00 devstack sudo[109023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:00 devstack sudo[109023]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-83d187e4-bb6a-4e6a-be18-35d195bf9d27 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9" returned: 0 in 0.257s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:00 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-83d187e4-bb6a-4e6a-be18-35d195bf9d27 tempest-ProjectMemberTests-2128122521 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:05:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-83d187e4-bb6a-4e6a-be18-35d195bf9d27 tempest-ProjectMemberTests-2128122521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:05:00 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-83d187e4-bb6a-4e6a-be18-35d195bf9d27 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b678822-bdee-4ff2-b8df-11d84b6e662a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:05:00 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-83d187e4-bb6a-4e6a-be18-35d195bf9d27 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (721b1a4e-6e73-4f26-a227-08764d382b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:05:00 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-83d187e4-bb6a-4e6a-be18-35d195bf9d27 tempest-ProjectMemberTests-2128122521 None] Volume volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9 (f4c793a6-a6fb-4a3c-a604-ceda3545a1d9): created successfully
Nov 06 12:05:00 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-83d187e4-bb6a-4e6a-be18-35d195bf9d27 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (721b1a4e-6e73-4f26-a227-08764d382b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:05:00 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-83d187e4-bb6a-4e6a-be18-35d195bf9d27 tempest-ProjectMemberTests-2128122521 None] Flow 'volume_create_manager' (e1c4dc13-cc76-4c68-b50a-9c0c80964893) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:05:00 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-83d187e4-bb6a-4e6a-be18-35d195bf9d27 tempest-ProjectMemberTests-2128122521 None] Created volume successfully.
Nov 06 12:05:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-63fc08ac-0219-4f6c-b8b4-53b1d5495d13 tempest-ProjectMemberTests-2128122521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:05:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-63fc08ac-0219-4f6c-b8b4-53b1d5495d13 tempest-ProjectMemberTests-2128122521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:05:00 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-63fc08ac-0219-4f6c-b8b4-53b1d5495d13 tempest-ProjectMemberTests-2128122521 None] Creating offline snapshot 040d0948-dd70-4ba1-97d9-f38e71d60f2c of volume f4c793a6-a6fb-4a3c-a604-ceda3545a1d9 {{(pid=87165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 12:05:00 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e7a59b-b62c-4bda-915c-383efb66a81a]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:05:00 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-63fc08ac-0219-4f6c-b8b4-53b1d5495d13 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:01 devstack sudo[109027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9
Nov 06 12:05:01 devstack sudo[109027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:01 devstack sudo[109027]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-63fc08ac-0219-4f6c-b8b4-53b1d5495d13 tempest-ProjectMemberTests-2128122521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9" returned: 0 in 0.404s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-63fc08ac-0219-4f6c-b8b4-53b1d5495d13 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9.040d0948-dd70-4ba1-97d9-f38e71d60f2c 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:01 devstack sudo[109032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9.040d0948-dd70-4ba1-97d9-f38e71d60f2c 1G
Nov 06 12:05:01 devstack sudo[109032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:01 devstack sudo[109032]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-63fc08ac-0219-4f6c-b8b4-53b1d5495d13 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9.040d0948-dd70-4ba1-97d9-f38e71d60f2c 1G" returned: 0 in 0.433s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:01 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-63fc08ac-0219-4f6c-b8b4-53b1d5495d13 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9.040d0948-dd70-4ba1-97d9-f38e71d60f2c {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:01 devstack sudo[109038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9.040d0948-dd70-4ba1-97d9-f38e71d60f2c
Nov 06 12:05:01 devstack sudo[109038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:02 devstack sudo[109038]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-63fc08ac-0219-4f6c-b8b4-53b1d5495d13 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9.040d0948-dd70-4ba1-97d9-f38e71d60f2c" returned: 0 in 0.303s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:02 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-63fc08ac-0219-4f6c-b8b4-53b1d5495d13 tempest-ProjectMemberTests-2128122521 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9.040d0948-dd70-4ba1-97d9-f38e71d60f2c is being set with open permissions: ugo+rw
Nov 06 12:05:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-63fc08ac-0219-4f6c-b8b4-53b1d5495d13 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9.040d0948-dd70-4ba1-97d9-f38e71d60f2c {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:02 devstack sudo[109047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9.040d0948-dd70-4ba1-97d9-f38e71d60f2c
Nov 06 12:05:02 devstack sudo[109047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:02 devstack sudo[109047]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-63fc08ac-0219-4f6c-b8b4-53b1d5495d13 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9.040d0948-dd70-4ba1-97d9-f38e71d60f2c" returned: 0 in 0.251s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-63fc08ac-0219-4f6c-b8b4-53b1d5495d13 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:02 devstack sudo[109050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9.info
Nov 06 12:05:02 devstack sudo[109050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:02 devstack sudo[109050]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-63fc08ac-0219-4f6c-b8b4-53b1d5495d13 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9.info" returned: 0 in 0.288s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:02 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-63fc08ac-0219-4f6c-b8b4-53b1d5495d13 tempest-ProjectMemberTests-2128122521 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9.info is being set with open permissions: ugo+rw
Nov 06 12:05:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-63fc08ac-0219-4f6c-b8b4-53b1d5495d13 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:02 devstack sudo[109053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9.info
Nov 06 12:05:02 devstack sudo[109053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:02 devstack sudo[109053]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-63fc08ac-0219-4f6c-b8b4-53b1d5495d13 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9.info" returned: 0 in 0.273s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:02 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-63fc08ac-0219-4f6c-b8b4-53b1d5495d13 tempest-ProjectMemberTests-2128122521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.061s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:05:02 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-63fc08ac-0219-4f6c-b8b4-53b1d5495d13 tempest-ProjectMemberTests-2128122521 None] Create snapshot completed successfully
Nov 06 12:05:04 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-909cfddb-4f82-4140-b15f-e0ff78d391d6 tempest-ProjectMemberTests-2128122521 None] Acquiring lock "cinder-040d0948-dd70-4ba1-97d9-f38e71d60f2c-delete_snapshot" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:05:04 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-909cfddb-4f82-4140-b15f-e0ff78d391d6 tempest-ProjectMemberTests-2128122521 None] Lock "cinder-040d0948-dd70-4ba1-97d9-f38e71d60f2c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:05:04 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-909cfddb-4f82-4140-b15f-e0ff78d391d6 tempest-ProjectMemberTests-2128122521 None] Acquiring lock "cinder-quobyte-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:05:04 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-909cfddb-4f82-4140-b15f-e0ff78d391d6 tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:05:04 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-909cfddb-4f82-4140-b15f-e0ff78d391d6 tempest-ProjectMemberTests-2128122521 None] Acquiring lock "cinder-quobyte-040d0948-dd70-4ba1-97d9-f38e71d60f2c" by "_delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:05:04 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-909cfddb-4f82-4140-b15f-e0ff78d391d6 tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-040d0948-dd70-4ba1-97d9-f38e71d60f2c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:05:04 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-909cfddb-4f82-4140-b15f-e0ff78d391d6 tempest-ProjectMemberTests-2128122521 None] Deleting offline snapshot 040d0948-dd70-4ba1-97d9-f38e71d60f2c of volume f4c793a6-a6fb-4a3c-a604-ceda3545a1d9 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 12:05:04 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-909cfddb-4f82-4140-b15f-e0ff78d391d6 tempest-ProjectMemberTests-2128122521 None] snapshot_file for this snap is: volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9.040d0948-dd70-4ba1-97d9-f38e71d60f2c {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 12:05:04 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80e1c99-1035-4f9c-a9d9-5f9a18f5433d]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:05:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-909cfddb-4f82-4140-b15f-e0ff78d391d6 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9.040d0948-dd70-4ba1-97d9-f38e71d60f2c {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:04 devstack sudo[109058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9.040d0948-dd70-4ba1-97d9-f38e71d60f2c
Nov 06 12:05:04 devstack sudo[109058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:04 devstack sudo[109058]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-909cfddb-4f82-4140-b15f-e0ff78d391d6 tempest-ProjectMemberTests-2128122521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9.040d0948-dd70-4ba1-97d9-f38e71d60f2c" returned: 0 in 0.387s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:04 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-909cfddb-4f82-4140-b15f-e0ff78d391d6 tempest-ProjectMemberTests-2128122521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 12:05:04 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ccb2a5-01f5-4a8c-979f-1d8b19fa1438]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:05:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-909cfddb-4f82-4140-b15f-e0ff78d391d6 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:04 devstack sudo[109063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9
Nov 06 12:05:04 devstack sudo[109063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:04 devstack sudo[109063]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-909cfddb-4f82-4140-b15f-e0ff78d391d6 tempest-ProjectMemberTests-2128122521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9" returned: 0 in 0.384s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:04 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-909cfddb-4f82-4140-b15f-e0ff78d391d6 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9.040d0948-dd70-4ba1-97d9-f38e71d60f2c {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:04 devstack sudo[109069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9.040d0948-dd70-4ba1-97d9-f38e71d60f2c
Nov 06 12:05:04 devstack sudo[109069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:05 devstack sudo[109069]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-909cfddb-4f82-4140-b15f-e0ff78d391d6 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9.040d0948-dd70-4ba1-97d9-f38e71d60f2c" returned: 0 in 0.349s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-909cfddb-4f82-4140-b15f-e0ff78d391d6 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9.040d0948-dd70-4ba1-97d9-f38e71d60f2c {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:05 devstack sudo[109075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9.040d0948-dd70-4ba1-97d9-f38e71d60f2c
Nov 06 12:05:05 devstack sudo[109075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:05 devstack sudo[109075]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:05 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-909cfddb-4f82-4140-b15f-e0ff78d391d6 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9.040d0948-dd70-4ba1-97d9-f38e71d60f2c" returned: 0 in 0.251s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:05 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-909cfddb-4f82-4140-b15f-e0ff78d391d6 tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-040d0948-dd70-4ba1-97d9-f38e71d60f2c" released by "_delete_snapshot" :: held 1.488s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:05:05 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-909cfddb-4f82-4140-b15f-e0ff78d391d6 tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9" released by "delete_snapshot" :: held 1.514s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:05:05 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:SELECT=171,cinder:INSERT=59,cinder:UPDATE=217,cinder:DELETE=14 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 12:05:05 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:INSERT=50,cinder:UPDATE=196,cinder:SELECT=151,cinder:DELETE=21 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 12:05:05 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-909cfddb-4f82-4140-b15f-e0ff78d391d6 tempest-ProjectMemberTests-2128122521 None] Created reservations ['4f00bb0f-9c60-4f14-ab05-0bbfe402e759', 'a57ad2a1-2f12-416f-a829-3f8a1e9f4f9c', '2d7cde77-cb45-43d4-971c-644ed3b39412', 'f7c9c909-a379-4fe7-b8c0-7cddac0c099b'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:05:05 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-909cfddb-4f82-4140-b15f-e0ff78d391d6 tempest-ProjectMemberTests-2128122521 None] Delete snapshot completed successfully.
Nov 06 12:05:05 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-909cfddb-4f82-4140-b15f-e0ff78d391d6 tempest-ProjectMemberTests-2128122521 None] Lock "cinder-040d0948-dd70-4ba1-97d9-f38e71d60f2c-delete_snapshot" released by "delete_snapshot" :: held 1.676s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:05:06 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-54e694d7-9263-4f07-a521-4d623281b8ef tempest-ProjectMemberTests-2128122521 None] Acquiring lock "cinder-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:05:06 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-54e694d7-9263-4f07-a521-4d623281b8ef tempest-ProjectMemberTests-2128122521 None] Lock "cinder-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:05:06 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-54e694d7-9263-4f07-a521-4d623281b8ef tempest-ProjectMemberTests-2128122521 None] Acquiring lock "cinder-quobyte-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:05:06 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-54e694d7-9263-4f07-a521-4d623281b8ef tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9" acquired by "delete_volume" :: waited 0.016s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:05:06 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e76676-3dc6-44fc-b4a0-1c0032c66d4d]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:05:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-54e694d7-9263-4f07-a521-4d623281b8ef tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:06 devstack sudo[109078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9
Nov 06 12:05:06 devstack sudo[109078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:06 devstack sudo[109078]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-54e694d7-9263-4f07-a521-4d623281b8ef tempest-ProjectMemberTests-2128122521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9" returned: 0 in 0.369s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-54e694d7-9263-4f07-a521-4d623281b8ef tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:06 devstack sudo[109083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9
Nov 06 12:05:06 devstack sudo[109083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:06 devstack sudo[109083]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:06 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-54e694d7-9263-4f07-a521-4d623281b8ef tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9" returned: 0 in 0.282s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:07 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-54e694d7-9263-4f07-a521-4d623281b8ef tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9" released by "delete_volume" :: held 0.714s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:05:07 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-54e694d7-9263-4f07-a521-4d623281b8ef tempest-ProjectMemberTests-2128122521 None] Created reservations ['af6cceca-4787-474f-8f52-3ec734c9abf4', '9cc8c9ff-5564-42ae-a337-ca758cf68c38', '108ee245-774f-48b8-878d-586a6bef7bc6', '8407230a-2e5c-4f33-8b84-ac1df1898808'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:05:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-54e694d7-9263-4f07-a521-4d623281b8ef tempest-ProjectMemberTests-2128122521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:05:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-54e694d7-9263-4f07-a521-4d623281b8ef tempest-ProjectMemberTests-2128122521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:05:07 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-54e694d7-9263-4f07-a521-4d623281b8ef tempest-ProjectMemberTests-2128122521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:05:07 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-54e694d7-9263-4f07-a521-4d623281b8ef tempest-ProjectMemberTests-2128122521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:05:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-54e694d7-9263-4f07-a521-4d623281b8ef tempest-ProjectMemberTests-2128122521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:05:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-54e694d7-9263-4f07-a521-4d623281b8ef tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:07 devstack sudo[109086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:05:07 devstack sudo[109086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:07 devstack sudo[109086]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-54e694d7-9263-4f07-a521-4d623281b8ef tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.247s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:07 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-54e694d7-9263-4f07-a521-4d623281b8ef tempest-ProjectMemberTests-2128122521 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:05:07 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-54e694d7-9263-4f07-a521-4d623281b8ef tempest-ProjectMemberTests-2128122521 None] Deleted volume successfully.
Nov 06 12:05:07 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-54e694d7-9263-4f07-a521-4d623281b8ef tempest-ProjectMemberTests-2128122521 None] Lock "cinder-f4c793a6-a6fb-4a3c-a604-ceda3545a1d9-delete_volume" released by "delete_volume" :: held 1.195s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:05:07 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e87ac55-527b-4066-bb70-162ad818a0c9 tempest-ProjectMemberTests-2128122521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:05:07 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3e87ac55-527b-4066-bb70-162ad818a0c9 tempest-ProjectMemberTests-2128122521 None] Flow 'volume_create_manager' (36f8f3f2-fce7-4f96-83b5-54c6df082184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:05:07 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3e87ac55-527b-4066-bb70-162ad818a0c9 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8851225-c5aa-4a50-ab8b-21be90702d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:05:07 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3e87ac55-527b-4066-bb70-162ad818a0c9 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8851225-c5aa-4a50-ab8b-21be90702d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:05:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-534828698',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b958f13-7699-4cba-88aa-49a3c5591ebb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3c5c4d5cd09492198badac02cec1874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:05:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:05:08Z,use_quota=True,user_id='78f8479fdeb04b689787bce30dc332ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:05:07 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3e87ac55-527b-4066-bb70-162ad818a0c9 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c7f106a-a699-496d-b4be-00e54f85526a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:05:07 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3e87ac55-527b-4066-bb70-162ad818a0c9 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c7f106a-a699-496d-b4be-00e54f85526a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:05:07 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3e87ac55-527b-4066-bb70-162ad818a0c9 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36306652-1fa3-4bce-a5b1-d0fd0c72ed6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:05:07 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3e87ac55-527b-4066-bb70-162ad818a0c9 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36306652-1fa3-4bce-a5b1-d0fd0c72ed6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b958f13-7699-4cba-88aa-49a3c5591ebb', 'volume_name': 'volume-8b958f13-7699-4cba-88aa-49a3c5591ebb', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:05:07 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3e87ac55-527b-4066-bb70-162ad818a0c9 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61abc899-31f7-4054-9288-889fbe63ee68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:05:07 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3e87ac55-527b-4066-bb70-162ad818a0c9 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61abc899-31f7-4054-9288-889fbe63ee68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:05:07 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3e87ac55-527b-4066-bb70-162ad818a0c9 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6ac0539-d516-402b-ad93-ff55968d4b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:05:07 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-3e87ac55-527b-4066-bb70-162ad818a0c9 tempest-ProjectMemberTests-2128122521 None] Volume 8b958f13-7699-4cba-88aa-49a3c5591ebb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b958f13-7699-4cba-88aa-49a3c5591ebb', 'volume_size': 1}
Nov 06 12:05:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3e87ac55-527b-4066-bb70-162ad818a0c9 tempest-ProjectMemberTests-2128122521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:05:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3e87ac55-527b-4066-bb70-162ad818a0c9 tempest-ProjectMemberTests-2128122521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:05:07 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-3e87ac55-527b-4066-bb70-162ad818a0c9 tempest-ProjectMemberTests-2128122521 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:05:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-534828698',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b958f13-7699-4cba-88aa-49a3c5591ebb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3c5c4d5cd09492198badac02cec1874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:05:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:05:08Z,use_quota=True,user_id='78f8479fdeb04b689787bce30dc332ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:05:07 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-3e87ac55-527b-4066-bb70-162ad818a0c9 tempest-ProjectMemberTests-2128122521 None] Creating volume 8b958f13-7699-4cba-88aa-49a3c5591ebb {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:05:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3e87ac55-527b-4066-bb70-162ad818a0c9 tempest-ProjectMemberTests-2128122521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:05:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3e87ac55-527b-4066-bb70-162ad818a0c9 tempest-ProjectMemberTests-2128122521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:05:07 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-3e87ac55-527b-4066-bb70-162ad818a0c9 tempest-ProjectMemberTests-2128122521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:05:07 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-3e87ac55-527b-4066-bb70-162ad818a0c9 tempest-ProjectMemberTests-2128122521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:05:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3e87ac55-527b-4066-bb70-162ad818a0c9 tempest-ProjectMemberTests-2128122521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:05:07 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-3e87ac55-527b-4066-bb70-162ad818a0c9 tempest-ProjectMemberTests-2128122521 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:05:07 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-3e87ac55-527b-4066-bb70-162ad818a0c9 tempest-ProjectMemberTests-2128122521 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:05:07 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3e87ac55-527b-4066-bb70-162ad818a0c9 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b958f13-7699-4cba-88aa-49a3c5591ebb 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:08 devstack sudo[109093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b958f13-7699-4cba-88aa-49a3c5591ebb 1073741824
Nov 06 12:05:08 devstack sudo[109093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:08 devstack sudo[109093]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3e87ac55-527b-4066-bb70-162ad818a0c9 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b958f13-7699-4cba-88aa-49a3c5591ebb 1073741824" returned: 0 in 0.477s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3e87ac55-527b-4066-bb70-162ad818a0c9 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b958f13-7699-4cba-88aa-49a3c5591ebb {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:08 devstack sudo[109102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b958f13-7699-4cba-88aa-49a3c5591ebb
Nov 06 12:05:08 devstack sudo[109102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:08 devstack sudo[109102]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3e87ac55-527b-4066-bb70-162ad818a0c9 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b958f13-7699-4cba-88aa-49a3c5591ebb" returned: 0 in 0.270s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:08 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-3e87ac55-527b-4066-bb70-162ad818a0c9 tempest-ProjectMemberTests-2128122521 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:05:08 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3e87ac55-527b-4066-bb70-162ad818a0c9 tempest-ProjectMemberTests-2128122521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:05:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3e87ac55-527b-4066-bb70-162ad818a0c9 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6ac0539-d516-402b-ad93-ff55968d4b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b958f13-7699-4cba-88aa-49a3c5591ebb', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:05:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3e87ac55-527b-4066-bb70-162ad818a0c9 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10d8e59c-9249-46ce-8abb-03b90a4c63b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:05:08 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-3e87ac55-527b-4066-bb70-162ad818a0c9 tempest-ProjectMemberTests-2128122521 None] Volume volume-8b958f13-7699-4cba-88aa-49a3c5591ebb (8b958f13-7699-4cba-88aa-49a3c5591ebb): created successfully
Nov 06 12:05:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3e87ac55-527b-4066-bb70-162ad818a0c9 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10d8e59c-9249-46ce-8abb-03b90a4c63b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:05:08 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3e87ac55-527b-4066-bb70-162ad818a0c9 tempest-ProjectMemberTests-2128122521 None] Flow 'volume_create_manager' (36f8f3f2-fce7-4f96-83b5-54c6df082184) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:05:08 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-3e87ac55-527b-4066-bb70-162ad818a0c9 tempest-ProjectMemberTests-2128122521 None] Created volume successfully.
Nov 06 12:05:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5e43fe06-4f21-4545-8224-f5eec120588d tempest-ProjectMemberTests-2128122521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:05:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5e43fe06-4f21-4545-8224-f5eec120588d tempest-ProjectMemberTests-2128122521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:05:10 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-5e43fe06-4f21-4545-8224-f5eec120588d tempest-ProjectMemberTests-2128122521 None] Creating offline snapshot 5c1e8026-87ea-46f8-a9f7-eb01b8102180 of volume 8b958f13-7699-4cba-88aa-49a3c5591ebb {{(pid=87165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 12:05:10 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[67979b89-503c-46c6-9ff2-9bb5a7fa58b8]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:05:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5e43fe06-4f21-4545-8224-f5eec120588d tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b958f13-7699-4cba-88aa-49a3c5591ebb {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:10 devstack sudo[109105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b958f13-7699-4cba-88aa-49a3c5591ebb
Nov 06 12:05:10 devstack sudo[109105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:10 devstack sudo[109105]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5e43fe06-4f21-4545-8224-f5eec120588d tempest-ProjectMemberTests-2128122521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b958f13-7699-4cba-88aa-49a3c5591ebb" returned: 0 in 0.355s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5e43fe06-4f21-4545-8224-f5eec120588d tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b958f13-7699-4cba-88aa-49a3c5591ebb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b958f13-7699-4cba-88aa-49a3c5591ebb.5c1e8026-87ea-46f8-a9f7-eb01b8102180 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:10 devstack sudo[109111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b958f13-7699-4cba-88aa-49a3c5591ebb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b958f13-7699-4cba-88aa-49a3c5591ebb.5c1e8026-87ea-46f8-a9f7-eb01b8102180 1G
Nov 06 12:05:10 devstack sudo[109111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:10 devstack sudo[109111]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5e43fe06-4f21-4545-8224-f5eec120588d tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b958f13-7699-4cba-88aa-49a3c5591ebb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b958f13-7699-4cba-88aa-49a3c5591ebb.5c1e8026-87ea-46f8-a9f7-eb01b8102180 1G" returned: 0 in 0.397s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:10 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5e43fe06-4f21-4545-8224-f5eec120588d tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b958f13-7699-4cba-88aa-49a3c5591ebb -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b958f13-7699-4cba-88aa-49a3c5591ebb.5c1e8026-87ea-46f8-a9f7-eb01b8102180 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:10 devstack sudo[109117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b958f13-7699-4cba-88aa-49a3c5591ebb -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b958f13-7699-4cba-88aa-49a3c5591ebb.5c1e8026-87ea-46f8-a9f7-eb01b8102180
Nov 06 12:05:10 devstack sudo[109117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:11 devstack sudo[109117]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5e43fe06-4f21-4545-8224-f5eec120588d tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b958f13-7699-4cba-88aa-49a3c5591ebb -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b958f13-7699-4cba-88aa-49a3c5591ebb.5c1e8026-87ea-46f8-a9f7-eb01b8102180" returned: 0 in 0.291s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:11 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-5e43fe06-4f21-4545-8224-f5eec120588d tempest-ProjectMemberTests-2128122521 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b958f13-7699-4cba-88aa-49a3c5591ebb.5c1e8026-87ea-46f8-a9f7-eb01b8102180 is being set with open permissions: ugo+rw
Nov 06 12:05:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5e43fe06-4f21-4545-8224-f5eec120588d tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b958f13-7699-4cba-88aa-49a3c5591ebb.5c1e8026-87ea-46f8-a9f7-eb01b8102180 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:11 devstack sudo[109122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b958f13-7699-4cba-88aa-49a3c5591ebb.5c1e8026-87ea-46f8-a9f7-eb01b8102180
Nov 06 12:05:11 devstack sudo[109122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:11 devstack sudo[109122]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5e43fe06-4f21-4545-8224-f5eec120588d tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b958f13-7699-4cba-88aa-49a3c5591ebb.5c1e8026-87ea-46f8-a9f7-eb01b8102180" returned: 0 in 0.229s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5e43fe06-4f21-4545-8224-f5eec120588d tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b958f13-7699-4cba-88aa-49a3c5591ebb.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:11 devstack sudo[109125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b958f13-7699-4cba-88aa-49a3c5591ebb.info
Nov 06 12:05:11 devstack sudo[109125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:11 devstack sudo[109125]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5e43fe06-4f21-4545-8224-f5eec120588d tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b958f13-7699-4cba-88aa-49a3c5591ebb.info" returned: 0 in 0.242s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:11 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-5e43fe06-4f21-4545-8224-f5eec120588d tempest-ProjectMemberTests-2128122521 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b958f13-7699-4cba-88aa-49a3c5591ebb.info is being set with open permissions: ugo+rw
Nov 06 12:05:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5e43fe06-4f21-4545-8224-f5eec120588d tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b958f13-7699-4cba-88aa-49a3c5591ebb.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:11 devstack sudo[109128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b958f13-7699-4cba-88aa-49a3c5591ebb.info
Nov 06 12:05:11 devstack sudo[109128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:11 devstack sudo[109128]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-5e43fe06-4f21-4545-8224-f5eec120588d tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b958f13-7699-4cba-88aa-49a3c5591ebb.info" returned: 0 in 0.260s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:11 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-5e43fe06-4f21-4545-8224-f5eec120588d tempest-ProjectMemberTests-2128122521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.853s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:05:11 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-5e43fe06-4f21-4545-8224-f5eec120588d tempest-ProjectMemberTests-2128122521 None] Create snapshot completed successfully
Nov 06 12:05:12 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-26ba774c-46fb-43df-848c-23f386aad96a tempest-ProjectMemberTests-2128122521 None] Acquiring lock "cinder-5c1e8026-87ea-46f8-a9f7-eb01b8102180-delete_snapshot" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:05:12 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-26ba774c-46fb-43df-848c-23f386aad96a tempest-ProjectMemberTests-2128122521 None] Lock "cinder-5c1e8026-87ea-46f8-a9f7-eb01b8102180-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:05:12 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-26ba774c-46fb-43df-848c-23f386aad96a tempest-ProjectMemberTests-2128122521 None] Acquiring lock "cinder-quobyte-8b958f13-7699-4cba-88aa-49a3c5591ebb" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:05:12 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-26ba774c-46fb-43df-848c-23f386aad96a tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-8b958f13-7699-4cba-88aa-49a3c5591ebb" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:05:12 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-26ba774c-46fb-43df-848c-23f386aad96a tempest-ProjectMemberTests-2128122521 None] Acquiring lock "cinder-quobyte-5c1e8026-87ea-46f8-a9f7-eb01b8102180" by "_delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:05:12 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-26ba774c-46fb-43df-848c-23f386aad96a tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-5c1e8026-87ea-46f8-a9f7-eb01b8102180" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:05:12 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-26ba774c-46fb-43df-848c-23f386aad96a tempest-ProjectMemberTests-2128122521 None] Deleting offline snapshot 5c1e8026-87ea-46f8-a9f7-eb01b8102180 of volume 8b958f13-7699-4cba-88aa-49a3c5591ebb {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 12:05:12 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-26ba774c-46fb-43df-848c-23f386aad96a tempest-ProjectMemberTests-2128122521 None] snapshot_file for this snap is: volume-8b958f13-7699-4cba-88aa-49a3c5591ebb.5c1e8026-87ea-46f8-a9f7-eb01b8102180 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 12:05:12 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4768727-0241-46a3-8237-a028157e2df1]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:05:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-26ba774c-46fb-43df-848c-23f386aad96a tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b958f13-7699-4cba-88aa-49a3c5591ebb.5c1e8026-87ea-46f8-a9f7-eb01b8102180 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:12 devstack sudo[109131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b958f13-7699-4cba-88aa-49a3c5591ebb.5c1e8026-87ea-46f8-a9f7-eb01b8102180
Nov 06 12:05:12 devstack sudo[109131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:12 devstack sudo[109131]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-26ba774c-46fb-43df-848c-23f386aad96a tempest-ProjectMemberTests-2128122521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b958f13-7699-4cba-88aa-49a3c5591ebb.5c1e8026-87ea-46f8-a9f7-eb01b8102180" returned: 0 in 0.342s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:12 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-26ba774c-46fb-43df-848c-23f386aad96a tempest-ProjectMemberTests-2128122521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b958f13-7699-4cba-88aa-49a3c5591ebb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 12:05:12 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04fd1ff-29ca-4b47-8531-a61eecbc0b90]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:05:12 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-26ba774c-46fb-43df-848c-23f386aad96a tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b958f13-7699-4cba-88aa-49a3c5591ebb {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:12 devstack sudo[109136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b958f13-7699-4cba-88aa-49a3c5591ebb
Nov 06 12:05:12 devstack sudo[109136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:13 devstack sudo[109136]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-26ba774c-46fb-43df-848c-23f386aad96a tempest-ProjectMemberTests-2128122521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b958f13-7699-4cba-88aa-49a3c5591ebb" returned: 0 in 0.345s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-26ba774c-46fb-43df-848c-23f386aad96a tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b958f13-7699-4cba-88aa-49a3c5591ebb.5c1e8026-87ea-46f8-a9f7-eb01b8102180 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:13 devstack sudo[109141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b958f13-7699-4cba-88aa-49a3c5591ebb.5c1e8026-87ea-46f8-a9f7-eb01b8102180
Nov 06 12:05:13 devstack sudo[109141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:13 devstack sudo[109141]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-26ba774c-46fb-43df-848c-23f386aad96a tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b958f13-7699-4cba-88aa-49a3c5591ebb.5c1e8026-87ea-46f8-a9f7-eb01b8102180" returned: 0 in 0.323s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-26ba774c-46fb-43df-848c-23f386aad96a tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b958f13-7699-4cba-88aa-49a3c5591ebb.5c1e8026-87ea-46f8-a9f7-eb01b8102180 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:13 devstack sudo[109180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b958f13-7699-4cba-88aa-49a3c5591ebb.5c1e8026-87ea-46f8-a9f7-eb01b8102180
Nov 06 12:05:13 devstack sudo[109180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:13 devstack sudo[109180]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:13 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-26ba774c-46fb-43df-848c-23f386aad96a tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b958f13-7699-4cba-88aa-49a3c5591ebb.5c1e8026-87ea-46f8-a9f7-eb01b8102180" returned: 0 in 0.243s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:13 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-26ba774c-46fb-43df-848c-23f386aad96a tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-5c1e8026-87ea-46f8-a9f7-eb01b8102180" released by "_delete_snapshot" :: held 1.346s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:05:13 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-26ba774c-46fb-43df-848c-23f386aad96a tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-8b958f13-7699-4cba-88aa-49a3c5591ebb" released by "delete_snapshot" :: held 1.370s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:05:13 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-26ba774c-46fb-43df-848c-23f386aad96a tempest-ProjectMemberTests-2128122521 None] Created reservations ['40b93d75-7ae0-4547-8f8e-aecfc724fc02', '2470f8d8-bd60-4271-89ac-13e35dc8553a', '552b249f-52da-45cb-bfb1-30fc00cf94dd', '5578f72e-130b-46cd-8cf6-405c15dde2f6'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:05:13 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-26ba774c-46fb-43df-848c-23f386aad96a tempest-ProjectMemberTests-2128122521 None] Delete snapshot completed successfully.
Nov 06 12:05:13 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-26ba774c-46fb-43df-848c-23f386aad96a tempest-ProjectMemberTests-2128122521 None] Lock "cinder-5c1e8026-87ea-46f8-a9f7-eb01b8102180-delete_snapshot" released by "delete_snapshot" :: held 1.496s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:05:14 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-6e891232-f255-4f9c-a318-3df00712f9e0 tempest-ProjectMemberTests-2128122521 None] Acquiring lock "cinder-8b958f13-7699-4cba-88aa-49a3c5591ebb-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:05:14 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-6e891232-f255-4f9c-a318-3df00712f9e0 tempest-ProjectMemberTests-2128122521 None] Lock "cinder-8b958f13-7699-4cba-88aa-49a3c5591ebb-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:05:14 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-6e891232-f255-4f9c-a318-3df00712f9e0 tempest-ProjectMemberTests-2128122521 None] Acquiring lock "cinder-quobyte-8b958f13-7699-4cba-88aa-49a3c5591ebb" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:05:14 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-6e891232-f255-4f9c-a318-3df00712f9e0 tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-8b958f13-7699-4cba-88aa-49a3c5591ebb" acquired by "delete_volume" :: waited 0.015s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:05:14 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[404c4dfa-1e6e-49f2-adaa-229a4c467ac7]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:05:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6e891232-f255-4f9c-a318-3df00712f9e0 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b958f13-7699-4cba-88aa-49a3c5591ebb {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:14 devstack sudo[109185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b958f13-7699-4cba-88aa-49a3c5591ebb
Nov 06 12:05:14 devstack sudo[109185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:14 devstack sudo[109185]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6e891232-f255-4f9c-a318-3df00712f9e0 tempest-ProjectMemberTests-2128122521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b958f13-7699-4cba-88aa-49a3c5591ebb" returned: 0 in 0.344s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:14 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6e891232-f255-4f9c-a318-3df00712f9e0 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b958f13-7699-4cba-88aa-49a3c5591ebb {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:14 devstack sudo[109190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b958f13-7699-4cba-88aa-49a3c5591ebb
Nov 06 12:05:14 devstack sudo[109190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:15 devstack sudo[109190]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6e891232-f255-4f9c-a318-3df00712f9e0 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-8b958f13-7699-4cba-88aa-49a3c5591ebb" returned: 0 in 0.236s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:15 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-6e891232-f255-4f9c-a318-3df00712f9e0 tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-8b958f13-7699-4cba-88aa-49a3c5591ebb" released by "delete_volume" :: held 0.636s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:05:15 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-6e891232-f255-4f9c-a318-3df00712f9e0 tempest-ProjectMemberTests-2128122521 None] Created reservations ['3424c324-71d4-4497-b847-75d4fa4b8e14', 'e93c8a4c-b728-43f8-b23c-f8661019e9d8', '1396628f-4f67-4061-bad7-0f8fa0095945', 'ffa4e41d-9d20-4226-abc0-0000719af07c'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:05:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6e891232-f255-4f9c-a318-3df00712f9e0 tempest-ProjectMemberTests-2128122521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:05:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6e891232-f255-4f9c-a318-3df00712f9e0 tempest-ProjectMemberTests-2128122521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:05:15 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-6e891232-f255-4f9c-a318-3df00712f9e0 tempest-ProjectMemberTests-2128122521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:05:15 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-6e891232-f255-4f9c-a318-3df00712f9e0 tempest-ProjectMemberTests-2128122521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:05:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6e891232-f255-4f9c-a318-3df00712f9e0 tempest-ProjectMemberTests-2128122521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:05:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6e891232-f255-4f9c-a318-3df00712f9e0 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:15 devstack sudo[109194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:05:15 devstack sudo[109194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:15 devstack sudo[109194]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:15 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6e891232-f255-4f9c-a318-3df00712f9e0 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.230s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:15 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-6e891232-f255-4f9c-a318-3df00712f9e0 tempest-ProjectMemberTests-2128122521 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:05:15 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-6e891232-f255-4f9c-a318-3df00712f9e0 tempest-ProjectMemberTests-2128122521 None] Deleted volume successfully.
Nov 06 12:05:15 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-6e891232-f255-4f9c-a318-3df00712f9e0 tempest-ProjectMemberTests-2128122521 None] Lock "cinder-8b958f13-7699-4cba-88aa-49a3c5591ebb-delete_volume" released by "delete_volume" :: held 1.046s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:05:15 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-3610cf74-a578-4ab6-a122-bbd6906ff32a tempest-ProjectMemberTests-2128122521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:05:15 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3610cf74-a578-4ab6-a122-bbd6906ff32a tempest-ProjectMemberTests-2128122521 None] Flow 'volume_create_manager' (233e9910-cb9d-4868-b5b3-51b5d8395003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:05:15 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3610cf74-a578-4ab6-a122-bbd6906ff32a tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5626c599-ebd2-43a0-bb0b-466ba6d9a626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:05:15 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3610cf74-a578-4ab6-a122-bbd6906ff32a tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5626c599-ebd2-43a0-bb0b-466ba6d9a626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2081828233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35608269-412d-4391-a146-9f5bf2a11cd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3c5c4d5cd09492198badac02cec1874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:05:16Z,use_quota=True,user_id='78f8479fdeb04b689787bce30dc332ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:05:15 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3610cf74-a578-4ab6-a122-bbd6906ff32a tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdeba9e0-4401-4589-8c03-43401859592c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:05:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3610cf74-a578-4ab6-a122-bbd6906ff32a tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdeba9e0-4401-4589-8c03-43401859592c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:05:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3610cf74-a578-4ab6-a122-bbd6906ff32a tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (769d3ae9-c847-4960-8dfe-59960a8963f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:05:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3610cf74-a578-4ab6-a122-bbd6906ff32a tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (769d3ae9-c847-4960-8dfe-59960a8963f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35608269-412d-4391-a146-9f5bf2a11cd8', 'volume_name': 'volume-35608269-412d-4391-a146-9f5bf2a11cd8', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:05:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3610cf74-a578-4ab6-a122-bbd6906ff32a tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ad6f276-d5a8-474d-9273-b961eb628bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:05:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3610cf74-a578-4ab6-a122-bbd6906ff32a tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ad6f276-d5a8-474d-9273-b961eb628bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:05:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3610cf74-a578-4ab6-a122-bbd6906ff32a tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fde4e11d-38ac-4191-851f-44dc9111994a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:05:16 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-3610cf74-a578-4ab6-a122-bbd6906ff32a tempest-ProjectMemberTests-2128122521 None] Volume 35608269-412d-4391-a146-9f5bf2a11cd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35608269-412d-4391-a146-9f5bf2a11cd8', 'volume_size': 1}
Nov 06 12:05:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3610cf74-a578-4ab6-a122-bbd6906ff32a tempest-ProjectMemberTests-2128122521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:05:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3610cf74-a578-4ab6-a122-bbd6906ff32a tempest-ProjectMemberTests-2128122521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:05:16 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-3610cf74-a578-4ab6-a122-bbd6906ff32a tempest-ProjectMemberTests-2128122521 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2081828233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35608269-412d-4391-a146-9f5bf2a11cd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3c5c4d5cd09492198badac02cec1874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:05:16Z,use_quota=True,user_id='78f8479fdeb04b689787bce30dc332ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:05:16 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-3610cf74-a578-4ab6-a122-bbd6906ff32a tempest-ProjectMemberTests-2128122521 None] Creating volume 35608269-412d-4391-a146-9f5bf2a11cd8 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:05:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3610cf74-a578-4ab6-a122-bbd6906ff32a tempest-ProjectMemberTests-2128122521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:05:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3610cf74-a578-4ab6-a122-bbd6906ff32a tempest-ProjectMemberTests-2128122521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:05:16 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-3610cf74-a578-4ab6-a122-bbd6906ff32a tempest-ProjectMemberTests-2128122521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:05:16 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-3610cf74-a578-4ab6-a122-bbd6906ff32a tempest-ProjectMemberTests-2128122521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:05:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3610cf74-a578-4ab6-a122-bbd6906ff32a tempest-ProjectMemberTests-2128122521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:05:16 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-3610cf74-a578-4ab6-a122-bbd6906ff32a tempest-ProjectMemberTests-2128122521 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:05:16 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-3610cf74-a578-4ab6-a122-bbd6906ff32a tempest-ProjectMemberTests-2128122521 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:05:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3610cf74-a578-4ab6-a122-bbd6906ff32a tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35608269-412d-4391-a146-9f5bf2a11cd8 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:16 devstack sudo[109197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35608269-412d-4391-a146-9f5bf2a11cd8 1073741824
Nov 06 12:05:16 devstack sudo[109197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:16 devstack sudo[109197]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3610cf74-a578-4ab6-a122-bbd6906ff32a tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35608269-412d-4391-a146-9f5bf2a11cd8 1073741824" returned: 0 in 0.396s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3610cf74-a578-4ab6-a122-bbd6906ff32a tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35608269-412d-4391-a146-9f5bf2a11cd8 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:16 devstack sudo[109202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35608269-412d-4391-a146-9f5bf2a11cd8
Nov 06 12:05:16 devstack sudo[109202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:16 devstack sudo[109202]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-3610cf74-a578-4ab6-a122-bbd6906ff32a tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35608269-412d-4391-a146-9f5bf2a11cd8" returned: 0 in 0.260s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:16 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-3610cf74-a578-4ab6-a122-bbd6906ff32a tempest-ProjectMemberTests-2128122521 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:05:16 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-3610cf74-a578-4ab6-a122-bbd6906ff32a tempest-ProjectMemberTests-2128122521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:05:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3610cf74-a578-4ab6-a122-bbd6906ff32a tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fde4e11d-38ac-4191-851f-44dc9111994a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35608269-412d-4391-a146-9f5bf2a11cd8', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:05:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3610cf74-a578-4ab6-a122-bbd6906ff32a tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04f9db35-c454-4bbd-a2b2-5dfd4b827065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:05:16 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-3610cf74-a578-4ab6-a122-bbd6906ff32a tempest-ProjectMemberTests-2128122521 None] Volume volume-35608269-412d-4391-a146-9f5bf2a11cd8 (35608269-412d-4391-a146-9f5bf2a11cd8): created successfully
Nov 06 12:05:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3610cf74-a578-4ab6-a122-bbd6906ff32a tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04f9db35-c454-4bbd-a2b2-5dfd4b827065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:05:16 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-3610cf74-a578-4ab6-a122-bbd6906ff32a tempest-ProjectMemberTests-2128122521 None] Flow 'volume_create_manager' (233e9910-cb9d-4868-b5b3-51b5d8395003) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:05:16 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-3610cf74-a578-4ab6-a122-bbd6906ff32a tempest-ProjectMemberTests-2128122521 None] Created volume successfully.
Nov 06 12:05:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-33005cb2-1584-4047-96fb-86679e42a597 tempest-ProjectMemberTests-2128122521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:05:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-33005cb2-1584-4047-96fb-86679e42a597 tempest-ProjectMemberTests-2128122521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:05:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-33005cb2-1584-4047-96fb-86679e42a597 tempest-ProjectMemberTests-2128122521 None] Creating offline snapshot 0d092edf-cb9e-4326-a55b-6dafd378e6ba of volume 35608269-412d-4391-a146-9f5bf2a11cd8 {{(pid=87165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 12:05:17 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[33cf6823-1cf9-482b-8447-96a3dc509b72]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:05:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-33005cb2-1584-4047-96fb-86679e42a597 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35608269-412d-4391-a146-9f5bf2a11cd8 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:17 devstack cinder-volume[87165]: DEBUG oslo_service.periodic_task [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 12:05:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:05:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:05:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:05:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:05:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:05:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:17 devstack sudo[109206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:05:17 devstack sudo[109206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:17 devstack sudo[109205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35608269-412d-4391-a146-9f5bf2a11cd8
Nov 06 12:05:17 devstack sudo[109205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:17 devstack sudo[109206]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.256s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:17 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:05:17 devstack cinder-volume[87165]: DEBUG oslo_service.periodic_task [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running periodic task VolumeManager._thread_info {{(pid=87165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 12:05:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] thread count: 29 {{(pid=87165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 12:05:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] thread info: [<_MainThread(MainThread, started 127732956901504)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127732842693056)>, <Thread(Thread-3 (stat_writer), started daemon 127732841891136)>, <Thread(Rabbit-heartbeat, started daemon 127732842515648)>, <Thread(Thread-5 (_runner), started daemon 127732840534464)>, <Thread(Thread-7 (_runner), started daemon 127732840636032)>, <Thread(fd_logger, started daemon 127732838664256)>, <Thread(privsep_reader, started daemon 127732838673408)>, <Thread(tpool_thread_0, started daemon 127732829828800)>, <Thread(tpool_thread_1, started daemon 127732821436096)>, <Thread(tpool_thread_2, started daemon 127732813043392)>, <Thread(tpool_thread_3, started daemon 127732804650688)>, <Thread(tpool_thread_4, started daemon 127732796257984)>, <Thread(tpool_thread_5, started daemon 127732787865280)>, <Thread(tpool_thread_6, started daemon 127732779456192)>, <Thread(tpool_thread_7, started daemon 127732771047104)>, <Thread(tpool_thread_8, started daemon 127732762638016)>, <Thread(tpool_thread_9, started daemon 127732754228928)>, <Thread(tpool_thread_10, started daemon 127732745819840)>, <Thread(tpool_thread_11, started daemon 127732737410752)>, <Thread(tpool_thread_12, started daemon 127732729001664)>, <Thread(tpool_thread_13, started daemon 127732720592576)>, <Thread(tpool_thread_14, started daemon 127732712183488)>, <Thread(tpool_thread_15, started daemon 127732703774400)>, <Thread(tpool_thread_16, started daemon 127732695365312)>, <Thread(tpool_thread_17, started daemon 127732686956224)>, <Thread(tpool_thread_18, started daemon 127732678547136)>, <Thread(tpool_thread_19, started daemon 127732670138048)>, <Thread(Rabbit-heartbeat, started daemon 127732832631296)>] {{(pid=87165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 06 12:05:17 devstack sudo[109205]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-33005cb2-1584-4047-96fb-86679e42a597 tempest-ProjectMemberTests-2128122521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35608269-412d-4391-a146-9f5bf2a11cd8" returned: 0 in 0.362s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-33005cb2-1584-4047-96fb-86679e42a597 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35608269-412d-4391-a146-9f5bf2a11cd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35608269-412d-4391-a146-9f5bf2a11cd8.0d092edf-cb9e-4326-a55b-6dafd378e6ba 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:17 devstack sudo[109213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35608269-412d-4391-a146-9f5bf2a11cd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35608269-412d-4391-a146-9f5bf2a11cd8.0d092edf-cb9e-4326-a55b-6dafd378e6ba 1G
Nov 06 12:05:17 devstack sudo[109213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:17 devstack sudo[109213]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-33005cb2-1584-4047-96fb-86679e42a597 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35608269-412d-4391-a146-9f5bf2a11cd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35608269-412d-4391-a146-9f5bf2a11cd8.0d092edf-cb9e-4326-a55b-6dafd378e6ba 1G" returned: 0 in 0.388s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-33005cb2-1584-4047-96fb-86679e42a597 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35608269-412d-4391-a146-9f5bf2a11cd8 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35608269-412d-4391-a146-9f5bf2a11cd8.0d092edf-cb9e-4326-a55b-6dafd378e6ba {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:17 devstack sudo[109218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35608269-412d-4391-a146-9f5bf2a11cd8 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35608269-412d-4391-a146-9f5bf2a11cd8.0d092edf-cb9e-4326-a55b-6dafd378e6ba
Nov 06 12:05:17 devstack sudo[109218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:18 devstack sudo[109218]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-33005cb2-1584-4047-96fb-86679e42a597 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35608269-412d-4391-a146-9f5bf2a11cd8 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35608269-412d-4391-a146-9f5bf2a11cd8.0d092edf-cb9e-4326-a55b-6dafd378e6ba" returned: 0 in 0.280s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:18 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-33005cb2-1584-4047-96fb-86679e42a597 tempest-ProjectMemberTests-2128122521 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35608269-412d-4391-a146-9f5bf2a11cd8.0d092edf-cb9e-4326-a55b-6dafd378e6ba is being set with open permissions: ugo+rw
Nov 06 12:05:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-33005cb2-1584-4047-96fb-86679e42a597 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35608269-412d-4391-a146-9f5bf2a11cd8.0d092edf-cb9e-4326-a55b-6dafd378e6ba {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:18 devstack sudo[109223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35608269-412d-4391-a146-9f5bf2a11cd8.0d092edf-cb9e-4326-a55b-6dafd378e6ba
Nov 06 12:05:18 devstack sudo[109223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:18 devstack sudo[109223]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-33005cb2-1584-4047-96fb-86679e42a597 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35608269-412d-4391-a146-9f5bf2a11cd8.0d092edf-cb9e-4326-a55b-6dafd378e6ba" returned: 0 in 0.231s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-33005cb2-1584-4047-96fb-86679e42a597 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35608269-412d-4391-a146-9f5bf2a11cd8.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:18 devstack sudo[109226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35608269-412d-4391-a146-9f5bf2a11cd8.info
Nov 06 12:05:18 devstack sudo[109226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:18 devstack sudo[109226]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-33005cb2-1584-4047-96fb-86679e42a597 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35608269-412d-4391-a146-9f5bf2a11cd8.info" returned: 0 in 0.241s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:18 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-33005cb2-1584-4047-96fb-86679e42a597 tempest-ProjectMemberTests-2128122521 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35608269-412d-4391-a146-9f5bf2a11cd8.info is being set with open permissions: ugo+rw
Nov 06 12:05:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-33005cb2-1584-4047-96fb-86679e42a597 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35608269-412d-4391-a146-9f5bf2a11cd8.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:18 devstack sudo[109229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35608269-412d-4391-a146-9f5bf2a11cd8.info
Nov 06 12:05:18 devstack sudo[109229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:18 devstack sudo[109229]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-33005cb2-1584-4047-96fb-86679e42a597 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35608269-412d-4391-a146-9f5bf2a11cd8.info" returned: 0 in 0.262s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:18 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-33005cb2-1584-4047-96fb-86679e42a597 tempest-ProjectMemberTests-2128122521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.856s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:05:18 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-33005cb2-1584-4047-96fb-86679e42a597 tempest-ProjectMemberTests-2128122521 None] Create snapshot completed successfully
Nov 06 12:05:19 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-47d09d11-4942-4d48-8b03-e37ad7b8aa73 tempest-ProjectMemberTests-2128122521 None] Acquiring lock "cinder-0d092edf-cb9e-4326-a55b-6dafd378e6ba-delete_snapshot" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:05:19 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-47d09d11-4942-4d48-8b03-e37ad7b8aa73 tempest-ProjectMemberTests-2128122521 None] Lock "cinder-0d092edf-cb9e-4326-a55b-6dafd378e6ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:05:19 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-47d09d11-4942-4d48-8b03-e37ad7b8aa73 tempest-ProjectMemberTests-2128122521 None] Acquiring lock "cinder-quobyte-35608269-412d-4391-a146-9f5bf2a11cd8" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:05:19 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-47d09d11-4942-4d48-8b03-e37ad7b8aa73 tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-35608269-412d-4391-a146-9f5bf2a11cd8" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:05:19 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-47d09d11-4942-4d48-8b03-e37ad7b8aa73 tempest-ProjectMemberTests-2128122521 None] Acquiring lock "cinder-quobyte-0d092edf-cb9e-4326-a55b-6dafd378e6ba" by "_delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:05:19 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-47d09d11-4942-4d48-8b03-e37ad7b8aa73 tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-0d092edf-cb9e-4326-a55b-6dafd378e6ba" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:05:19 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-47d09d11-4942-4d48-8b03-e37ad7b8aa73 tempest-ProjectMemberTests-2128122521 None] Deleting offline snapshot 0d092edf-cb9e-4326-a55b-6dafd378e6ba of volume 35608269-412d-4391-a146-9f5bf2a11cd8 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 12:05:19 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-47d09d11-4942-4d48-8b03-e37ad7b8aa73 tempest-ProjectMemberTests-2128122521 None] snapshot_file for this snap is: volume-35608269-412d-4391-a146-9f5bf2a11cd8.0d092edf-cb9e-4326-a55b-6dafd378e6ba {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 12:05:19 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0aa27a-5fec-4c6e-93d8-4a89ebffcd4f]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:05:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-47d09d11-4942-4d48-8b03-e37ad7b8aa73 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35608269-412d-4391-a146-9f5bf2a11cd8.0d092edf-cb9e-4326-a55b-6dafd378e6ba {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:19 devstack sudo[109232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35608269-412d-4391-a146-9f5bf2a11cd8.0d092edf-cb9e-4326-a55b-6dafd378e6ba
Nov 06 12:05:19 devstack sudo[109232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:19 devstack sudo[109232]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-47d09d11-4942-4d48-8b03-e37ad7b8aa73 tempest-ProjectMemberTests-2128122521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35608269-412d-4391-a146-9f5bf2a11cd8.0d092edf-cb9e-4326-a55b-6dafd378e6ba" returned: 0 in 0.373s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:19 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-47d09d11-4942-4d48-8b03-e37ad7b8aa73 tempest-ProjectMemberTests-2128122521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35608269-412d-4391-a146-9f5bf2a11cd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 12:05:19 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a649eac-979d-4be7-9d66-4aa569ba1d42]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:05:19 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-47d09d11-4942-4d48-8b03-e37ad7b8aa73 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35608269-412d-4391-a146-9f5bf2a11cd8 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:19 devstack sudo[109237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35608269-412d-4391-a146-9f5bf2a11cd8
Nov 06 12:05:19 devstack sudo[109237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:20 devstack sudo[109237]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-47d09d11-4942-4d48-8b03-e37ad7b8aa73 tempest-ProjectMemberTests-2128122521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35608269-412d-4391-a146-9f5bf2a11cd8" returned: 0 in 0.367s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-47d09d11-4942-4d48-8b03-e37ad7b8aa73 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35608269-412d-4391-a146-9f5bf2a11cd8.0d092edf-cb9e-4326-a55b-6dafd378e6ba {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:20 devstack sudo[109243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35608269-412d-4391-a146-9f5bf2a11cd8.0d092edf-cb9e-4326-a55b-6dafd378e6ba
Nov 06 12:05:20 devstack sudo[109243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:20 devstack sudo[109243]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-47d09d11-4942-4d48-8b03-e37ad7b8aa73 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35608269-412d-4391-a146-9f5bf2a11cd8.0d092edf-cb9e-4326-a55b-6dafd378e6ba" returned: 0 in 0.338s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-47d09d11-4942-4d48-8b03-e37ad7b8aa73 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35608269-412d-4391-a146-9f5bf2a11cd8.0d092edf-cb9e-4326-a55b-6dafd378e6ba {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:20 devstack sudo[109248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35608269-412d-4391-a146-9f5bf2a11cd8.0d092edf-cb9e-4326-a55b-6dafd378e6ba
Nov 06 12:05:20 devstack sudo[109248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:20 devstack sudo[109248]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:20 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-47d09d11-4942-4d48-8b03-e37ad7b8aa73 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35608269-412d-4391-a146-9f5bf2a11cd8.0d092edf-cb9e-4326-a55b-6dafd378e6ba" returned: 0 in 0.249s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:20 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-47d09d11-4942-4d48-8b03-e37ad7b8aa73 tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-0d092edf-cb9e-4326-a55b-6dafd378e6ba" released by "_delete_snapshot" :: held 1.428s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:05:20 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-47d09d11-4942-4d48-8b03-e37ad7b8aa73 tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-35608269-412d-4391-a146-9f5bf2a11cd8" released by "delete_snapshot" :: held 1.447s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:05:20 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-47d09d11-4942-4d48-8b03-e37ad7b8aa73 tempest-ProjectMemberTests-2128122521 None] Created reservations ['5dea3ad0-79c6-4782-b859-10a359f7704f', '3eb59001-fd4f-447a-8a13-f37dbbe1d79a', 'cc93aa73-6582-4a02-9c3a-46fb67d2bf5f', '8c596e9b-c598-41a2-ba6f-0db6f58ac7f4'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:05:20 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-47d09d11-4942-4d48-8b03-e37ad7b8aa73 tempest-ProjectMemberTests-2128122521 None] Delete snapshot completed successfully.
Nov 06 12:05:20 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-47d09d11-4942-4d48-8b03-e37ad7b8aa73 tempest-ProjectMemberTests-2128122521 None] Lock "cinder-0d092edf-cb9e-4326-a55b-6dafd378e6ba-delete_snapshot" released by "delete_snapshot" :: held 1.581s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:05:21 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-72482dd8-b3ac-48a2-b486-96336ef81d69 tempest-ProjectMemberTests-2128122521 None] Acquiring lock "cinder-35608269-412d-4391-a146-9f5bf2a11cd8-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:05:21 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-72482dd8-b3ac-48a2-b486-96336ef81d69 tempest-ProjectMemberTests-2128122521 None] Lock "cinder-35608269-412d-4391-a146-9f5bf2a11cd8-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:05:21 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-72482dd8-b3ac-48a2-b486-96336ef81d69 tempest-ProjectMemberTests-2128122521 None] Acquiring lock "cinder-quobyte-35608269-412d-4391-a146-9f5bf2a11cd8" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:05:21 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-72482dd8-b3ac-48a2-b486-96336ef81d69 tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-35608269-412d-4391-a146-9f5bf2a11cd8" acquired by "delete_volume" :: waited 0.014s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:05:21 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[44171234-e8f8-4047-b775-1cb703014ebc]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:05:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-72482dd8-b3ac-48a2-b486-96336ef81d69 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35608269-412d-4391-a146-9f5bf2a11cd8 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:21 devstack sudo[109251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35608269-412d-4391-a146-9f5bf2a11cd8
Nov 06 12:05:21 devstack sudo[109251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:21 devstack sudo[109251]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-72482dd8-b3ac-48a2-b486-96336ef81d69 tempest-ProjectMemberTests-2128122521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35608269-412d-4391-a146-9f5bf2a11cd8" returned: 0 in 0.355s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:21 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-72482dd8-b3ac-48a2-b486-96336ef81d69 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35608269-412d-4391-a146-9f5bf2a11cd8 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:21 devstack sudo[109256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35608269-412d-4391-a146-9f5bf2a11cd8
Nov 06 12:05:21 devstack sudo[109256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:22 devstack sudo[109256]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-72482dd8-b3ac-48a2-b486-96336ef81d69 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-35608269-412d-4391-a146-9f5bf2a11cd8" returned: 0 in 0.240s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:22 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-72482dd8-b3ac-48a2-b486-96336ef81d69 tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-35608269-412d-4391-a146-9f5bf2a11cd8" released by "delete_volume" :: held 0.656s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:05:22 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-72482dd8-b3ac-48a2-b486-96336ef81d69 tempest-ProjectMemberTests-2128122521 None] Created reservations ['7dafbce9-1eff-4496-a8f9-9269f6716486', 'ef41bf0f-0ff0-4334-9b3a-cc0a5dcedcc0', 'dca3fa5b-8ee3-478a-a076-8944a8a9de2e', 'e046cc72-d84d-4ce9-be18-956d0254f2f5'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:05:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-72482dd8-b3ac-48a2-b486-96336ef81d69 tempest-ProjectMemberTests-2128122521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:05:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-72482dd8-b3ac-48a2-b486-96336ef81d69 tempest-ProjectMemberTests-2128122521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:05:22 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-72482dd8-b3ac-48a2-b486-96336ef81d69 tempest-ProjectMemberTests-2128122521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:05:22 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-72482dd8-b3ac-48a2-b486-96336ef81d69 tempest-ProjectMemberTests-2128122521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:05:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-72482dd8-b3ac-48a2-b486-96336ef81d69 tempest-ProjectMemberTests-2128122521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:05:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-72482dd8-b3ac-48a2-b486-96336ef81d69 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:22 devstack sudo[109259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:05:22 devstack sudo[109259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:22 devstack sudo[109259]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:22 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-72482dd8-b3ac-48a2-b486-96336ef81d69 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.225s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:22 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-72482dd8-b3ac-48a2-b486-96336ef81d69 tempest-ProjectMemberTests-2128122521 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:05:22 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-72482dd8-b3ac-48a2-b486-96336ef81d69 tempest-ProjectMemberTests-2128122521 None] Deleted volume successfully.
Nov 06 12:05:22 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-72482dd8-b3ac-48a2-b486-96336ef81d69 tempest-ProjectMemberTests-2128122521 None] Lock "cinder-35608269-412d-4391-a146-9f5bf2a11cd8-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:05:22 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-462c6d8b-c672-4a3d-8394-223e01a81a2e tempest-ProjectMemberTests-2128122521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:05:22 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-462c6d8b-c672-4a3d-8394-223e01a81a2e tempest-ProjectMemberTests-2128122521 None] Flow 'volume_create_manager' (14398075-2db4-413a-80f5-0a0d2b232758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:05:22 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-462c6d8b-c672-4a3d-8394-223e01a81a2e tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ad6b76b-1c3c-4baa-98dc-f80331e580fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:05:23 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-462c6d8b-c672-4a3d-8394-223e01a81a2e tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ad6b76b-1c3c-4baa-98dc-f80331e580fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1071865656',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b72e8de-25e0-4e7e-94f6-e26da10aa609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3c5c4d5cd09492198badac02cec1874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:05:23Z,use_quota=True,user_id='78f8479fdeb04b689787bce30dc332ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:05:23 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-462c6d8b-c672-4a3d-8394-223e01a81a2e tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8e2e600-2259-4fe3-86e8-130348eed719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:05:23 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-462c6d8b-c672-4a3d-8394-223e01a81a2e tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8e2e600-2259-4fe3-86e8-130348eed719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:05:23 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-462c6d8b-c672-4a3d-8394-223e01a81a2e tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cbec080-b0ad-43e3-a82b-d5c0ff5a75ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:05:23 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-462c6d8b-c672-4a3d-8394-223e01a81a2e tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cbec080-b0ad-43e3-a82b-d5c0ff5a75ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b72e8de-25e0-4e7e-94f6-e26da10aa609', 'volume_name': 'volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:05:23 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-462c6d8b-c672-4a3d-8394-223e01a81a2e tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b265834-37be-4c62-bb5b-c0119334ed41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:05:23 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-462c6d8b-c672-4a3d-8394-223e01a81a2e tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b265834-37be-4c62-bb5b-c0119334ed41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:05:23 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-462c6d8b-c672-4a3d-8394-223e01a81a2e tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93073396-ddab-4a7e-afe5-6023fb522bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:05:23 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-462c6d8b-c672-4a3d-8394-223e01a81a2e tempest-ProjectMemberTests-2128122521 None] Volume 9b72e8de-25e0-4e7e-94f6-e26da10aa609: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609', 'volume_size': 1}
Nov 06 12:05:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-462c6d8b-c672-4a3d-8394-223e01a81a2e tempest-ProjectMemberTests-2128122521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:05:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-462c6d8b-c672-4a3d-8394-223e01a81a2e tempest-ProjectMemberTests-2128122521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:05:23 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-462c6d8b-c672-4a3d-8394-223e01a81a2e tempest-ProjectMemberTests-2128122521 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1071865656',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b72e8de-25e0-4e7e-94f6-e26da10aa609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3c5c4d5cd09492198badac02cec1874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:05:23Z,use_quota=True,user_id='78f8479fdeb04b689787bce30dc332ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:05:23 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-462c6d8b-c672-4a3d-8394-223e01a81a2e tempest-ProjectMemberTests-2128122521 None] Creating volume 9b72e8de-25e0-4e7e-94f6-e26da10aa609 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:05:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-462c6d8b-c672-4a3d-8394-223e01a81a2e tempest-ProjectMemberTests-2128122521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:05:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-462c6d8b-c672-4a3d-8394-223e01a81a2e tempest-ProjectMemberTests-2128122521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:05:23 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-462c6d8b-c672-4a3d-8394-223e01a81a2e tempest-ProjectMemberTests-2128122521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:05:23 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-462c6d8b-c672-4a3d-8394-223e01a81a2e tempest-ProjectMemberTests-2128122521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:05:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-462c6d8b-c672-4a3d-8394-223e01a81a2e tempest-ProjectMemberTests-2128122521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:05:23 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-462c6d8b-c672-4a3d-8394-223e01a81a2e tempest-ProjectMemberTests-2128122521 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:05:23 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-462c6d8b-c672-4a3d-8394-223e01a81a2e tempest-ProjectMemberTests-2128122521 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:05:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-462c6d8b-c672-4a3d-8394-223e01a81a2e tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:23 devstack sudo[109262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609 1073741824
Nov 06 12:05:23 devstack sudo[109262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:23 devstack sudo[109262]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-462c6d8b-c672-4a3d-8394-223e01a81a2e tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609 1073741824" returned: 0 in 0.385s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-462c6d8b-c672-4a3d-8394-223e01a81a2e tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:23 devstack sudo[109268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609
Nov 06 12:05:23 devstack sudo[109268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:23 devstack sudo[109268]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-462c6d8b-c672-4a3d-8394-223e01a81a2e tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609" returned: 0 in 0.237s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:23 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-462c6d8b-c672-4a3d-8394-223e01a81a2e tempest-ProjectMemberTests-2128122521 None] <== create_volume: return (663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:05:23 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-462c6d8b-c672-4a3d-8394-223e01a81a2e tempest-ProjectMemberTests-2128122521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.665s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:05:23 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-462c6d8b-c672-4a3d-8394-223e01a81a2e tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93073396-ddab-4a7e-afe5-6023fb522bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:05:23 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-462c6d8b-c672-4a3d-8394-223e01a81a2e tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6ab27e5-921c-415e-a9bb-a31720e08d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:05:23 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-462c6d8b-c672-4a3d-8394-223e01a81a2e tempest-ProjectMemberTests-2128122521 None] Volume volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609 (9b72e8de-25e0-4e7e-94f6-e26da10aa609): created successfully
Nov 06 12:05:23 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-462c6d8b-c672-4a3d-8394-223e01a81a2e tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6ab27e5-921c-415e-a9bb-a31720e08d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:05:23 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-462c6d8b-c672-4a3d-8394-223e01a81a2e tempest-ProjectMemberTests-2128122521 None] Flow 'volume_create_manager' (14398075-2db4-413a-80f5-0a0d2b232758) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:05:23 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-462c6d8b-c672-4a3d-8394-223e01a81a2e tempest-ProjectMemberTests-2128122521 None] Created volume successfully.
Nov 06 12:05:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a2d4e180-4c70-460c-8a5b-c09543b8099d tempest-ProjectMemberTests-2128122521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:05:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a2d4e180-4c70-460c-8a5b-c09543b8099d tempest-ProjectMemberTests-2128122521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:05:24 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-a2d4e180-4c70-460c-8a5b-c09543b8099d tempest-ProjectMemberTests-2128122521 None] Creating offline snapshot 92fd3621-2558-4ed3-899c-4033597874ea of volume 9b72e8de-25e0-4e7e-94f6-e26da10aa609 {{(pid=87165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 12:05:24 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7a3e39-39a8-4622-a763-28b89b26453a]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:05:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a2d4e180-4c70-460c-8a5b-c09543b8099d tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:24 devstack sudo[109271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609
Nov 06 12:05:24 devstack sudo[109271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:24 devstack sudo[109271]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a2d4e180-4c70-460c-8a5b-c09543b8099d tempest-ProjectMemberTests-2128122521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609" returned: 0 in 0.360s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a2d4e180-4c70-460c-8a5b-c09543b8099d tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609.92fd3621-2558-4ed3-899c-4033597874ea 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:24 devstack sudo[109276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609.92fd3621-2558-4ed3-899c-4033597874ea 1G
Nov 06 12:05:24 devstack sudo[109276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:24 devstack sudo[109276]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a2d4e180-4c70-460c-8a5b-c09543b8099d tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609.92fd3621-2558-4ed3-899c-4033597874ea 1G" returned: 0 in 0.381s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a2d4e180-4c70-460c-8a5b-c09543b8099d tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609.92fd3621-2558-4ed3-899c-4033597874ea {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:24 devstack sudo[109282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609.92fd3621-2558-4ed3-899c-4033597874ea
Nov 06 12:05:24 devstack sudo[109282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:25 devstack sudo[109282]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a2d4e180-4c70-460c-8a5b-c09543b8099d tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609.92fd3621-2558-4ed3-899c-4033597874ea" returned: 0 in 0.300s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:25 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-a2d4e180-4c70-460c-8a5b-c09543b8099d tempest-ProjectMemberTests-2128122521 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609.92fd3621-2558-4ed3-899c-4033597874ea is being set with open permissions: ugo+rw
Nov 06 12:05:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a2d4e180-4c70-460c-8a5b-c09543b8099d tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609.92fd3621-2558-4ed3-899c-4033597874ea {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:25 devstack sudo[109288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609.92fd3621-2558-4ed3-899c-4033597874ea
Nov 06 12:05:25 devstack sudo[109288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:25 devstack sudo[109288]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a2d4e180-4c70-460c-8a5b-c09543b8099d tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609.92fd3621-2558-4ed3-899c-4033597874ea" returned: 0 in 0.239s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a2d4e180-4c70-460c-8a5b-c09543b8099d tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:25 devstack sudo[109291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609.info
Nov 06 12:05:25 devstack sudo[109291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:25 devstack sudo[109291]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a2d4e180-4c70-460c-8a5b-c09543b8099d tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609.info" returned: 0 in 0.254s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:25 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-a2d4e180-4c70-460c-8a5b-c09543b8099d tempest-ProjectMemberTests-2128122521 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609.info is being set with open permissions: ugo+rw
Nov 06 12:05:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a2d4e180-4c70-460c-8a5b-c09543b8099d tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:25 devstack sudo[109294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609.info
Nov 06 12:05:25 devstack sudo[109294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:25 devstack sudo[109294]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a2d4e180-4c70-460c-8a5b-c09543b8099d tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609.info" returned: 0 in 0.255s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:25 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a2d4e180-4c70-460c-8a5b-c09543b8099d tempest-ProjectMemberTests-2128122521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.868s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:05:26 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-a2d4e180-4c70-460c-8a5b-c09543b8099d tempest-ProjectMemberTests-2128122521 None] Create snapshot completed successfully
Nov 06 12:05:26 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-126a28a8-19cf-4b35-b5c4-1cd047dd5d17 tempest-ProjectMemberTests-2128122521 None] Acquiring lock "cinder-92fd3621-2558-4ed3-899c-4033597874ea-delete_snapshot" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:05:26 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-126a28a8-19cf-4b35-b5c4-1cd047dd5d17 tempest-ProjectMemberTests-2128122521 None] Lock "cinder-92fd3621-2558-4ed3-899c-4033597874ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:05:26 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-126a28a8-19cf-4b35-b5c4-1cd047dd5d17 tempest-ProjectMemberTests-2128122521 None] Acquiring lock "cinder-quobyte-9b72e8de-25e0-4e7e-94f6-e26da10aa609" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:05:26 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-126a28a8-19cf-4b35-b5c4-1cd047dd5d17 tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-9b72e8de-25e0-4e7e-94f6-e26da10aa609" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:05:26 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-126a28a8-19cf-4b35-b5c4-1cd047dd5d17 tempest-ProjectMemberTests-2128122521 None] Acquiring lock "cinder-quobyte-92fd3621-2558-4ed3-899c-4033597874ea" by "_delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:05:26 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-126a28a8-19cf-4b35-b5c4-1cd047dd5d17 tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-92fd3621-2558-4ed3-899c-4033597874ea" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:05:26 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-126a28a8-19cf-4b35-b5c4-1cd047dd5d17 tempest-ProjectMemberTests-2128122521 None] Deleting offline snapshot 92fd3621-2558-4ed3-899c-4033597874ea of volume 9b72e8de-25e0-4e7e-94f6-e26da10aa609 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 12:05:26 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-126a28a8-19cf-4b35-b5c4-1cd047dd5d17 tempest-ProjectMemberTests-2128122521 None] snapshot_file for this snap is: volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609.92fd3621-2558-4ed3-899c-4033597874ea {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 12:05:26 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5860c52a-4577-401a-9fcb-f7a3a0621009]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:05:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-126a28a8-19cf-4b35-b5c4-1cd047dd5d17 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609.92fd3621-2558-4ed3-899c-4033597874ea {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:26 devstack sudo[109297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609.92fd3621-2558-4ed3-899c-4033597874ea
Nov 06 12:05:26 devstack sudo[109297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:26 devstack sudo[109297]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-126a28a8-19cf-4b35-b5c4-1cd047dd5d17 tempest-ProjectMemberTests-2128122521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609.92fd3621-2558-4ed3-899c-4033597874ea" returned: 0 in 0.373s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:26 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-126a28a8-19cf-4b35-b5c4-1cd047dd5d17 tempest-ProjectMemberTests-2128122521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 12:05:26 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb22e64-9bf9-429a-9271-3e7270d4995f]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:05:26 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-126a28a8-19cf-4b35-b5c4-1cd047dd5d17 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:26 devstack sudo[109302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609
Nov 06 12:05:26 devstack sudo[109302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:27 devstack sudo[109302]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-126a28a8-19cf-4b35-b5c4-1cd047dd5d17 tempest-ProjectMemberTests-2128122521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609" returned: 0 in 0.370s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-126a28a8-19cf-4b35-b5c4-1cd047dd5d17 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609.92fd3621-2558-4ed3-899c-4033597874ea {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:27 devstack sudo[109307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609.92fd3621-2558-4ed3-899c-4033597874ea
Nov 06 12:05:27 devstack sudo[109307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:27 devstack sudo[109307]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-126a28a8-19cf-4b35-b5c4-1cd047dd5d17 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609.92fd3621-2558-4ed3-899c-4033597874ea" returned: 0 in 0.338s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-126a28a8-19cf-4b35-b5c4-1cd047dd5d17 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609.92fd3621-2558-4ed3-899c-4033597874ea {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:27 devstack sudo[109312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609.92fd3621-2558-4ed3-899c-4033597874ea
Nov 06 12:05:27 devstack sudo[109312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:27 devstack sudo[109312]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:27 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-126a28a8-19cf-4b35-b5c4-1cd047dd5d17 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609.92fd3621-2558-4ed3-899c-4033597874ea" returned: 0 in 0.247s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:27 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-126a28a8-19cf-4b35-b5c4-1cd047dd5d17 tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-92fd3621-2558-4ed3-899c-4033597874ea" released by "_delete_snapshot" :: held 1.420s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:05:27 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-126a28a8-19cf-4b35-b5c4-1cd047dd5d17 tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-9b72e8de-25e0-4e7e-94f6-e26da10aa609" released by "delete_snapshot" :: held 1.445s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:05:27 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-126a28a8-19cf-4b35-b5c4-1cd047dd5d17 tempest-ProjectMemberTests-2128122521 None] Created reservations ['9c1476ca-c1a5-4de0-b144-2c156ff77ea5', '8c059a88-10fc-43f3-926f-6aa01c9e93af', '69e7fef3-762d-490f-9c09-817f1f90b239', 'd8e065e1-a054-4ab1-9786-d2d2396d235e'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:05:27 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-126a28a8-19cf-4b35-b5c4-1cd047dd5d17 tempest-ProjectMemberTests-2128122521 None] Delete snapshot completed successfully.
Nov 06 12:05:27 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-126a28a8-19cf-4b35-b5c4-1cd047dd5d17 tempest-ProjectMemberTests-2128122521 None] Lock "cinder-92fd3621-2558-4ed3-899c-4033597874ea-delete_snapshot" released by "delete_snapshot" :: held 1.587s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:05:28 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b138bcfc-027c-4a28-97b7-32026287bddf tempest-ProjectMemberTests-2128122521 None] Acquiring lock "cinder-9b72e8de-25e0-4e7e-94f6-e26da10aa609-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:05:28 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b138bcfc-027c-4a28-97b7-32026287bddf tempest-ProjectMemberTests-2128122521 None] Lock "cinder-9b72e8de-25e0-4e7e-94f6-e26da10aa609-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:05:28 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b138bcfc-027c-4a28-97b7-32026287bddf tempest-ProjectMemberTests-2128122521 None] Acquiring lock "cinder-quobyte-9b72e8de-25e0-4e7e-94f6-e26da10aa609" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:05:28 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b138bcfc-027c-4a28-97b7-32026287bddf tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-9b72e8de-25e0-4e7e-94f6-e26da10aa609" acquired by "delete_volume" :: waited 0.015s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:05:28 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1e2b2c-f9a5-4ac4-8797-61e20a42c1e1]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:05:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b138bcfc-027c-4a28-97b7-32026287bddf tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:28 devstack sudo[109316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609
Nov 06 12:05:28 devstack sudo[109316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:28 devstack sudo[109316]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b138bcfc-027c-4a28-97b7-32026287bddf tempest-ProjectMemberTests-2128122521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609" returned: 0 in 0.354s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:28 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b138bcfc-027c-4a28-97b7-32026287bddf tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:28 devstack sudo[109321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609
Nov 06 12:05:28 devstack sudo[109321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:29 devstack sudo[109321]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b138bcfc-027c-4a28-97b7-32026287bddf tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-9b72e8de-25e0-4e7e-94f6-e26da10aa609" returned: 0 in 0.255s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:29 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b138bcfc-027c-4a28-97b7-32026287bddf tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-9b72e8de-25e0-4e7e-94f6-e26da10aa609" released by "delete_volume" :: held 0.671s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:05:29 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-b138bcfc-027c-4a28-97b7-32026287bddf tempest-ProjectMemberTests-2128122521 None] Created reservations ['39dd955a-663d-4e40-be82-504cbdc86e51', '11239814-c980-4197-b1d1-10756765ee49', '0e712e2c-d8de-4933-b729-da149bdba42e', 'bf56111f-8406-4838-9bf6-1fb03fa7cb75'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:05:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b138bcfc-027c-4a28-97b7-32026287bddf tempest-ProjectMemberTests-2128122521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:05:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b138bcfc-027c-4a28-97b7-32026287bddf tempest-ProjectMemberTests-2128122521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:05:29 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b138bcfc-027c-4a28-97b7-32026287bddf tempest-ProjectMemberTests-2128122521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:05:29 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-b138bcfc-027c-4a28-97b7-32026287bddf tempest-ProjectMemberTests-2128122521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:05:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-b138bcfc-027c-4a28-97b7-32026287bddf tempest-ProjectMemberTests-2128122521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:05:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b138bcfc-027c-4a28-97b7-32026287bddf tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:29 devstack sudo[109324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:05:29 devstack sudo[109324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:29 devstack sudo[109324]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:29 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-b138bcfc-027c-4a28-97b7-32026287bddf tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.240s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:29 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-b138bcfc-027c-4a28-97b7-32026287bddf tempest-ProjectMemberTests-2128122521 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:05:29 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-b138bcfc-027c-4a28-97b7-32026287bddf tempest-ProjectMemberTests-2128122521 None] Deleted volume successfully.
Nov 06 12:05:29 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-b138bcfc-027c-4a28-97b7-32026287bddf tempest-ProjectMemberTests-2128122521 None] Lock "cinder-9b72e8de-25e0-4e7e-94f6-e26da10aa609-delete_volume" released by "delete_volume" :: held 1.099s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:05:30 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bb08552-0077-476c-b81d-6c9a0e42e599 tempest-ProjectMemberTests-2128122521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:05:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2bb08552-0077-476c-b81d-6c9a0e42e599 tempest-ProjectMemberTests-2128122521 None] Flow 'volume_create_manager' (83631c4a-69c6-4ac5-921d-b8774ad6989d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:05:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2bb08552-0077-476c-b81d-6c9a0e42e599 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d612e95c-2415-4240-88ba-5bcc7247d192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:05:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2bb08552-0077-476c-b81d-6c9a0e42e599 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d612e95c-2415-4240-88ba-5bcc7247d192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-306593784',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76f727c0-c7a7-4895-aa11-24ea24d93f4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3c5c4d5cd09492198badac02cec1874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:05:30Z,use_quota=True,user_id='78f8479fdeb04b689787bce30dc332ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:05:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2bb08552-0077-476c-b81d-6c9a0e42e599 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44fb588a-56f8-4f85-b3fb-f233604f061b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:05:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2bb08552-0077-476c-b81d-6c9a0e42e599 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44fb588a-56f8-4f85-b3fb-f233604f061b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:05:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2bb08552-0077-476c-b81d-6c9a0e42e599 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d390ae43-d157-4609-b501-87def0a1a538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:05:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2bb08552-0077-476c-b81d-6c9a0e42e599 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d390ae43-d157-4609-b501-87def0a1a538) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76f727c0-c7a7-4895-aa11-24ea24d93f4a', 'volume_name': 'volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:05:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2bb08552-0077-476c-b81d-6c9a0e42e599 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b1c6ab7-5ae1-49d6-9003-be86eeb51809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:05:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2bb08552-0077-476c-b81d-6c9a0e42e599 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b1c6ab7-5ae1-49d6-9003-be86eeb51809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:05:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2bb08552-0077-476c-b81d-6c9a0e42e599 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (047b1f3e-4504-4742-b440-e581506630c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:05:30 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-2bb08552-0077-476c-b81d-6c9a0e42e599 tempest-ProjectMemberTests-2128122521 None] Volume 76f727c0-c7a7-4895-aa11-24ea24d93f4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a', 'volume_size': 1}
Nov 06 12:05:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-2bb08552-0077-476c-b81d-6c9a0e42e599 tempest-ProjectMemberTests-2128122521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:05:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-2bb08552-0077-476c-b81d-6c9a0e42e599 tempest-ProjectMemberTests-2128122521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:05:30 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-2bb08552-0077-476c-b81d-6c9a0e42e599 tempest-ProjectMemberTests-2128122521 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-306593784',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76f727c0-c7a7-4895-aa11-24ea24d93f4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3c5c4d5cd09492198badac02cec1874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:05:30Z,use_quota=True,user_id='78f8479fdeb04b689787bce30dc332ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:05:30 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-2bb08552-0077-476c-b81d-6c9a0e42e599 tempest-ProjectMemberTests-2128122521 None] Creating volume 76f727c0-c7a7-4895-aa11-24ea24d93f4a {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:05:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-2bb08552-0077-476c-b81d-6c9a0e42e599 tempest-ProjectMemberTests-2128122521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:05:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-2bb08552-0077-476c-b81d-6c9a0e42e599 tempest-ProjectMemberTests-2128122521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:05:30 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-2bb08552-0077-476c-b81d-6c9a0e42e599 tempest-ProjectMemberTests-2128122521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:05:30 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-2bb08552-0077-476c-b81d-6c9a0e42e599 tempest-ProjectMemberTests-2128122521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:05:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-2bb08552-0077-476c-b81d-6c9a0e42e599 tempest-ProjectMemberTests-2128122521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:05:30 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-2bb08552-0077-476c-b81d-6c9a0e42e599 tempest-ProjectMemberTests-2128122521 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:05:30 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-2bb08552-0077-476c-b81d-6c9a0e42e599 tempest-ProjectMemberTests-2128122521 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:05:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2bb08552-0077-476c-b81d-6c9a0e42e599 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:30 devstack sudo[109327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a 1073741824
Nov 06 12:05:30 devstack sudo[109327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:30 devstack sudo[109327]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2bb08552-0077-476c-b81d-6c9a0e42e599 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a 1073741824" returned: 0 in 0.397s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2bb08552-0077-476c-b81d-6c9a0e42e599 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:30 devstack sudo[109332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a
Nov 06 12:05:30 devstack sudo[109332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:30 devstack sudo[109332]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2bb08552-0077-476c-b81d-6c9a0e42e599 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a" returned: 0 in 0.234s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:30 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-2bb08552-0077-476c-b81d-6c9a0e42e599 tempest-ProjectMemberTests-2128122521 None] <== create_volume: return (669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:05:30 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-2bb08552-0077-476c-b81d-6c9a0e42e599 tempest-ProjectMemberTests-2128122521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.672s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:05:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2bb08552-0077-476c-b81d-6c9a0e42e599 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (047b1f3e-4504-4742-b440-e581506630c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:05:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2bb08552-0077-476c-b81d-6c9a0e42e599 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c27d0901-5161-490d-b259-e7b242f2aaf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:05:30 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-2bb08552-0077-476c-b81d-6c9a0e42e599 tempest-ProjectMemberTests-2128122521 None] Volume volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a (76f727c0-c7a7-4895-aa11-24ea24d93f4a): created successfully
Nov 06 12:05:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2bb08552-0077-476c-b81d-6c9a0e42e599 tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c27d0901-5161-490d-b259-e7b242f2aaf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:05:30 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-2bb08552-0077-476c-b81d-6c9a0e42e599 tempest-ProjectMemberTests-2128122521 None] Flow 'volume_create_manager' (83631c4a-69c6-4ac5-921d-b8774ad6989d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:05:30 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-2bb08552-0077-476c-b81d-6c9a0e42e599 tempest-ProjectMemberTests-2128122521 None] Created volume successfully.
Nov 06 12:05:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-54bbb5b3-835d-4e92-b962-6d44f2adb519 tempest-ProjectMemberTests-2128122521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:05:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-54bbb5b3-835d-4e92-b962-6d44f2adb519 tempest-ProjectMemberTests-2128122521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:05:31 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-54bbb5b3-835d-4e92-b962-6d44f2adb519 tempest-ProjectMemberTests-2128122521 None] Creating offline snapshot 8e2af952-e7cf-4fa0-baa1-1f0c9cba36a7 of volume 76f727c0-c7a7-4895-aa11-24ea24d93f4a {{(pid=87165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 12:05:31 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d83385-453c-4b2a-af3e-6af2c2168d4d]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:05:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-54bbb5b3-835d-4e92-b962-6d44f2adb519 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:31 devstack sudo[109335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a
Nov 06 12:05:31 devstack sudo[109335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:31 devstack sudo[109335]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-54bbb5b3-835d-4e92-b962-6d44f2adb519 tempest-ProjectMemberTests-2128122521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a" returned: 0 in 0.343s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-54bbb5b3-835d-4e92-b962-6d44f2adb519 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a.8e2af952-e7cf-4fa0-baa1-1f0c9cba36a7 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:31 devstack sudo[109340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a.8e2af952-e7cf-4fa0-baa1-1f0c9cba36a7 1G
Nov 06 12:05:31 devstack sudo[109340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:31 devstack sudo[109340]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-54bbb5b3-835d-4e92-b962-6d44f2adb519 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a.8e2af952-e7cf-4fa0-baa1-1f0c9cba36a7 1G" returned: 0 in 0.390s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:31 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-54bbb5b3-835d-4e92-b962-6d44f2adb519 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a.8e2af952-e7cf-4fa0-baa1-1f0c9cba36a7 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:31 devstack sudo[109345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a.8e2af952-e7cf-4fa0-baa1-1f0c9cba36a7
Nov 06 12:05:31 devstack sudo[109345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:32 devstack sudo[109345]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-54bbb5b3-835d-4e92-b962-6d44f2adb519 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a.8e2af952-e7cf-4fa0-baa1-1f0c9cba36a7" returned: 0 in 0.302s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:32 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-54bbb5b3-835d-4e92-b962-6d44f2adb519 tempest-ProjectMemberTests-2128122521 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a.8e2af952-e7cf-4fa0-baa1-1f0c9cba36a7 is being set with open permissions: ugo+rw
Nov 06 12:05:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-54bbb5b3-835d-4e92-b962-6d44f2adb519 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a.8e2af952-e7cf-4fa0-baa1-1f0c9cba36a7 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:32 devstack sudo[109350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a.8e2af952-e7cf-4fa0-baa1-1f0c9cba36a7
Nov 06 12:05:32 devstack sudo[109350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:32 devstack sudo[109350]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-54bbb5b3-835d-4e92-b962-6d44f2adb519 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a.8e2af952-e7cf-4fa0-baa1-1f0c9cba36a7" returned: 0 in 0.249s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-54bbb5b3-835d-4e92-b962-6d44f2adb519 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:32 devstack sudo[109353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a.info
Nov 06 12:05:32 devstack sudo[109353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:32 devstack sudo[109353]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-54bbb5b3-835d-4e92-b962-6d44f2adb519 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a.info" returned: 0 in 0.246s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:32 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-54bbb5b3-835d-4e92-b962-6d44f2adb519 tempest-ProjectMemberTests-2128122521 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a.info is being set with open permissions: ugo+rw
Nov 06 12:05:32 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-54bbb5b3-835d-4e92-b962-6d44f2adb519 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:32 devstack sudo[109356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a.info
Nov 06 12:05:32 devstack sudo[109356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:33 devstack sudo[109356]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-54bbb5b3-835d-4e92-b962-6d44f2adb519 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a.info" returned: 0 in 0.248s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-54bbb5b3-835d-4e92-b962-6d44f2adb519 tempest-ProjectMemberTests-2128122521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.855s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:05:33 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-54bbb5b3-835d-4e92-b962-6d44f2adb519 tempest-ProjectMemberTests-2128122521 None] Create snapshot completed successfully
Nov 06 12:05:33 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-2f9a6c06-f52b-4be9-add2-091245080e59 tempest-ProjectMemberTests-2128122521 None] Acquiring lock "cinder-8e2af952-e7cf-4fa0-baa1-1f0c9cba36a7-delete_snapshot" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:05:33 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-2f9a6c06-f52b-4be9-add2-091245080e59 tempest-ProjectMemberTests-2128122521 None] Lock "cinder-8e2af952-e7cf-4fa0-baa1-1f0c9cba36a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:05:33 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-2f9a6c06-f52b-4be9-add2-091245080e59 tempest-ProjectMemberTests-2128122521 None] Acquiring lock "cinder-quobyte-76f727c0-c7a7-4895-aa11-24ea24d93f4a" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:05:33 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-2f9a6c06-f52b-4be9-add2-091245080e59 tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-76f727c0-c7a7-4895-aa11-24ea24d93f4a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:05:33 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-2f9a6c06-f52b-4be9-add2-091245080e59 tempest-ProjectMemberTests-2128122521 None] Acquiring lock "cinder-quobyte-8e2af952-e7cf-4fa0-baa1-1f0c9cba36a7" by "_delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:05:33 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-2f9a6c06-f52b-4be9-add2-091245080e59 tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-8e2af952-e7cf-4fa0-baa1-1f0c9cba36a7" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:05:33 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-2f9a6c06-f52b-4be9-add2-091245080e59 tempest-ProjectMemberTests-2128122521 None] Deleting offline snapshot 8e2af952-e7cf-4fa0-baa1-1f0c9cba36a7 of volume 76f727c0-c7a7-4895-aa11-24ea24d93f4a {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 12:05:33 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-2f9a6c06-f52b-4be9-add2-091245080e59 tempest-ProjectMemberTests-2128122521 None] snapshot_file for this snap is: volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a.8e2af952-e7cf-4fa0-baa1-1f0c9cba36a7 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 12:05:33 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3febe7-0434-466e-8938-bdfbe9c9e899]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:05:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2f9a6c06-f52b-4be9-add2-091245080e59 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a.8e2af952-e7cf-4fa0-baa1-1f0c9cba36a7 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:33 devstack sudo[109359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a.8e2af952-e7cf-4fa0-baa1-1f0c9cba36a7
Nov 06 12:05:33 devstack sudo[109359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:33 devstack sudo[109359]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2f9a6c06-f52b-4be9-add2-091245080e59 tempest-ProjectMemberTests-2128122521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a.8e2af952-e7cf-4fa0-baa1-1f0c9cba36a7" returned: 0 in 0.349s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:33 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-2f9a6c06-f52b-4be9-add2-091245080e59 tempest-ProjectMemberTests-2128122521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 12:05:33 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4be36f8-0e43-4049-851d-a47294b350e5]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:05:33 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2f9a6c06-f52b-4be9-add2-091245080e59 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:33 devstack sudo[109364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a
Nov 06 12:05:33 devstack sudo[109364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:34 devstack sudo[109364]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2f9a6c06-f52b-4be9-add2-091245080e59 tempest-ProjectMemberTests-2128122521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a" returned: 0 in 0.356s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2f9a6c06-f52b-4be9-add2-091245080e59 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a.8e2af952-e7cf-4fa0-baa1-1f0c9cba36a7 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:34 devstack sudo[109369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a.8e2af952-e7cf-4fa0-baa1-1f0c9cba36a7
Nov 06 12:05:34 devstack sudo[109369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:34 devstack sudo[109369]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2f9a6c06-f52b-4be9-add2-091245080e59 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a.8e2af952-e7cf-4fa0-baa1-1f0c9cba36a7" returned: 0 in 0.316s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2f9a6c06-f52b-4be9-add2-091245080e59 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a.8e2af952-e7cf-4fa0-baa1-1f0c9cba36a7 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:34 devstack sudo[109374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a.8e2af952-e7cf-4fa0-baa1-1f0c9cba36a7
Nov 06 12:05:34 devstack sudo[109374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:34 devstack sudo[109374]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:34 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-2f9a6c06-f52b-4be9-add2-091245080e59 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a.8e2af952-e7cf-4fa0-baa1-1f0c9cba36a7" returned: 0 in 0.247s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:34 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-2f9a6c06-f52b-4be9-add2-091245080e59 tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-8e2af952-e7cf-4fa0-baa1-1f0c9cba36a7" released by "_delete_snapshot" :: held 1.361s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:05:34 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-2f9a6c06-f52b-4be9-add2-091245080e59 tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-76f727c0-c7a7-4895-aa11-24ea24d93f4a" released by "delete_snapshot" :: held 1.384s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:05:34 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-2f9a6c06-f52b-4be9-add2-091245080e59 tempest-ProjectMemberTests-2128122521 None] Created reservations ['def149d4-a18c-43c8-abb9-ad74a4422b4b', 'f466ce05-6cca-4d2d-9696-79c266f5b76a', '156cfc85-7d67-409a-93c7-edea4f0bb1a8', '90595bf3-ce8e-4a1a-892d-734bf3183342'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:05:34 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-2f9a6c06-f52b-4be9-add2-091245080e59 tempest-ProjectMemberTests-2128122521 None] Delete snapshot completed successfully.
Nov 06 12:05:34 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-2f9a6c06-f52b-4be9-add2-091245080e59 tempest-ProjectMemberTests-2128122521 None] Lock "cinder-8e2af952-e7cf-4fa0-baa1-1f0c9cba36a7-delete_snapshot" released by "delete_snapshot" :: held 1.516s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:05:35 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0837bea1-b302-4963-b3e0-f3632bdac1d2 tempest-ProjectMemberTests-2128122521 None] Acquiring lock "cinder-76f727c0-c7a7-4895-aa11-24ea24d93f4a-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:05:35 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0837bea1-b302-4963-b3e0-f3632bdac1d2 tempest-ProjectMemberTests-2128122521 None] Lock "cinder-76f727c0-c7a7-4895-aa11-24ea24d93f4a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:05:35 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0837bea1-b302-4963-b3e0-f3632bdac1d2 tempest-ProjectMemberTests-2128122521 None] Acquiring lock "cinder-quobyte-76f727c0-c7a7-4895-aa11-24ea24d93f4a" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:05:35 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0837bea1-b302-4963-b3e0-f3632bdac1d2 tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-76f727c0-c7a7-4895-aa11-24ea24d93f4a" acquired by "delete_volume" :: waited 0.013s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:05:35 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2693628c-8af7-442e-8d36-f69c2505310b]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:05:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0837bea1-b302-4963-b3e0-f3632bdac1d2 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:35 devstack sudo[109378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a
Nov 06 12:05:35 devstack sudo[109378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:35 devstack sudo[109378]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0837bea1-b302-4963-b3e0-f3632bdac1d2 tempest-ProjectMemberTests-2128122521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a" returned: 0 in 0.360s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:35 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0837bea1-b302-4963-b3e0-f3632bdac1d2 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:35 devstack sudo[109383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a
Nov 06 12:05:35 devstack sudo[109383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:36 devstack sudo[109383]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0837bea1-b302-4963-b3e0-f3632bdac1d2 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-76f727c0-c7a7-4895-aa11-24ea24d93f4a" returned: 0 in 0.244s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:36 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0837bea1-b302-4963-b3e0-f3632bdac1d2 tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-76f727c0-c7a7-4895-aa11-24ea24d93f4a" released by "delete_volume" :: held 0.660s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:05:36 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-0837bea1-b302-4963-b3e0-f3632bdac1d2 tempest-ProjectMemberTests-2128122521 None] Created reservations ['6b71f26e-ff79-472e-9a32-a6081a125246', '387f3291-bb56-4ebd-8730-59ce17c6eb90', 'a368b942-13b2-49ff-b0f2-1304c83a4ad9', '8d7f991a-60d2-4c9a-a549-22d19e2a7023'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:05:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-0837bea1-b302-4963-b3e0-f3632bdac1d2 tempest-ProjectMemberTests-2128122521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:05:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-0837bea1-b302-4963-b3e0-f3632bdac1d2 tempest-ProjectMemberTests-2128122521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:05:36 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-0837bea1-b302-4963-b3e0-f3632bdac1d2 tempest-ProjectMemberTests-2128122521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:05:36 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-0837bea1-b302-4963-b3e0-f3632bdac1d2 tempest-ProjectMemberTests-2128122521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:05:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-0837bea1-b302-4963-b3e0-f3632bdac1d2 tempest-ProjectMemberTests-2128122521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:05:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0837bea1-b302-4963-b3e0-f3632bdac1d2 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:36 devstack sudo[109386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:05:36 devstack sudo[109386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:36 devstack sudo[109386]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:36 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-0837bea1-b302-4963-b3e0-f3632bdac1d2 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.239s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:36 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-0837bea1-b302-4963-b3e0-f3632bdac1d2 tempest-ProjectMemberTests-2128122521 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:05:36 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-0837bea1-b302-4963-b3e0-f3632bdac1d2 tempest-ProjectMemberTests-2128122521 None] Deleted volume successfully.
Nov 06 12:05:36 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-0837bea1-b302-4963-b3e0-f3632bdac1d2 tempest-ProjectMemberTests-2128122521 None] Lock "cinder-76f727c0-c7a7-4895-aa11-24ea24d93f4a-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:05:37 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0dd6362-252b-49e5-927b-92e3a7dfc62c tempest-ProjectMemberTests-2128122521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:05:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e0dd6362-252b-49e5-927b-92e3a7dfc62c tempest-ProjectMemberTests-2128122521 None] Flow 'volume_create_manager' (e3c4879e-7439-4486-acb4-f182094f161c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:05:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e0dd6362-252b-49e5-927b-92e3a7dfc62c tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45323ec5-b70c-43c1-884f-38eb0290b2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:05:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e0dd6362-252b-49e5-927b-92e3a7dfc62c tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45323ec5-b70c-43c1-884f-38eb0290b2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-367789899',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1e5b9cb-762a-4178-bd76-b11abaa52aa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3c5c4d5cd09492198badac02cec1874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:05:37Z,use_quota=True,user_id='78f8479fdeb04b689787bce30dc332ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:05:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e0dd6362-252b-49e5-927b-92e3a7dfc62c tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e0d85cc-b136-4f9a-8202-6c29b78bfd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:05:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e0dd6362-252b-49e5-927b-92e3a7dfc62c tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e0d85cc-b136-4f9a-8202-6c29b78bfd7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:05:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e0dd6362-252b-49e5-927b-92e3a7dfc62c tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abe46863-6909-4265-a074-f70b898f8b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:05:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e0dd6362-252b-49e5-927b-92e3a7dfc62c tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abe46863-6909-4265-a074-f70b898f8b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1e5b9cb-762a-4178-bd76-b11abaa52aa7', 'volume_name': 'volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:05:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e0dd6362-252b-49e5-927b-92e3a7dfc62c tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcea1f36-491a-42ff-8cfe-16c76a3a95bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:05:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e0dd6362-252b-49e5-927b-92e3a7dfc62c tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcea1f36-491a-42ff-8cfe-16c76a3a95bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:05:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e0dd6362-252b-49e5-927b-92e3a7dfc62c tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d2f46af-f587-47bd-83de-c54c74b2a532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:05:37 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-e0dd6362-252b-49e5-927b-92e3a7dfc62c tempest-ProjectMemberTests-2128122521 None] Volume a1e5b9cb-762a-4178-bd76-b11abaa52aa7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7', 'volume_size': 1}
Nov 06 12:05:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e0dd6362-252b-49e5-927b-92e3a7dfc62c tempest-ProjectMemberTests-2128122521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:05:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e0dd6362-252b-49e5-927b-92e3a7dfc62c tempest-ProjectMemberTests-2128122521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:05:37 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-e0dd6362-252b-49e5-927b-92e3a7dfc62c tempest-ProjectMemberTests-2128122521 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-367789899',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1e5b9cb-762a-4178-bd76-b11abaa52aa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3c5c4d5cd09492198badac02cec1874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:05:37Z,use_quota=True,user_id='78f8479fdeb04b689787bce30dc332ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:05:37 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-e0dd6362-252b-49e5-927b-92e3a7dfc62c tempest-ProjectMemberTests-2128122521 None] Creating volume a1e5b9cb-762a-4178-bd76-b11abaa52aa7 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:05:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e0dd6362-252b-49e5-927b-92e3a7dfc62c tempest-ProjectMemberTests-2128122521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:05:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e0dd6362-252b-49e5-927b-92e3a7dfc62c tempest-ProjectMemberTests-2128122521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:05:37 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-e0dd6362-252b-49e5-927b-92e3a7dfc62c tempest-ProjectMemberTests-2128122521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:05:37 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-e0dd6362-252b-49e5-927b-92e3a7dfc62c tempest-ProjectMemberTests-2128122521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:05:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e0dd6362-252b-49e5-927b-92e3a7dfc62c tempest-ProjectMemberTests-2128122521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:05:37 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-e0dd6362-252b-49e5-927b-92e3a7dfc62c tempest-ProjectMemberTests-2128122521 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:05:37 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-e0dd6362-252b-49e5-927b-92e3a7dfc62c tempest-ProjectMemberTests-2128122521 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:05:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e0dd6362-252b-49e5-927b-92e3a7dfc62c tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:37 devstack sudo[109389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7 1073741824
Nov 06 12:05:37 devstack sudo[109389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:37 devstack sudo[109389]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e0dd6362-252b-49e5-927b-92e3a7dfc62c tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7 1073741824" returned: 0 in 0.407s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e0dd6362-252b-49e5-927b-92e3a7dfc62c tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:37 devstack sudo[109394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7
Nov 06 12:05:37 devstack sudo[109394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:37 devstack sudo[109394]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-e0dd6362-252b-49e5-927b-92e3a7dfc62c tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7" returned: 0 in 0.249s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:37 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-e0dd6362-252b-49e5-927b-92e3a7dfc62c tempest-ProjectMemberTests-2128122521 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:05:37 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-e0dd6362-252b-49e5-927b-92e3a7dfc62c tempest-ProjectMemberTests-2128122521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:05:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e0dd6362-252b-49e5-927b-92e3a7dfc62c tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d2f46af-f587-47bd-83de-c54c74b2a532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:05:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e0dd6362-252b-49e5-927b-92e3a7dfc62c tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b590cc4-2889-491f-a8e3-62533323c443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:05:37 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-e0dd6362-252b-49e5-927b-92e3a7dfc62c tempest-ProjectMemberTests-2128122521 None] Volume volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7 (a1e5b9cb-762a-4178-bd76-b11abaa52aa7): created successfully
Nov 06 12:05:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e0dd6362-252b-49e5-927b-92e3a7dfc62c tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b590cc4-2889-491f-a8e3-62533323c443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:05:37 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-e0dd6362-252b-49e5-927b-92e3a7dfc62c tempest-ProjectMemberTests-2128122521 None] Flow 'volume_create_manager' (e3c4879e-7439-4486-acb4-f182094f161c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:05:37 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-e0dd6362-252b-49e5-927b-92e3a7dfc62c tempest-ProjectMemberTests-2128122521 None] Created volume successfully.
Nov 06 12:05:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a3b8f4bd-8582-49e1-bebc-d94954b729a3 tempest-ProjectMemberTests-2128122521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:05:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a3b8f4bd-8582-49e1-bebc-d94954b729a3 tempest-ProjectMemberTests-2128122521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:05:38 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-a3b8f4bd-8582-49e1-bebc-d94954b729a3 tempest-ProjectMemberTests-2128122521 None] Creating offline snapshot de9edf68-afa6-441f-81f9-2132615c3d3d of volume a1e5b9cb-762a-4178-bd76-b11abaa52aa7 {{(pid=87165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 12:05:38 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e255e07d-ac92-4cb1-8182-97f5561c8f67]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:05:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a3b8f4bd-8582-49e1-bebc-d94954b729a3 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:38 devstack sudo[109397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7
Nov 06 12:05:38 devstack sudo[109397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:38 devstack sudo[109397]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a3b8f4bd-8582-49e1-bebc-d94954b729a3 tempest-ProjectMemberTests-2128122521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7" returned: 0 in 0.361s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a3b8f4bd-8582-49e1-bebc-d94954b729a3 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7.de9edf68-afa6-441f-81f9-2132615c3d3d 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:38 devstack sudo[109402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7.de9edf68-afa6-441f-81f9-2132615c3d3d 1G
Nov 06 12:05:38 devstack sudo[109402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:38 devstack sudo[109402]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a3b8f4bd-8582-49e1-bebc-d94954b729a3 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7.de9edf68-afa6-441f-81f9-2132615c3d3d 1G" returned: 0 in 0.391s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:38 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a3b8f4bd-8582-49e1-bebc-d94954b729a3 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7.de9edf68-afa6-441f-81f9-2132615c3d3d {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:39 devstack sudo[109407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7.de9edf68-afa6-441f-81f9-2132615c3d3d
Nov 06 12:05:39 devstack sudo[109407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:39 devstack sudo[109407]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a3b8f4bd-8582-49e1-bebc-d94954b729a3 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7.de9edf68-afa6-441f-81f9-2132615c3d3d" returned: 0 in 0.301s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:39 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-a3b8f4bd-8582-49e1-bebc-d94954b729a3 tempest-ProjectMemberTests-2128122521 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7.de9edf68-afa6-441f-81f9-2132615c3d3d is being set with open permissions: ugo+rw
Nov 06 12:05:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a3b8f4bd-8582-49e1-bebc-d94954b729a3 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7.de9edf68-afa6-441f-81f9-2132615c3d3d {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:39 devstack sudo[109412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7.de9edf68-afa6-441f-81f9-2132615c3d3d
Nov 06 12:05:39 devstack sudo[109412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:39 devstack sudo[109412]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a3b8f4bd-8582-49e1-bebc-d94954b729a3 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7.de9edf68-afa6-441f-81f9-2132615c3d3d" returned: 0 in 0.255s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a3b8f4bd-8582-49e1-bebc-d94954b729a3 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:39 devstack sudo[109415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7.info
Nov 06 12:05:39 devstack sudo[109415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:39 devstack sudo[109415]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a3b8f4bd-8582-49e1-bebc-d94954b729a3 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7.info" returned: 0 in 0.268s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:39 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-a3b8f4bd-8582-49e1-bebc-d94954b729a3 tempest-ProjectMemberTests-2128122521 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7.info is being set with open permissions: ugo+rw
Nov 06 12:05:39 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a3b8f4bd-8582-49e1-bebc-d94954b729a3 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:39 devstack sudo[109418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7.info
Nov 06 12:05:39 devstack sudo[109418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:40 devstack sudo[109418]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a3b8f4bd-8582-49e1-bebc-d94954b729a3 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7.info" returned: 0 in 0.245s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a3b8f4bd-8582-49e1-bebc-d94954b729a3 tempest-ProjectMemberTests-2128122521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.900s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:05:40 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-a3b8f4bd-8582-49e1-bebc-d94954b729a3 tempest-ProjectMemberTests-2128122521 None] Create snapshot completed successfully
Nov 06 12:05:40 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ec6cfbad-c67e-418d-abbc-19149cc4824f tempest-ProjectMemberTests-2128122521 None] Acquiring lock "cinder-de9edf68-afa6-441f-81f9-2132615c3d3d-delete_snapshot" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:05:40 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ec6cfbad-c67e-418d-abbc-19149cc4824f tempest-ProjectMemberTests-2128122521 None] Lock "cinder-de9edf68-afa6-441f-81f9-2132615c3d3d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:05:40 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ec6cfbad-c67e-418d-abbc-19149cc4824f tempest-ProjectMemberTests-2128122521 None] Acquiring lock "cinder-quobyte-a1e5b9cb-762a-4178-bd76-b11abaa52aa7" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:05:40 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ec6cfbad-c67e-418d-abbc-19149cc4824f tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-a1e5b9cb-762a-4178-bd76-b11abaa52aa7" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:05:40 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ec6cfbad-c67e-418d-abbc-19149cc4824f tempest-ProjectMemberTests-2128122521 None] Acquiring lock "cinder-quobyte-de9edf68-afa6-441f-81f9-2132615c3d3d" by "_delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:05:40 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ec6cfbad-c67e-418d-abbc-19149cc4824f tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-de9edf68-afa6-441f-81f9-2132615c3d3d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:05:40 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-ec6cfbad-c67e-418d-abbc-19149cc4824f tempest-ProjectMemberTests-2128122521 None] Deleting offline snapshot de9edf68-afa6-441f-81f9-2132615c3d3d of volume a1e5b9cb-762a-4178-bd76-b11abaa52aa7 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 12:05:40 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-ec6cfbad-c67e-418d-abbc-19149cc4824f tempest-ProjectMemberTests-2128122521 None] snapshot_file for this snap is: volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7.de9edf68-afa6-441f-81f9-2132615c3d3d {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 12:05:40 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f54888d-ac75-410a-8294-f3c4fcb05d9b]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:05:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ec6cfbad-c67e-418d-abbc-19149cc4824f tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7.de9edf68-afa6-441f-81f9-2132615c3d3d {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:40 devstack sudo[109421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7.de9edf68-afa6-441f-81f9-2132615c3d3d
Nov 06 12:05:40 devstack sudo[109421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:40 devstack sudo[109421]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ec6cfbad-c67e-418d-abbc-19149cc4824f tempest-ProjectMemberTests-2128122521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7.de9edf68-afa6-441f-81f9-2132615c3d3d" returned: 0 in 0.352s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:40 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-ec6cfbad-c67e-418d-abbc-19149cc4824f tempest-ProjectMemberTests-2128122521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 12:05:40 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[599b38d7-4add-4567-ab31-38e99e7ee479]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:05:40 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ec6cfbad-c67e-418d-abbc-19149cc4824f tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:40 devstack sudo[109426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7
Nov 06 12:05:40 devstack sudo[109426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:41 devstack sudo[109426]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ec6cfbad-c67e-418d-abbc-19149cc4824f tempest-ProjectMemberTests-2128122521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7" returned: 0 in 0.348s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ec6cfbad-c67e-418d-abbc-19149cc4824f tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7.de9edf68-afa6-441f-81f9-2132615c3d3d {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:41 devstack sudo[109431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7.de9edf68-afa6-441f-81f9-2132615c3d3d
Nov 06 12:05:41 devstack sudo[109431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:41 devstack sudo[109431]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ec6cfbad-c67e-418d-abbc-19149cc4824f tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7.de9edf68-afa6-441f-81f9-2132615c3d3d" returned: 0 in 0.331s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ec6cfbad-c67e-418d-abbc-19149cc4824f tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7.de9edf68-afa6-441f-81f9-2132615c3d3d {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:41 devstack sudo[109436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7.de9edf68-afa6-441f-81f9-2132615c3d3d
Nov 06 12:05:41 devstack sudo[109436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:41 devstack sudo[109436]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:41 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-ec6cfbad-c67e-418d-abbc-19149cc4824f tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7.de9edf68-afa6-441f-81f9-2132615c3d3d" returned: 0 in 0.245s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:41 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ec6cfbad-c67e-418d-abbc-19149cc4824f tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-de9edf68-afa6-441f-81f9-2132615c3d3d" released by "_delete_snapshot" :: held 1.370s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:05:41 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ec6cfbad-c67e-418d-abbc-19149cc4824f tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-a1e5b9cb-762a-4178-bd76-b11abaa52aa7" released by "delete_snapshot" :: held 1.395s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:05:41 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-ec6cfbad-c67e-418d-abbc-19149cc4824f tempest-ProjectMemberTests-2128122521 None] Created reservations ['ed201e29-e729-44dc-a0ec-b193bdeda26e', 'd372bd91-040c-46e3-8a5f-796a1d099c4f', '61772078-3d28-4679-96c4-36cc737d21fa', '1e0b7406-f85e-4e53-a423-fd638097e0da'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:05:41 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-ec6cfbad-c67e-418d-abbc-19149cc4824f tempest-ProjectMemberTests-2128122521 None] Delete snapshot completed successfully.
Nov 06 12:05:41 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-ec6cfbad-c67e-418d-abbc-19149cc4824f tempest-ProjectMemberTests-2128122521 None] Lock "cinder-de9edf68-afa6-441f-81f9-2132615c3d3d-delete_snapshot" released by "delete_snapshot" :: held 1.525s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:05:42 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-f58b6c44-54f6-469f-a4da-c16bec980ae8 tempest-ProjectMemberTests-2128122521 None] Acquiring lock "cinder-a1e5b9cb-762a-4178-bd76-b11abaa52aa7-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:05:42 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-f58b6c44-54f6-469f-a4da-c16bec980ae8 tempest-ProjectMemberTests-2128122521 None] Lock "cinder-a1e5b9cb-762a-4178-bd76-b11abaa52aa7-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:05:42 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-f58b6c44-54f6-469f-a4da-c16bec980ae8 tempest-ProjectMemberTests-2128122521 None] Acquiring lock "cinder-quobyte-a1e5b9cb-762a-4178-bd76-b11abaa52aa7" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:05:42 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-f58b6c44-54f6-469f-a4da-c16bec980ae8 tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-a1e5b9cb-762a-4178-bd76-b11abaa52aa7" acquired by "delete_volume" :: waited 0.017s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:05:42 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ac40e5-a66e-4ddb-99ac-05779a1ea5e3]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:05:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f58b6c44-54f6-469f-a4da-c16bec980ae8 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:42 devstack sudo[109439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7
Nov 06 12:05:42 devstack sudo[109439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:42 devstack sudo[109439]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f58b6c44-54f6-469f-a4da-c16bec980ae8 tempest-ProjectMemberTests-2128122521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7" returned: 0 in 0.359s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:42 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f58b6c44-54f6-469f-a4da-c16bec980ae8 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:42 devstack sudo[109445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7
Nov 06 12:05:42 devstack sudo[109445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:43 devstack sudo[109445]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f58b6c44-54f6-469f-a4da-c16bec980ae8 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-a1e5b9cb-762a-4178-bd76-b11abaa52aa7" returned: 0 in 0.255s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:43 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-f58b6c44-54f6-469f-a4da-c16bec980ae8 tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-a1e5b9cb-762a-4178-bd76-b11abaa52aa7" released by "delete_volume" :: held 0.674s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:05:43 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-f58b6c44-54f6-469f-a4da-c16bec980ae8 tempest-ProjectMemberTests-2128122521 None] Created reservations ['5d467aab-b642-4a5e-b16e-8b37d42f3d87', '7e6450eb-9e20-4205-b53e-673ae32a0164', 'd1fa16d5-7d60-4def-ad9a-bde0cbe3d468', '13b56da0-6a52-4ef5-8208-194eb8a44253'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:05:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f58b6c44-54f6-469f-a4da-c16bec980ae8 tempest-ProjectMemberTests-2128122521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:05:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f58b6c44-54f6-469f-a4da-c16bec980ae8 tempest-ProjectMemberTests-2128122521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:05:43 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-f58b6c44-54f6-469f-a4da-c16bec980ae8 tempest-ProjectMemberTests-2128122521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:05:43 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-f58b6c44-54f6-469f-a4da-c16bec980ae8 tempest-ProjectMemberTests-2128122521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:05:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-f58b6c44-54f6-469f-a4da-c16bec980ae8 tempest-ProjectMemberTests-2128122521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:05:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f58b6c44-54f6-469f-a4da-c16bec980ae8 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:43 devstack sudo[109448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:05:43 devstack sudo[109448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:43 devstack sudo[109448]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:43 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-f58b6c44-54f6-469f-a4da-c16bec980ae8 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.265s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:43 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-f58b6c44-54f6-469f-a4da-c16bec980ae8 tempest-ProjectMemberTests-2128122521 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:05:43 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-f58b6c44-54f6-469f-a4da-c16bec980ae8 tempest-ProjectMemberTests-2128122521 None] Deleted volume successfully.
Nov 06 12:05:43 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-f58b6c44-54f6-469f-a4da-c16bec980ae8 tempest-ProjectMemberTests-2128122521 None] Lock "cinder-a1e5b9cb-762a-4178-bd76-b11abaa52aa7-delete_volume" released by "delete_volume" :: held 1.158s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:05:44 devstack cinder-volume[87165]: DEBUG cinder.volume.flows.manager.create_volume [None req-6212b1da-b4c3-4108-a7d0-c8e7e419ac3c tempest-ProjectMemberTests-2128122521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 06 12:05:44 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6212b1da-b4c3-4108-a7d0-c8e7e419ac3c tempest-ProjectMemberTests-2128122521 None] Flow 'volume_create_manager' (aeced0e2-4cde-40ee-b02c-ab72180905cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:05:44 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6212b1da-b4c3-4108-a7d0-c8e7e419ac3c tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebd714b3-7971-4610-b94e-63da4807bd85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:05:44 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6212b1da-b4c3-4108-a7d0-c8e7e419ac3c tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebd714b3-7971-4610-b94e-63da4807bd85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:05:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2063619596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=721c50ff-2523-4019-b572-1750fe20fce8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3c5c4d5cd09492198badac02cec1874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:05:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:05:44Z,use_quota=True,user_id='78f8479fdeb04b689787bce30dc332ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:05:44 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6212b1da-b4c3-4108-a7d0-c8e7e419ac3c tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e448f6f-360a-4c6b-8c19-b9424d2c4424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:05:44 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6212b1da-b4c3-4108-a7d0-c8e7e419ac3c tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e448f6f-360a-4c6b-8c19-b9424d2c4424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:05:44 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6212b1da-b4c3-4108-a7d0-c8e7e419ac3c tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88dc70b8-a71b-4d67-8b57-072db1e6235a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:05:44 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6212b1da-b4c3-4108-a7d0-c8e7e419ac3c tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88dc70b8-a71b-4d67-8b57-072db1e6235a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '721c50ff-2523-4019-b572-1750fe20fce8', 'volume_name': 'volume-721c50ff-2523-4019-b572-1750fe20fce8', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:05:44 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6212b1da-b4c3-4108-a7d0-c8e7e419ac3c tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9ebb773-de24-4cb4-b861-e1876714d94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:05:44 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6212b1da-b4c3-4108-a7d0-c8e7e419ac3c tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9ebb773-de24-4cb4-b861-e1876714d94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:05:44 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6212b1da-b4c3-4108-a7d0-c8e7e419ac3c tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (105b04d8-36cf-4b39-a2de-03b5c22c4190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:05:44 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-6212b1da-b4c3-4108-a7d0-c8e7e419ac3c tempest-ProjectMemberTests-2128122521 None] Volume 721c50ff-2523-4019-b572-1750fe20fce8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-721c50ff-2523-4019-b572-1750fe20fce8', 'volume_size': 1}
Nov 06 12:05:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6212b1da-b4c3-4108-a7d0-c8e7e419ac3c tempest-ProjectMemberTests-2128122521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:05:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6212b1da-b4c3-4108-a7d0-c8e7e419ac3c tempest-ProjectMemberTests-2128122521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:05:44 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-6212b1da-b4c3-4108-a7d0-c8e7e419ac3c tempest-ProjectMemberTests-2128122521 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x742c1f574950>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-06T11:05:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2063619596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=721c50ff-2523-4019-b572-1750fe20fce8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3c5c4d5cd09492198badac02cec1874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:05:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:05:44Z,use_quota=True,user_id='78f8479fdeb04b689787bce30dc332ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f4d1d73-7d17-46a9-9f41-e9132466ceeb),volume_type_id=0f4d1d73-7d17-46a9-9f41-e9132466ceeb)}" {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 06 12:05:44 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-6212b1da-b4c3-4108-a7d0-c8e7e419ac3c tempest-ProjectMemberTests-2128122521 None] Creating volume 721c50ff-2523-4019-b572-1750fe20fce8 {{(pid=87165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 06 12:05:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6212b1da-b4c3-4108-a7d0-c8e7e419ac3c tempest-ProjectMemberTests-2128122521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:05:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6212b1da-b4c3-4108-a7d0-c8e7e419ac3c tempest-ProjectMemberTests-2128122521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:05:44 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-6212b1da-b4c3-4108-a7d0-c8e7e419ac3c tempest-ProjectMemberTests-2128122521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:05:44 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-6212b1da-b4c3-4108-a7d0-c8e7e419ac3c tempest-ProjectMemberTests-2128122521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:05:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6212b1da-b4c3-4108-a7d0-c8e7e419ac3c tempest-ProjectMemberTests-2128122521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:05:44 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-6212b1da-b4c3-4108-a7d0-c8e7e419ac3c tempest-ProjectMemberTests-2128122521 None] Selected osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50 as target Quobyte volume. {{(pid=87165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 06 12:05:44 devstack cinder-volume[87165]: INFO cinder.volume.drivers.remotefs [None req-6212b1da-b4c3-4108-a7d0-c8e7e419ac3c tempest-ProjectMemberTests-2128122521 None] casted to osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50
Nov 06 12:05:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6212b1da-b4c3-4108-a7d0-c8e7e419ac3c tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-721c50ff-2523-4019-b572-1750fe20fce8 1073741824 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:44 devstack sudo[109451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-721c50ff-2523-4019-b572-1750fe20fce8 1073741824
Nov 06 12:05:44 devstack sudo[109451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:44 devstack sudo[109451]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6212b1da-b4c3-4108-a7d0-c8e7e419ac3c tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-721c50ff-2523-4019-b572-1750fe20fce8 1073741824" returned: 0 in 0.421s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6212b1da-b4c3-4108-a7d0-c8e7e419ac3c tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-721c50ff-2523-4019-b572-1750fe20fce8 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:44 devstack sudo[109457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-721c50ff-2523-4019-b572-1750fe20fce8
Nov 06 12:05:44 devstack sudo[109457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:44 devstack sudo[109457]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-6212b1da-b4c3-4108-a7d0-c8e7e419ac3c tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-721c50ff-2523-4019-b572-1750fe20fce8" returned: 0 in 0.261s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:44 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-6212b1da-b4c3-4108-a7d0-c8e7e419ac3c tempest-ProjectMemberTests-2128122521 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'} {{(pid=87165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 06 12:05:44 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-6212b1da-b4c3-4108-a7d0-c8e7e419ac3c tempest-ProjectMemberTests-2128122521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:05:44 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6212b1da-b4c3-4108-a7d0-c8e7e419ac3c tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (105b04d8-36cf-4b39-a2de-03b5c22c4190) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-721c50ff-2523-4019-b572-1750fe20fce8', 'volume_size': 1}' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:05:44 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6212b1da-b4c3-4108-a7d0-c8e7e419ac3c tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0221fae-2b71-44fd-87aa-c8c13d33ebbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 06 12:05:44 devstack cinder-volume[87165]: INFO cinder.volume.flows.manager.create_volume [None req-6212b1da-b4c3-4108-a7d0-c8e7e419ac3c tempest-ProjectMemberTests-2128122521 None] Volume volume-721c50ff-2523-4019-b572-1750fe20fce8 (721c50ff-2523-4019-b572-1750fe20fce8): created successfully
Nov 06 12:05:44 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6212b1da-b4c3-4108-a7d0-c8e7e419ac3c tempest-ProjectMemberTests-2128122521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0221fae-2b71-44fd-87aa-c8c13d33ebbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 06 12:05:44 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-6212b1da-b4c3-4108-a7d0-c8e7e419ac3c tempest-ProjectMemberTests-2128122521 None] Flow 'volume_create_manager' (aeced0e2-4cde-40ee-b02c-ab72180905cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 06 12:05:44 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-6212b1da-b4c3-4108-a7d0-c8e7e419ac3c tempest-ProjectMemberTests-2128122521 None] Created volume successfully.
Nov 06 12:05:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-658b048b-b8bc-4e4d-87d2-c3e02d8ef18c tempest-ProjectMemberTests-2128122521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:05:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-658b048b-b8bc-4e4d-87d2-c3e02d8ef18c tempest-ProjectMemberTests-2128122521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:05:45 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-658b048b-b8bc-4e4d-87d2-c3e02d8ef18c tempest-ProjectMemberTests-2128122521 None] Creating offline snapshot ef938e1e-f0cb-4468-a46b-328dd1051fe9 of volume 721c50ff-2523-4019-b572-1750fe20fce8 {{(pid=87165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 06 12:05:45 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6110be91-be78-4edf-b289-2313a1453523]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:05:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-658b048b-b8bc-4e4d-87d2-c3e02d8ef18c tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-721c50ff-2523-4019-b572-1750fe20fce8 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:45 devstack sudo[109463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-721c50ff-2523-4019-b572-1750fe20fce8
Nov 06 12:05:45 devstack sudo[109463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:45 devstack sudo[109463]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-658b048b-b8bc-4e4d-87d2-c3e02d8ef18c tempest-ProjectMemberTests-2128122521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-721c50ff-2523-4019-b572-1750fe20fce8" returned: 0 in 0.369s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:45 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-658b048b-b8bc-4e4d-87d2-c3e02d8ef18c tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-721c50ff-2523-4019-b572-1750fe20fce8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-721c50ff-2523-4019-b572-1750fe20fce8.ef938e1e-f0cb-4468-a46b-328dd1051fe9 1G {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:45 devstack sudo[109468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-721c50ff-2523-4019-b572-1750fe20fce8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-721c50ff-2523-4019-b572-1750fe20fce8.ef938e1e-f0cb-4468-a46b-328dd1051fe9 1G
Nov 06 12:05:45 devstack sudo[109468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:46 devstack sudo[109468]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-658b048b-b8bc-4e4d-87d2-c3e02d8ef18c tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-721c50ff-2523-4019-b572-1750fe20fce8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-721c50ff-2523-4019-b572-1750fe20fce8.ef938e1e-f0cb-4468-a46b-328dd1051fe9 1G" returned: 0 in 0.408s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-658b048b-b8bc-4e4d-87d2-c3e02d8ef18c tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-721c50ff-2523-4019-b572-1750fe20fce8 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-721c50ff-2523-4019-b572-1750fe20fce8.ef938e1e-f0cb-4468-a46b-328dd1051fe9 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:46 devstack sudo[109474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-721c50ff-2523-4019-b572-1750fe20fce8 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-721c50ff-2523-4019-b572-1750fe20fce8.ef938e1e-f0cb-4468-a46b-328dd1051fe9
Nov 06 12:05:46 devstack sudo[109474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:46 devstack sudo[109474]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-658b048b-b8bc-4e4d-87d2-c3e02d8ef18c tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-721c50ff-2523-4019-b572-1750fe20fce8 -F qcow2 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-721c50ff-2523-4019-b572-1750fe20fce8.ef938e1e-f0cb-4468-a46b-328dd1051fe9" returned: 0 in 0.299s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:46 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-658b048b-b8bc-4e4d-87d2-c3e02d8ef18c tempest-ProjectMemberTests-2128122521 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-721c50ff-2523-4019-b572-1750fe20fce8.ef938e1e-f0cb-4468-a46b-328dd1051fe9 is being set with open permissions: ugo+rw
Nov 06 12:05:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-658b048b-b8bc-4e4d-87d2-c3e02d8ef18c tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-721c50ff-2523-4019-b572-1750fe20fce8.ef938e1e-f0cb-4468-a46b-328dd1051fe9 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:46 devstack sudo[109479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-721c50ff-2523-4019-b572-1750fe20fce8.ef938e1e-f0cb-4468-a46b-328dd1051fe9
Nov 06 12:05:46 devstack sudo[109479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:46 devstack sudo[109479]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-658b048b-b8bc-4e4d-87d2-c3e02d8ef18c tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-721c50ff-2523-4019-b572-1750fe20fce8.ef938e1e-f0cb-4468-a46b-328dd1051fe9" returned: 0 in 0.258s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-658b048b-b8bc-4e4d-87d2-c3e02d8ef18c tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-721c50ff-2523-4019-b572-1750fe20fce8.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:46 devstack sudo[109482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-721c50ff-2523-4019-b572-1750fe20fce8.info
Nov 06 12:05:46 devstack sudo[109482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:46 devstack sudo[109482]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-658b048b-b8bc-4e4d-87d2-c3e02d8ef18c tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-721c50ff-2523-4019-b572-1750fe20fce8.info" returned: 0 in 0.269s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:46 devstack cinder-volume[87165]: WARNING cinder.volume.drivers.remotefs [None req-658b048b-b8bc-4e4d-87d2-c3e02d8ef18c tempest-ProjectMemberTests-2128122521 None] /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-721c50ff-2523-4019-b572-1750fe20fce8.info is being set with open permissions: ugo+rw
Nov 06 12:05:46 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-658b048b-b8bc-4e4d-87d2-c3e02d8ef18c tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-721c50ff-2523-4019-b572-1750fe20fce8.info {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:47 devstack sudo[109485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-721c50ff-2523-4019-b572-1750fe20fce8.info
Nov 06 12:05:47 devstack sudo[109485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:47 devstack sudo[109485]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-658b048b-b8bc-4e4d-87d2-c3e02d8ef18c tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-721c50ff-2523-4019-b572-1750fe20fce8.info" returned: 0 in 0.258s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-658b048b-b8bc-4e4d-87d2-c3e02d8ef18c tempest-ProjectMemberTests-2128122521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.954s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:05:47 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-658b048b-b8bc-4e4d-87d2-c3e02d8ef18c tempest-ProjectMemberTests-2128122521 None] Create snapshot completed successfully
Nov 06 12:05:47 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-acb756d2-31ad-49b3-9a28-c2fdaab93430 tempest-ProjectMemberTests-2128122521 None] Acquiring lock "cinder-ef938e1e-f0cb-4468-a46b-328dd1051fe9-delete_snapshot" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:05:47 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-acb756d2-31ad-49b3-9a28-c2fdaab93430 tempest-ProjectMemberTests-2128122521 None] Lock "cinder-ef938e1e-f0cb-4468-a46b-328dd1051fe9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:05:47 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-acb756d2-31ad-49b3-9a28-c2fdaab93430 tempest-ProjectMemberTests-2128122521 None] Acquiring lock "cinder-quobyte-721c50ff-2523-4019-b572-1750fe20fce8" by "delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:05:47 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-acb756d2-31ad-49b3-9a28-c2fdaab93430 tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-721c50ff-2523-4019-b572-1750fe20fce8" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:05:47 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-acb756d2-31ad-49b3-9a28-c2fdaab93430 tempest-ProjectMemberTests-2128122521 None] Acquiring lock "cinder-quobyte-ef938e1e-f0cb-4468-a46b-328dd1051fe9" by "_delete_snapshot" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:05:47 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-acb756d2-31ad-49b3-9a28-c2fdaab93430 tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-ef938e1e-f0cb-4468-a46b-328dd1051fe9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:05:47 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-acb756d2-31ad-49b3-9a28-c2fdaab93430 tempest-ProjectMemberTests-2128122521 None] Deleting offline snapshot ef938e1e-f0cb-4468-a46b-328dd1051fe9 of volume 721c50ff-2523-4019-b572-1750fe20fce8 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 06 12:05:47 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-acb756d2-31ad-49b3-9a28-c2fdaab93430 tempest-ProjectMemberTests-2128122521 None] snapshot_file for this snap is: volume-721c50ff-2523-4019-b572-1750fe20fce8.ef938e1e-f0cb-4468-a46b-328dd1051fe9 {{(pid=87165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 06 12:05:47 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[26363158-9c91-443e-ad68-86982c65e4a9]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:05:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-acb756d2-31ad-49b3-9a28-c2fdaab93430 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-721c50ff-2523-4019-b572-1750fe20fce8.ef938e1e-f0cb-4468-a46b-328dd1051fe9 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:47 devstack sudo[109488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-721c50ff-2523-4019-b572-1750fe20fce8.ef938e1e-f0cb-4468-a46b-328dd1051fe9
Nov 06 12:05:47 devstack sudo[109488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:47 devstack sudo[109488]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:47 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-acb756d2-31ad-49b3-9a28-c2fdaab93430 tempest-ProjectMemberTests-2128122521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-721c50ff-2523-4019-b572-1750fe20fce8.ef938e1e-f0cb-4468-a46b-328dd1051fe9" returned: 0 in 0.364s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:47 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.remotefs [None req-acb756d2-31ad-49b3-9a28-c2fdaab93430 tempest-ProjectMemberTests-2128122521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-721c50ff-2523-4019-b572-1750fe20fce8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 06 12:05:48 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd63940-c3e3-4474-8173-99a627410543]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:05:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-acb756d2-31ad-49b3-9a28-c2fdaab93430 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-721c50ff-2523-4019-b572-1750fe20fce8 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:48 devstack sudo[109493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-721c50ff-2523-4019-b572-1750fe20fce8
Nov 06 12:05:48 devstack sudo[109493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:48 devstack sudo[109493]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-acb756d2-31ad-49b3-9a28-c2fdaab93430 tempest-ProjectMemberTests-2128122521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-721c50ff-2523-4019-b572-1750fe20fce8" returned: 0 in 0.355s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-acb756d2-31ad-49b3-9a28-c2fdaab93430 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-721c50ff-2523-4019-b572-1750fe20fce8.ef938e1e-f0cb-4468-a46b-328dd1051fe9 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:48 devstack sudo[109498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-721c50ff-2523-4019-b572-1750fe20fce8.ef938e1e-f0cb-4468-a46b-328dd1051fe9
Nov 06 12:05:48 devstack sudo[109498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:48 devstack sudo[109498]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-acb756d2-31ad-49b3-9a28-c2fdaab93430 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-721c50ff-2523-4019-b572-1750fe20fce8.ef938e1e-f0cb-4468-a46b-328dd1051fe9" returned: 0 in 0.325s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-acb756d2-31ad-49b3-9a28-c2fdaab93430 tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-721c50ff-2523-4019-b572-1750fe20fce8.ef938e1e-f0cb-4468-a46b-328dd1051fe9 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:48 devstack sudo[109503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-721c50ff-2523-4019-b572-1750fe20fce8.ef938e1e-f0cb-4468-a46b-328dd1051fe9
Nov 06 12:05:48 devstack sudo[109503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:48 devstack sudo[109503]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:48 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-acb756d2-31ad-49b3-9a28-c2fdaab93430 tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-721c50ff-2523-4019-b572-1750fe20fce8.ef938e1e-f0cb-4468-a46b-328dd1051fe9" returned: 0 in 0.250s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:48 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-acb756d2-31ad-49b3-9a28-c2fdaab93430 tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-ef938e1e-f0cb-4468-a46b-328dd1051fe9" released by "_delete_snapshot" :: held 1.386s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:05:48 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-acb756d2-31ad-49b3-9a28-c2fdaab93430 tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-721c50ff-2523-4019-b572-1750fe20fce8" released by "delete_snapshot" :: held 1.410s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:05:49 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-acb756d2-31ad-49b3-9a28-c2fdaab93430 tempest-ProjectMemberTests-2128122521 None] Created reservations ['0c43cad5-88b4-4608-ba1d-e0a7870a9355', '8aa2f68f-cd99-402c-a85a-97b5be8687e5', '0d5b02d3-895e-4d7b-bbdb-b601d16c7202', '6ce48bf4-13bb-429b-8980-c05cc6d6bda9'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:05:49 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-acb756d2-31ad-49b3-9a28-c2fdaab93430 tempest-ProjectMemberTests-2128122521 None] Delete snapshot completed successfully.
Nov 06 12:05:49 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-acb756d2-31ad-49b3-9a28-c2fdaab93430 tempest-ProjectMemberTests-2128122521 None] Lock "cinder-ef938e1e-f0cb-4468-a46b-328dd1051fe9-delete_snapshot" released by "delete_snapshot" :: held 1.547s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:05:49 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a14e1518-4a32-4d1d-ab94-dd0013f5aa9d tempest-ProjectMemberTests-2128122521 None] Acquiring lock "cinder-721c50ff-2523-4019-b572-1750fe20fce8-delete_volume" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:05:49 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a14e1518-4a32-4d1d-ab94-dd0013f5aa9d tempest-ProjectMemberTests-2128122521 None] Lock "cinder-721c50ff-2523-4019-b572-1750fe20fce8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:05:49 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a14e1518-4a32-4d1d-ab94-dd0013f5aa9d tempest-ProjectMemberTests-2128122521 None] Acquiring lock "cinder-quobyte-721c50ff-2523-4019-b572-1750fe20fce8" by "delete_volume" {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 06 12:05:49 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a14e1518-4a32-4d1d-ab94-dd0013f5aa9d tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-721c50ff-2523-4019-b572-1750fe20fce8" acquired by "delete_volume" :: waited 0.015s {{(pid=87165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 06 12:05:49 devstack cinder-volume[87165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a98a80a-f1e6-4b1d-8d0f-b91666b69307]: (4, 'qcow2') {{(pid=88431) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 06 12:05:49 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a14e1518-4a32-4d1d-ab94-dd0013f5aa9d tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-721c50ff-2523-4019-b572-1750fe20fce8 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:49 devstack sudo[109506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-721c50ff-2523-4019-b572-1750fe20fce8
Nov 06 12:05:49 devstack sudo[109506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:50 devstack sudo[109506]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a14e1518-4a32-4d1d-ab94-dd0013f5aa9d tempest-ProjectMemberTests-2128122521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-721c50ff-2523-4019-b572-1750fe20fce8" returned: 0 in 0.360s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a14e1518-4a32-4d1d-ab94-dd0013f5aa9d tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-721c50ff-2523-4019-b572-1750fe20fce8 {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:50 devstack sudo[109511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-721c50ff-2523-4019-b572-1750fe20fce8
Nov 06 12:05:50 devstack sudo[109511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:50 devstack sudo[109511]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a14e1518-4a32-4d1d-ab94-dd0013f5aa9d tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e/volume-721c50ff-2523-4019-b572-1750fe20fce8" returned: 0 in 0.252s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:50 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a14e1518-4a32-4d1d-ab94-dd0013f5aa9d tempest-ProjectMemberTests-2128122521 None] Lock "cinder-quobyte-721c50ff-2523-4019-b572-1750fe20fce8" released by "delete_volume" :: held 0.668s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:05:50 devstack cinder-volume[87165]: DEBUG cinder.quota [None req-a14e1518-4a32-4d1d-ab94-dd0013f5aa9d tempest-ProjectMemberTests-2128122521 None] Created reservations ['987ef7c2-be0c-4602-85b6-e9430654bd4a', '882a3e2e-43cb-4ba6-b1d3-55f62196480b', '79fef441-26fb-4ebf-a788-7840e3f9d0da', 'f9e7e60b-3fbe-45af-bd38-f35885094e5e'] {{(pid=87165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 06 12:05:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a14e1518-4a32-4d1d-ab94-dd0013f5aa9d tempest-ProjectMemberTests-2128122521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:05:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a14e1518-4a32-4d1d-ab94-dd0013f5aa9d tempest-ProjectMemberTests-2128122521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:05:50 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a14e1518-4a32-4d1d-ab94-dd0013f5aa9d tempest-ProjectMemberTests-2128122521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:05:50 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-a14e1518-4a32-4d1d-ab94-dd0013f5aa9d tempest-ProjectMemberTests-2128122521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:05:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-a14e1518-4a32-4d1d-ab94-dd0013f5aa9d tempest-ProjectMemberTests-2128122521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:05:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a14e1518-4a32-4d1d-ab94-dd0013f5aa9d tempest-ProjectMemberTests-2128122521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:05:50 devstack sudo[109514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:05:50 devstack sudo[109514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:05:50 devstack sudo[109514]: pam_unix(sudo:session): session closed for user root
Nov 06 12:05:50 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-a14e1518-4a32-4d1d-ab94-dd0013f5aa9d tempest-ProjectMemberTests-2128122521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.262s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:05:50 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-a14e1518-4a32-4d1d-ab94-dd0013f5aa9d tempest-ProjectMemberTests-2128122521 None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:05:50 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-a14e1518-4a32-4d1d-ab94-dd0013f5aa9d tempest-ProjectMemberTests-2128122521 None] Deleted volume successfully.
Nov 06 12:05:50 devstack cinder-volume[87165]: DEBUG cinder.coordination [None req-a14e1518-4a32-4d1d-ab94-dd0013f5aa9d tempest-ProjectMemberTests-2128122521 None] Lock "cinder-721c50ff-2523-4019-b572-1750fe20fce8-delete_volume" released by "delete_volume" :: held 1.128s {{(pid=87165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 06 12:06:00 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:SELECT=100,cinder:INSERT=31,cinder:UPDATE=113,cinder:DELETE=9 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 12:06:00 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:INSERT=37,cinder:UPDATE=131,cinder:SELECT=86,cinder:DELETE=10 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 06 12:06:17 devstack cinder-volume[87165]: DEBUG oslo_service.periodic_task [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 12:06:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 06 12:06:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 06 12:06:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50': None} {{(pid=87165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 06 12:06:17 devstack cinder-volume[87165]: DEBUG cinder.volume.drivers.quobyte [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-84d05012-2b45-4b03-a2ed-da02703f6d50'] {{(pid=87165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 06 12:06:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 06 12:06:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 06 12:06:17 devstack sudo[109765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e
Nov 06 12:06:17 devstack sudo[109765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 06 12:06:17 devstack sudo[109765]: pam_unix(sudo:session): session closed for user root
Nov 06 12:06:17 devstack cinder-volume[87165]: DEBUG oslo_concurrency.processutils [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d51235c5f8377c13b1f504e365ff31e" returned: 0 in 0.239s {{(pid=87165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 06 12:06:17 devstack cinder-volume[87165]: DEBUG cinder.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Notifying Schedulers of capabilities ... {{(pid=87165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 06 12:06:17 devstack cinder-volume[87165]: DEBUG oslo_service.periodic_task [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] Running periodic task VolumeManager._thread_info {{(pid=87165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 06 12:06:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] thread count: 29 {{(pid=87165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 06 12:06:17 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-01388048-3faa-4b37-bed5-7e6be5ea76b3 None None] thread info: [<_MainThread(MainThread, started 127732956901504)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127732842693056)>, <Thread(Thread-3 (stat_writer), started daemon 127732841891136)>, <Thread(Rabbit-heartbeat, started daemon 127732842515648)>, <Thread(Thread-5 (_runner), started daemon 127732840534464)>, <Thread(Thread-7 (_runner), started daemon 127732840636032)>, <Thread(fd_logger, started daemon 127732838664256)>, <Thread(privsep_reader, started daemon 127732838673408)>, <Thread(tpool_thread_0, started daemon 127732829828800)>, <Thread(tpool_thread_1, started daemon 127732821436096)>, <Thread(tpool_thread_2, started daemon 127732813043392)>, <Thread(tpool_thread_3, started daemon 127732804650688)>, <Thread(tpool_thread_4, started daemon 127732796257984)>, <Thread(tpool_thread_5, started daemon 127732787865280)>, <Thread(tpool_thread_6, started daemon 127732779456192)>, <Thread(tpool_thread_7, started daemon 127732771047104)>, <Thread(tpool_thread_8, started daemon 127732762638016)>, <Thread(tpool_thread_9, started daemon 127732754228928)>, <Thread(tpool_thread_10, started daemon 127732745819840)>, <Thread(tpool_thread_11, started daemon 127732737410752)>, <Thread(tpool_thread_12, started daemon 127732729001664)>, <Thread(tpool_thread_13, started daemon 127732720592576)>, <Thread(tpool_thread_14, started daemon 127732712183488)>, <Thread(tpool_thread_15, started daemon 127732703774400)>, <Thread(tpool_thread_16, started daemon 127732695365312)>, <Thread(tpool_thread_17, started daemon 127732686956224)>, <Thread(tpool_thread_18, started daemon 127732678547136)>, <Thread(tpool_thread_19, started daemon 127732670138048)>, <Thread(Rabbit-heartbeat, started daemon 127732832631296)>] {{(pid=87165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}